2023-12-01T23:00:32.517 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T23:00:32.517 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} --verbose --archive /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453 --owner scheduled_yuriw@teuthology --name yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/orig.config.yaml 2023-12-01T23:00:32.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:00:32.638 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453 branch: main description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7474453' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow request - SLOW_OPS - MON_DOWN sha1: bed7681480ccb0192b91a35e691658867e1e96b7 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: bed7681480ccb0192b91a35e691658867e1e96b7 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: bed7681480ccb0192b91a35e691658867e1e96b7 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1991 sha1: bed7681480ccb0192b91a35e691658867e1e96b7 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: bed7681480ccb0192b91a35e691658867e1e96b7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5u9+uNlGB2YWutX3Cmr7b6ud89iTWgYtn5XMcLs4DdTp8j0oxlfDvkBy0pyaEvFYIQjLgWqbo2HtWPfGBa7kA= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoqpsyrcBEMH2A5n6a8bsSeKBPM4Y72Gd+vAxFAmxwZHLJJnTUq2/QNgjtMlgdLqfmCc/XAZefFGkJSmG4+TWc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-01_17:57:53 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-01T23:00:32.638 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa; will attempt to use it 2023-12-01T23:00:32.639 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks 2023-12-01T23:00:32.639 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-01T23:00:32.641 INFO:teuthology.task.internal:Checking packages... 2023-12-01T23:00:32.667 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bed7681480ccb0192b91a35e691658867e1e96b7' 2023-12-01T23:00:32.667 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-01T23:00:32.667 INFO:teuthology.packaging:ref: None 2023-12-01T23:00:32.667 INFO:teuthology.packaging:tag: None 2023-12-01T23:00:32.667 INFO:teuthology.packaging:branch: main 2023-12-01T23:00:32.667 INFO:teuthology.packaging:sha1: bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:00:32.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-12-01T23:00:32.906 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7660.gb27938f5 2023-12-01T23:00:32.906 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-01T23:00:32.912 INFO:teuthology.task.internal:no buildpackages task found 2023-12-01T23:00:32.912 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-01T23:00:32.948 INFO:teuthology.task.internal:Saving configuration 2023-12-01T23:00:32.964 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-01T23:00:32.972 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T23:00:32.995 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 22:55:24.293873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5u9+uNlGB2YWutX3Cmr7b6ud89iTWgYtn5XMcLs4DdTp8j0oxlfDvkBy0pyaEvFYIQjLgWqbo2HtWPfGBa7kA='} 2023-12-01T23:00:33.020 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 22:55:24.295314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoqpsyrcBEMH2A5n6a8bsSeKBPM4Y72Gd+vAxFAmxwZHLJJnTUq2/QNgjtMlgdLqfmCc/XAZefFGkJSmG4+TWc='} 2023-12-01T23:00:33.020 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-01T23:00:33.026 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-01T23:00:33.026 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-01T23:00:33.026 INFO:teuthology.run_tasks:Running task console_log... 2023-12-01T23:00:33.144 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed317ae040>, signals=[15]) 2023-12-01T23:00:33.144 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-01T23:00:33.150 INFO:teuthology.task.internal:Opening connections... 2023-12-01T23:00:33.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:00:33.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:00:33.276 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:00:33.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:00:33.360 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-01T23:00:33.367 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-12-01T23:00:33.385 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-12-01T23:00:33.386 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-12-01T23:00:33.442 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-01T23:00:33.443 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T23:00:33.444 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-12-01T23:00:33.471 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-12-01T23:00:33.489 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-12-01T23:00:33.489 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-12-01T23:00:33.545 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-01T23:00:33.546 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T23:00:33.546 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-01T23:00:33.571 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-01T23:00:33.580 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-01T23:00:33.598 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-01T23:00:33.598 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2023-12-01T23:00:33.601 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2023-12-01T23:00:33.615 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-01T23:00:33.622 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-01T23:00:33.622 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2023-12-01T23:00:33.658 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2023-12-01T23:00:33.687 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-01T23:00:33.744 INFO:teuthology.run_tasks:Running task kernel... 2023-12-01T23:00:33.758 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-01T23:00:33.758 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-01T23:00:33.759 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T23:00:33.759 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T23:00:33.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:00:33.775 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-12-01T23:00:33.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:00:33.776 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-12-01T23:00:33.831 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-361.el9.x86_64 2023-12-01T23:00:33.832 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-361.el9.x86_64 2023-12-01T23:00:33.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2023-12-01T23:00:33.833 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-361.el9.x86_64 2023-12-01T23:00:33.833 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.14.0-361.el9.x86_64 2023-12-01T23:00:33.833 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2023-12-01T23:00:36.023 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-01T23:00:36.078 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-01T23:00:37.373 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-12-01T23:00:37.437 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2023-12-01T23:00:38.286 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 7.9 MB 00:00 2023-12-01T23:00:39.055 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-12-01T23:00:40.387 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-12-01T23:00:42.198 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 18 MB 00:02 2023-12-01T23:00:44.463 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 5.8 MB 00:00 2023-12-01T23:00:46.884 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 5.8 MB 00:01 2023-12-01T23:00:46.922 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 15 kB 00:01 2023-12-01T23:00:48.725 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2023-12-01T23:00:48.993 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-12-01T23:00:51.041 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 20 MB 00:02 2023-12-01T23:00:53.882 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-01T23:00:55.916 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-01T23:00:56.205 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-01T23:00:56.205 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-01T23:00:56.301 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2023-12-01T23:00:56.306 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 96 M 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 121 M 2023-12-01T23:00:56.307 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2023-12-01T23:00:57.724 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 4.9 MB/s | 5.6 MB 00:01 2023-12-01T23:00:58.264 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-01T23:00:58.264 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-01T23:00:58.325 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 12 MB/s | 20 MB 00:01 2023-12-01T23:00:58.363 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-12-01T23:00:58.375 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout:Install 4 Packages 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:00:58.376 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 96 M 2023-12-01T23:00:58.377 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 121 M 2023-12-01T23:00:58.377 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-12-01T23:00:59.025 INFO:teuthology.orchestra.run.smithi096.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 9.8 MB/s | 5.6 MB 00:00 2023-12-01T23:00:59.175 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 15 MB/s | 38 MB 00:02 2023-12-01T23:00:59.475 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 19 MB/s | 32 MB 00:01 2023-12-01T23:00:59.478 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2023-12-01T23:00:59.478 INFO:teuthology.orchestra.run.smithi102.stdout:Total 30 MB/s | 96 MB 00:03 2023-12-01T23:00:59.683 INFO:teuthology.orchestra.run.smithi096.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 17 MB/s | 20 MB 00:01 2023-12-01T23:01:00.176 INFO:teuthology.orchestra.run.smithi096.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 22 MB/s | 38 MB 00:01 2023-12-01T23:01:00.333 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2023-12-01T23:01:00.634 INFO:teuthology.orchestra.run.smithi096.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 20 MB/s | 32 MB 00:01 2023-12-01T23:01:00.635 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-12-01T23:01:00.635 INFO:teuthology.orchestra.run.smithi096.stdout:Total 43 MB/s | 96 MB 00:02 2023-12-01T23:01:00.699 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2023-12-01T23:01:00.699 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2023-12-01T23:01:01.491 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-12-01T23:01:01.837 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-12-01T23:01:01.837 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-12-01T23:01:02.004 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2023-12-01T23:01:02.004 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2023-12-01T23:01:03.142 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-12-01T23:01:03.143 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-12-01T23:01:04.925 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2023-12-01T23:01:05.567 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-01T23:01:05.709 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:05.798 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-12-01T23:01:06.465 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-01T23:01:06.602 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:08.494 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:08.681 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:09.326 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:09.519 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:13.293 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:13.480 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:14.116 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:14.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:18.117 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:18.920 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:46.946 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:46.989 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:47.351 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:47.763 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:47.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:01:47.764 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-12-01T23:01:48.013 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:48.056 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:48.236 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2023-12-01T23:01:48.368 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.368 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-01T23:01:48.369 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-01T23:01:48.369 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-01T23:01:48.369 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-01T23:01:48.369 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-01T23:01:48.369 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2023-12-01T23:01:48.369 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2023-12-01T23:01:48.469 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:48.469 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-01T23:01:48.469 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-01T23:01:48.469 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-01T23:01:48.487 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.488 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-01T23:01:48.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2023-12-01T23:01:48.521 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 68.el9 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8264254 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-01T23:01:48.522 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:01:48.523 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2023-12-01T23:01:48.524 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-01T23:01:48.524 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-388.el9.x86_64 2023-12-01T23:01:48.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-01T23:01:48.890 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-01T23:01:48.890 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:01:48.891 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-12-01T23:01:49.118 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2023-12-01T23:01:49.375 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2023-12-01T23:01:49.510 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:49.511 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-01T23:01:49.511 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-01T23:01:49.511 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-01T23:01:49.511 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-01T23:01:49.511 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-01T23:01:49.511 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2023-12-01T23:01:49.511 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2023-12-01T23:01:49.629 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-01T23:01:49.629 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-01T23:01:49.629 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 68.el9 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-01T23:01:49.666 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8264254 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-01T23:01:49.667 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-01T23:01:49.668 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2023-12-01T23:01:49.668 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:01:49.668 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2023-12-01T23:01:49.668 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-01T23:01:49.669 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 5.14.0-388.el9.x86_64 2023-12-01T23:01:49.669 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-01T23:01:50.280 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2023-12-01T23:01:50.533 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-01T23:01:50.557 INFO:teuthology.orchestra.run.smithi102.stderr:done 2023-12-01T23:01:50.569 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-12-01T23:01:50.584 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.E0YkYaYWtb 2023-12-01T23:01:50.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.E0YkYaYWtb 2023-12-01T23:01:50.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.E0YkYaYWtb 2023-12-01T23:01:50.792 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.E0YkYaYWtb is 6KB 2023-12-01T23:01:50.842 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.E0YkYaYWtb 2023-12-01T23:01:50.856 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2023-12-01T23:01:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-01T23:01:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-01T23:01:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-01T23:01:50.921 INFO:teuthology.orchestra.run.smithi102.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-01T23:01:50.922 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-01T23:01:51.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2023-12-01T23:01:51.670 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-01T23:01:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:done 2023-12-01T23:01:51.707 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-12-01T23:01:51.721 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.lEWhAFLfc6 2023-12-01T23:01:51.722 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lEWhAFLfc6 2023-12-01T23:01:51.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.lEWhAFLfc6 2023-12-01T23:01:51.934 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.lEWhAFLfc6 is 6KB 2023-12-01T23:01:51.983 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.lEWhAFLfc6 2023-12-01T23:01:51.997 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2023-12-01T23:01:52.061 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-01T23:01:52.062 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-01T23:01:52.062 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-01T23:01:52.062 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-01T23:01:52.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-01T23:01:52.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2023-12-01T23:02:21.110 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-01T23:02:21.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:02:21.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:02:22.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-01T23:02:22.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:02:22.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:02:39.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-01T23:02:40.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-12-01T23:02:48.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:02:48.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:02:49.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:02:49.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:02:51.526 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-01T23:02:52.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-12-01T23:03:03.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:03:03.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:03:04.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:03:04.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:03:23.234 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-12-01T23:03:35.399 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-01T23:03:35.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:03:35.812 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-388.el9.x86_64"... 2023-12-01T23:03:35.812 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2023-12-01T23:03:35.825 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-388.el9.x86_64 2023-12-01T23:03:35.826 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-01T23:03:35.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-01T23:03:35.826 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-01T23:03:36.827 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-01T23:03:36.827 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-01T23:03:36.901 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2023-12-01T23:03:36.958 DEBUG:teuthology.parallel:result is None 2023-12-01T23:03:38.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:03:38.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:03:38.618 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-12-01T23:03:38.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:03:38.987 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-12-01T23:03:38.987 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-12-01T23:03:39.000 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-388.el9.x86_64 2023-12-01T23:03:39.001 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-01T23:03:39.001 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-01T23:03:39.001 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-01T23:03:40.002 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-01T23:03:40.002 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-01T23:03:40.067 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2023-12-01T23:03:40.113 DEBUG:teuthology.parallel:result is None 2023-12-01T23:03:40.114 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-01T23:03:40.120 INFO:teuthology.task.internal:Creating test directory... 2023-12-01T23:03:40.120 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T23:03:40.122 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T23:03:40.141 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-01T23:03:40.159 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-01T23:03:40.193 INFO:teuthology.task.internal:Creating archive directory... 2023-12-01T23:03:40.193 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T23:03:40.195 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T23:03:40.228 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-01T23:03:40.238 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-01T23:03:40.238 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T23:03:40.256 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T23:03:40.286 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T23:03:40.295 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T23:03:40.298 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T23:03:40.310 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T23:03:40.311 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-01T23:03:40.319 INFO:teuthology.task.internal:Configuring sudo... 2023-12-01T23:03:40.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T23:03:40.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T23:03:40.382 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-01T23:03:40.391 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-01T23:03:40.391 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T23:03:40.418 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T23:03:40.439 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T23:03:40.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T23:03:40.580 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T23:03:40.666 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T23:03:40.711 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:03:40.711 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T23:03:40.782 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T23:03:40.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T23:03:40.880 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T23:03:40.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T23:03:41.008 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:03:41.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T23:03:41.076 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2023-12-01T23:03:41.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2023-12-01T23:03:41.135 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T23:03:41.161 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T23:03:41.622 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-01T23:03:41.630 INFO:teuthology.task.internal:Starting timer... 2023-12-01T23:03:41.630 INFO:teuthology.run_tasks:Running task pcp... 2023-12-01T23:03:41.693 INFO:teuthology.run_tasks:Running task selinux... 2023-12-01T23:03:41.726 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2023-12-01T23:03:41.828 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2023-12-01T23:03:41.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2023-12-01T23:03:41.887 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2023-12-01T23:03:41.889 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-01T23:03:41.889 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2023-12-01T23:03:41.927 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2023-12-01T23:03:41.927 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2023-12-01T23:03:41.949 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2023-12-01T23:03:41.950 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2023-12-01T23:03:41.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T23:03:42.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:03:42.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T23:03:42.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:03:42.048 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-01T23:03:42.048 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2023-12-01T23:03:42.346 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2023-12-01T23:03:42.385 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-01T23:03:42.400 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-01T23:03:42.406 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-01T23:03:42.548 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-01T23:03:42.564 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-01T23:03:42.565 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-01T23:09:15.548 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2023-12-01T23:09:15.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:09:15.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:09:15.638 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-12-01T23:09:15.704 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-12-01T23:09:15.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:09:15.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T23:09:15.788 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-01T23:09:15.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-01T23:09:15.858 INFO:teuthology.run_tasks:Running task clock... 2023-12-01T23:09:15.870 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-01T23:09:15.870 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T23:09:15.871 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T23:09:15.873 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T23:09:15.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T23:09:15.902 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-01T23:09:15.918 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-01T23:09:15.930 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-01T23:09:15.946 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2023-12-01T23:09:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-01T23:09:15.960 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2023-12-01T23:09:15.976 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-01T23:09:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2023-12-01T23:09:15.990 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2023-12-01T23:09:15.992 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-01T23:09:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-01T23:09:16.022 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-01T23:09:16.035 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.038 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.065 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2023-12-01T23:09:16.067 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T23:09:16.067 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-12-01T23:09:16.067 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.068 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.068 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.068 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:09:16.069 INFO:teuthology.run_tasks:Running task install... 2023-12-01T23:09:16.076 DEBUG:teuthology.task.install:project ceph 2023-12-01T23:09:16.076 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}} 2023-12-01T23:09:16.076 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'} 2023-12-01T23:09:16.077 INFO:teuthology.task.install:Using flavor: default 2023-12-01T23:09:16.082 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-12-01T23:09:16.082 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-01T23:09:16.083 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'tag': None, 'wait_for_package': False} 2023-12-01T23:09:16.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:09:16.085 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'tag': None, 'wait_for_package': False} 2023-12-01T23:09:16.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:09:16.224 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/ 2023-12-01T23:09:16.224 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7631.gbed76814 2023-12-01T23:09:16.298 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/ 2023-12-01T23:09:16.298 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7631.gbed76814 2023-12-01T23:09:16.333 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-01T23:09:16.333 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:09:16.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-01T23:09:16.361 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-01T23:09:16.362 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bed7681480ccb0192b91a35e691658867e1e96b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-01T23:09:16.429 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-01T23:09:16.462 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/bed7681480ccb0192b91a35e691658867e1e96b7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-01T23:09:16.463 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:09:16.463 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-01T23:09:16.491 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-01T23:09:16.491 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bed7681480ccb0192b91a35e691658867e1e96b7/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-01T23:09:16.508 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-01T23:09:16.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-01T23:09:16.574 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2023-12-01T23:09:16.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2023-12-01T23:09:16.642 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-01T23:09:16.708 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2023-12-01T23:09:16.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2023-12-01T23:09:16.838 INFO:teuthology.orchestra.run.smithi096.stdout:73 files removed 2023-12-01T23:09:16.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-01T23:09:16.951 INFO:teuthology.orchestra.run.smithi102.stdout:73 files removed 2023-12-01T23:09:16.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-01T23:09:17.639 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 227 kB/s | 78 kB 00:00 2023-12-01T23:09:17.646 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 168 kB/s | 78 kB 00:00 2023-12-01T23:09:18.014 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 29 kB/s | 9.5 kB 00:00 2023-12-01T23:09:18.072 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-01T23:09:18.356 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2023-12-01T23:09:18.422 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-12-01T23:09:18.809 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-01T23:09:18.891 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-01T23:09:20.134 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2023-12-01T23:09:20.450 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-12-01T23:09:21.733 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 7.9 MB 00:00 2023-12-01T23:09:22.783 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 3.4 MB/s | 7.9 MB 00:02 2023-12-01T23:09:23.950 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 16 MB/s | 18 MB 00:01 2023-12-01T23:09:27.201 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 18 MB 00:03 2023-12-01T23:09:28.050 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.8 MB 00:00 2023-12-01T23:09:29.501 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2023-12-01T23:09:31.711 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2023-12-01T23:09:32.010 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-12-01T23:09:33.804 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2023-12-01T23:09:36.544 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-01T23:09:39.189 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-01T23:09:39.190 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-01T23:09:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-01T23:09:39.222 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-01T23:09:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-01T23:09:39.224 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-01T23:09:39.226 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-01T23:09:39.229 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-01T23:09:39.230 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-01T23:09:39.305 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:==================================================================================================== 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:==================================================================================================== 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.0.0-7631.gbed76814.el9 ceph 6.6 k 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.2 M 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 73 M 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 404 M 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 859 k 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.8 M 2023-12-01T23:09:39.339 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7631.gbed76814.el9 ceph 141 k 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.4 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 47 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.5 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 133 k 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 1.8 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 7.4 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 50 k 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 111 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 311 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 8.6 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 172 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.0.0-7631.gbed76814.el9 ceph 41 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 622 M 2023-12-01T23:09:39.340 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 262 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 776 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 218 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 18 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 31 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 718 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.1 M 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 127 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 108 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 43 M 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 50 M 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-01T23:09:39.341 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.0.0-7631.gbed76814.el9 ceph 162 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 615 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.0.0-7631.gbed76814.el9 ceph 320 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 769 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 298 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.1 M 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 99 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 337 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 85 k 2023-12-01T23:09:39.342 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 506 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 50 M 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 170 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.2 M 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-01T23:09:39.343 INFO:teuthology.orchestra.run.smithi096.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.3 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 21 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 28 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.0.0-7631.gbed76814.el9 ceph 2.1 M 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 243 k 2023-12-01T23:09:39.344 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.4 M 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 18 M 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 15 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.0.0-7631.gbed76814.el9 ceph 24 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.0.0-7631.gbed76814.el9 ceph 164 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-01T23:09:39.345 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 475 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.8 M 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-01T23:09:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 45 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 129 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-01T23:09:39.347 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-01T23:09:39.348 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-01T23:09:39.349 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-01T23:09:39.350 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout:Installing weak dependencies: 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout:==================================================================================================== 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout:Install 157 Packages 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 15 Packages 2023-12-01T23:09:39.351 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:09:39.352 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 2.1 G 2023-12-01T23:09:39.352 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-12-01T23:09:40.736 INFO:teuthology.orchestra.run.smithi096.stdout:(1/172): ceph-18.0.0-7631.gbed76814.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2023-12-01T23:09:41.137 INFO:teuthology.orchestra.run.smithi096.stdout:(2/172): ceph-base-18.0.0-7631.gbed76814.el9.x8 5.3 MB/s | 5.2 MB 00:00 2023-12-01T23:09:41.264 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 2.7 MB/s | 20 MB 00:07 2023-12-01T23:09:46.012 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2023-12-01T23:09:48.683 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-01T23:09:48.683 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-01T23:09:48.714 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-01T23:09:48.715 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-01T23:09:48.716 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-01T23:09:48.717 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-01T23:09:48.719 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-01T23:09:48.721 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-01T23:09:48.722 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-01T23:09:48.796 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2023-12-01T23:09:48.822 INFO:teuthology.orchestra.run.smithi102.stdout:==================================================================================================== 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout:==================================================================================================== 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:18.0.0-7631.gbed76814.el9 ceph 6.6 k 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.2 M 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 73 M 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 404 M 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 859 k 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.8 M 2023-12-01T23:09:48.823 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7631.gbed76814.el9 ceph 141 k 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.4 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 47 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.5 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 133 k 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 1.8 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 7.4 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 50 k 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 111 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 311 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 8.6 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 172 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:18.0.0-7631.gbed76814.el9 ceph 41 M 2023-12-01T23:09:48.824 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 622 M 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 262 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 776 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 218 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 18 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 31 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 718 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 5.1 M 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:18.0.0-7631.gbed76814.el9 ceph 127 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 108 k 2023-12-01T23:09:48.825 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 43 M 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 50 M 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:18.0.0-7631.gbed76814.el9 ceph 162 k 2023-12-01T23:09:48.826 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 615 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:18.0.0-7631.gbed76814.el9 ceph 320 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 769 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 298 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.1 M 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:18.0.0-7631.gbed76814.el9 ceph 99 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 337 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 85 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 506 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 50 M 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 170 k 2023-12-01T23:09:48.827 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 1.2 M 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-01T23:09:48.828 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.3 M 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 3.0 M 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-01T23:09:48.829 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 19 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-debuginfo x86_64 2:18.0.0-7631.gbed76814.el9 ceph 21 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 28 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:18.0.0-7631.gbed76814.el9 ceph 2.1 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 243 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.4 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:18.0.0-7631.gbed76814.el9 ceph 18 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7631.gbed76814.el9 ceph-noarch 15 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:18.0.0-7631.gbed76814.el9 ceph 24 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-01T23:09:48.830 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:18.0.0-7631.gbed76814.el9 ceph 164 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 475 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:18.0.0-7631.gbed76814.el9 ceph 4.8 M 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-01T23:09:48.831 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-01T23:09:48.832 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:18.0.0-7631.gbed76814.el9 ceph 45 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:18.0.0-7631.gbed76814.el9 ceph 129 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-01T23:09:48.833 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-01T23:09:48.834 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-01T23:09:48.835 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-01T23:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout:==================================================================================================== 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout:Install 157 Packages 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 15 Packages 2023-12-01T23:09:48.837 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:09:48.838 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.1 G 2023-12-01T23:09:48.838 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2023-12-01T23:09:50.429 INFO:teuthology.orchestra.run.smithi102.stdout:(1/172): ceph-18.0.0-7631.gbed76814.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2023-12-01T23:09:53.513 INFO:teuthology.orchestra.run.smithi102.stdout:(2/172): ceph-base-18.0.0-7631.gbed76814.el9.x8 1.5 MB/s | 5.2 MB 00:03 2023-12-01T23:10:00.196 INFO:teuthology.orchestra.run.smithi102.stdout:(3/172): ceph-common-18.0.0-7631.gbed76814.el9. 1.9 MB/s | 19 MB 00:09 2023-12-01T23:10:03.916 INFO:teuthology.orchestra.run.smithi096.stdout:(3/172): ceph-common-debuginfo-18.0.0-7631.gbed 18 MB/s | 404 MB 00:22 2023-12-01T23:10:04.117 INFO:teuthology.orchestra.run.smithi096.stdout:(4/172): ceph-common-18.0.0-7631.gbed76814.el9. 831 kB/s | 19 MB 00:23 2023-12-01T23:10:04.579 INFO:teuthology.orchestra.run.smithi102.stdout:(4/172): ceph-base-debuginfo-18.0.0-7631.gbed76 5.0 MB/s | 73 MB 00:14 2023-12-01T23:10:04.896 INFO:teuthology.orchestra.run.smithi102.stdout:(5/172): ceph-fuse-18.0.0-7631.gbed76814.el9.x8 2.7 MB/s | 859 kB 00:00 2023-12-01T23:10:05.217 INFO:teuthology.orchestra.run.smithi096.stdout:(5/172): ceph-debuginfo-18.0.0-7631.gbed76814.e 16 MB/s | 21 MB 00:01 2023-12-01T23:10:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:(6/172): ceph-fuse-18.0.0-7631.gbed76814.el9.x8 711 kB/s | 859 kB 00:01 2023-12-01T23:10:05.460 INFO:teuthology.orchestra.run.smithi102.stdout:(6/172): ceph-fuse-debuginfo-18.0.0-7631.gbed76 10 MB/s | 5.8 MB 00:00 2023-12-01T23:10:05.517 INFO:teuthology.orchestra.run.smithi096.stdout:(7/172): ceph-immutable-object-cache-18.0.0-763 737 kB/s | 141 kB 00:00 2023-12-01T23:10:05.535 INFO:teuthology.orchestra.run.smithi102.stdout:(7/172): ceph-immutable-object-cache-18.0.0-763 1.8 MB/s | 141 kB 00:00 2023-12-01T23:10:05.594 INFO:teuthology.orchestra.run.smithi096.stdout:(8/172): ceph-fuse-debuginfo-18.0.0-7631.gbed76 15 MB/s | 5.8 MB 00:00 2023-12-01T23:10:05.661 INFO:teuthology.orchestra.run.smithi102.stdout:(8/172): ceph-immutable-object-cache-debuginfo- 11 MB/s | 1.4 MB 00:00 2023-12-01T23:10:05.759 INFO:teuthology.orchestra.run.smithi096.stdout:(9/172): ceph-mds-18.0.0-7631.gbed76814.el9.x86 13 MB/s | 2.1 MB 00:00 2023-12-01T23:10:05.869 INFO:teuthology.orchestra.run.smithi102.stdout:(9/172): ceph-mds-18.0.0-7631.gbed76814.el9.x86 10 MB/s | 2.1 MB 00:00 2023-12-01T23:10:06.767 INFO:teuthology.orchestra.run.smithi096.stdout:(10/172): ceph-immutable-object-cache-debuginfo 1.1 MB/s | 1.4 MB 00:01 2023-12-01T23:10:08.451 INFO:teuthology.orchestra.run.smithi096.stdout:(11/172): ceph-mgr-18.0.0-7631.gbed76814.el9.x8 891 kB/s | 1.5 MB 00:01 2023-12-01T23:10:09.368 INFO:teuthology.orchestra.run.smithi096.stdout:(12/172): ceph-mds-debuginfo-18.0.0-7631.gbed76 13 MB/s | 47 MB 00:03 2023-12-01T23:10:09.495 INFO:teuthology.orchestra.run.smithi102.stdout:(10/172): ceph-debuginfo-18.0.0-7631.gbed76814. 2.2 MB/s | 21 MB 00:09 2023-12-01T23:10:09.693 INFO:teuthology.orchestra.run.smithi096.stdout:(13/172): ceph-mon-18.0.0-7631.gbed76814.el9.x8 14 MB/s | 4.4 MB 00:00 2023-12-01T23:10:10.411 INFO:teuthology.orchestra.run.smithi102.stdout:(11/172): ceph-mgr-18.0.0-7631.gbed76814.el9.x8 1.6 MB/s | 1.5 MB 00:00 2023-12-01T23:10:10.953 INFO:teuthology.orchestra.run.smithi102.stdout:(12/172): ceph-mds-debuginfo-18.0.0-7631.gbed76 9.2 MB/s | 47 MB 00:05 2023-12-01T23:10:11.570 INFO:teuthology.orchestra.run.smithi102.stdout:(13/172): ceph-mon-18.0.0-7631.gbed76814.el9.x8 7.1 MB/s | 4.4 MB 00:00 2023-12-01T23:10:17.876 INFO:teuthology.orchestra.run.smithi096.stdout:(14/172): ceph-mon-debuginfo-18.0.0-7631.gbed76 14 MB/s | 111 MB 00:08 2023-12-01T23:10:19.359 INFO:teuthology.orchestra.run.smithi096.stdout:(15/172): ceph-mgr-debuginfo-18.0.0-7631.gbed76 1.7 MB/s | 19 MB 00:10 2023-12-01T23:10:19.559 INFO:teuthology.orchestra.run.smithi096.stdout:(16/172): ceph-osd-18.0.0-7631.gbed76814.el9.x8 11 MB/s | 18 MB 00:01 2023-12-01T23:10:20.376 INFO:teuthology.orchestra.run.smithi096.stdout:(17/172): ceph-radosgw-18.0.0-7631.gbed76814.el 11 MB/s | 8.6 MB 00:00 2023-12-01T23:10:22.695 INFO:teuthology.orchestra.run.smithi102.stdout:(14/172): ceph-mgr-debuginfo-18.0.0-7631.gbed76 1.5 MB/s | 19 MB 00:12 2023-12-01T23:10:25.520 INFO:teuthology.orchestra.run.smithi102.stdout:(15/172): ceph-mon-debuginfo-18.0.0-7631.gbed76 8.0 MB/s | 111 MB 00:13 2023-12-01T23:10:34.344 INFO:teuthology.orchestra.run.smithi096.stdout:(18/172): ceph-radosgw-debuginfo-18.0.0-7631.gb 12 MB/s | 172 MB 00:13 2023-12-01T23:10:34.819 INFO:teuthology.orchestra.run.smithi096.stdout:(19/172): ceph-base-debuginfo-18.0.0-7631.gbed7 1.3 MB/s | 73 MB 00:54 2023-12-01T23:10:34.844 INFO:teuthology.orchestra.run.smithi096.stdout:(20/172): ceph-selinux-18.0.0-7631.gbed76814.el 48 kB/s | 24 kB 00:00 2023-12-01T23:10:37.694 INFO:teuthology.orchestra.run.smithi102.stdout:(16/172): ceph-osd-18.0.0-7631.gbed76814.el9.x8 1.2 MB/s | 18 MB 00:14 2023-12-01T23:10:44.335 INFO:teuthology.orchestra.run.smithi102.stdout:(17/172): ceph-radosgw-18.0.0-7631.gbed76814.el 1.3 MB/s | 8.6 MB 00:06 2023-12-01T23:11:04.414 INFO:teuthology.orchestra.run.smithi096.stdout:(21/172): ceph-test-18.0.0-7631.gbed76814.el9.x 1.4 MB/s | 41 MB 00:29 2023-12-01T23:11:04.606 INFO:teuthology.orchestra.run.smithi096.stdout:(22/172): cephfs-mirror-18.0.0-7631.gbed76814.e 1.1 MB/s | 218 kB 00:00 2023-12-01T23:11:04.698 INFO:teuthology.orchestra.run.smithi096.stdout:(23/172): libcephfs-devel-18.0.0-7631.gbed76814 340 kB/s | 31 kB 00:00 2023-12-01T23:11:04.875 INFO:teuthology.orchestra.run.smithi102.stdout:(18/172): ceph-osd-debuginfo-18.0.0-7631.gbed76 7.9 MB/s | 311 MB 00:39 2023-12-01T23:11:05.017 INFO:teuthology.orchestra.run.smithi102.stdout:(19/172): ceph-selinux-18.0.0-7631.gbed76814.el 170 kB/s | 24 kB 00:00 2023-12-01T23:11:05.073 INFO:teuthology.orchestra.run.smithi096.stdout:(24/172): libcephfs2-18.0.0-7631.gbed76814.el9. 1.9 MB/s | 718 kB 00:00 2023-12-01T23:11:07.639 INFO:teuthology.orchestra.run.smithi096.stdout:(25/172): libcephfs2-debuginfo-18.0.0-7631.gbed 2.0 MB/s | 5.1 MB 00:02 2023-12-01T23:11:08.056 INFO:teuthology.orchestra.run.smithi096.stdout:(26/172): libcephsqlite-18.0.0-7631.gbed76814.e 393 kB/s | 164 kB 00:00 2023-12-01T23:11:08.490 INFO:teuthology.orchestra.run.smithi096.stdout:(27/172): librados-devel-18.0.0-7631.gbed76814. 292 kB/s | 127 kB 00:00 2023-12-01T23:11:08.915 INFO:teuthology.orchestra.run.smithi096.stdout:(28/172): librados-devel-debuginfo-18.0.0-7631. 255 kB/s | 108 kB 00:00 2023-12-01T23:11:15.108 INFO:teuthology.orchestra.run.smithi102.stdout:(20/172): ceph-test-18.0.0-7631.gbed76814.el9.x 4.1 MB/s | 41 MB 00:10 2023-12-01T23:11:27.632 INFO:teuthology.orchestra.run.smithi102.stdout:(21/172): ceph-radosgw-debuginfo-18.0.0-7631.gb 4.0 MB/s | 172 MB 00:43 2023-12-01T23:11:27.891 INFO:teuthology.orchestra.run.smithi102.stdout:(22/172): cephfs-mirror-18.0.0-7631.gbed76814.e 844 kB/s | 218 kB 00:00 2023-12-01T23:11:28.007 INFO:teuthology.orchestra.run.smithi102.stdout:(23/172): libcephfs-devel-18.0.0-7631.gbed76814 267 kB/s | 31 kB 00:00 2023-12-01T23:11:28.391 INFO:teuthology.orchestra.run.smithi102.stdout:(24/172): libcephfs2-18.0.0-7631.gbed76814.el9. 1.8 MB/s | 718 kB 00:00 2023-12-01T23:11:30.116 INFO:teuthology.orchestra.run.smithi102.stdout:(25/172): libcephfs2-debuginfo-18.0.0-7631.gbed 3.0 MB/s | 5.1 MB 00:01 2023-12-01T23:11:30.225 INFO:teuthology.orchestra.run.smithi102.stdout:(26/172): libcephsqlite-18.0.0-7631.gbed76814.e 1.5 MB/s | 164 kB 00:00 2023-12-01T23:11:30.334 INFO:teuthology.orchestra.run.smithi102.stdout:(27/172): librados-devel-18.0.0-7631.gbed76814. 1.1 MB/s | 127 kB 00:00 2023-12-01T23:11:30.434 INFO:teuthology.orchestra.run.smithi102.stdout:(28/172): librados-devel-debuginfo-18.0.0-7631. 1.1 MB/s | 108 kB 00:00 2023-12-01T23:11:30.844 INFO:teuthology.orchestra.run.smithi096.stdout:(29/172): librados2-debuginfo-18.0.0-7631.gbed7 2.0 MB/s | 43 MB 00:21 2023-12-01T23:11:31.144 INFO:teuthology.orchestra.run.smithi096.stdout:(30/172): libradosstriper1-18.0.0-7631.gbed7681 1.6 MB/s | 475 kB 00:00 2023-12-01T23:11:37.369 INFO:teuthology.orchestra.run.smithi096.stdout:(31/172): ceph-test-debuginfo-18.0.0-7631.gbed7 10 MB/s | 622 MB 01:02 2023-12-01T23:11:38.227 INFO:teuthology.orchestra.run.smithi096.stdout:(32/172): librgw2-18.0.0-7631.gbed76814.el9.x86 5.6 MB/s | 4.8 MB 00:00 2023-12-01T23:11:38.302 INFO:teuthology.orchestra.run.smithi096.stdout:(33/172): python3-ceph-argparse-18.0.0-7631.gbe 602 kB/s | 45 kB 00:00 2023-12-01T23:11:38.377 INFO:teuthology.orchestra.run.smithi096.stdout:(34/172): python3-ceph-common-18.0.0-7631.gbed7 1.7 MB/s | 129 kB 00:00 2023-12-01T23:11:38.461 INFO:teuthology.orchestra.run.smithi096.stdout:(35/172): python3-cephfs-18.0.0-7631.gbed76814. 1.9 MB/s | 162 kB 00:00 2023-12-01T23:11:38.645 INFO:teuthology.orchestra.run.smithi096.stdout:(36/172): python3-cephfs-debuginfo-18.0.0-7631. 3.3 MB/s | 615 kB 00:00 2023-12-01T23:11:38.737 INFO:teuthology.orchestra.run.smithi096.stdout:(37/172): python3-rados-18.0.0-7631.gbed76814.e 3.4 MB/s | 320 kB 00:00 2023-12-01T23:11:38.945 INFO:teuthology.orchestra.run.smithi096.stdout:(38/172): python3-rados-debuginfo-18.0.0-7631.g 3.6 MB/s | 769 kB 00:00 2023-12-01T23:11:39.029 INFO:teuthology.orchestra.run.smithi096.stdout:(39/172): python3-rbd-18.0.0-7631.gbed76814.el9 3.5 MB/s | 298 kB 00:00 2023-12-01T23:11:39.254 INFO:teuthology.orchestra.run.smithi096.stdout:(40/172): python3-rbd-debuginfo-18.0.0-7631.gbe 5.0 MB/s | 1.1 MB 00:00 2023-12-01T23:11:39.312 INFO:teuthology.orchestra.run.smithi096.stdout:(41/172): python3-rgw-18.0.0-7631.gbed76814.el9 1.7 MB/s | 99 kB 00:00 2023-12-01T23:11:39.396 INFO:teuthology.orchestra.run.smithi096.stdout:(42/172): python3-rgw-debuginfo-18.0.0-7631.gbe 4.0 MB/s | 337 kB 00:00 2023-12-01T23:11:39.463 INFO:teuthology.orchestra.run.smithi096.stdout:(43/172): rbd-fuse-18.0.0-7631.gbed76814.el9.x8 1.3 MB/s | 85 kB 00:00 2023-12-01T23:11:39.491 INFO:teuthology.orchestra.run.smithi102.stdout:(29/172): librados2-debuginfo-18.0.0-7631.gbed7 4.8 MB/s | 43 MB 00:09 2023-12-01T23:11:39.580 INFO:teuthology.orchestra.run.smithi096.stdout:(44/172): rbd-fuse-debuginfo-18.0.0-7631.gbed76 4.2 MB/s | 506 kB 00:00 2023-12-01T23:11:39.750 INFO:teuthology.orchestra.run.smithi102.stdout:(30/172): libradosstriper1-18.0.0-7631.gbed7681 1.8 MB/s | 475 kB 00:00 2023-12-01T23:11:40.072 INFO:teuthology.orchestra.run.smithi096.stdout:(45/172): rbd-mirror-18.0.0-7631.gbed76814.el9. 6.1 MB/s | 3.0 MB 00:00 2023-12-01T23:11:41.897 INFO:teuthology.orchestra.run.smithi096.stdout:(46/172): ceph-osd-debuginfo-18.0.0-7631.gbed76 3.8 MB/s | 311 MB 01:22 2023-12-01T23:11:42.048 INFO:teuthology.orchestra.run.smithi096.stdout:(47/172): rbd-nbd-18.0.0-7631.gbed76814.el9.x86 1.1 MB/s | 170 kB 00:00 2023-12-01T23:11:42.290 INFO:teuthology.orchestra.run.smithi096.stdout:(48/172): rbd-nbd-debuginfo-18.0.0-7631.gbed768 5.1 MB/s | 1.2 MB 00:00 2023-12-01T23:11:42.365 INFO:teuthology.orchestra.run.smithi096.stdout:(49/172): ceph-grafana-dashboards-18.0.0-7631.g 376 kB/s | 28 kB 00:00 2023-12-01T23:11:42.441 INFO:teuthology.orchestra.run.smithi096.stdout:(50/172): ceph-mgr-cephadm-18.0.0-7631.gbed7681 1.7 MB/s | 133 kB 00:00 2023-12-01T23:11:42.682 INFO:teuthology.orchestra.run.smithi096.stdout:(51/172): ceph-mgr-dashboard-18.0.0-7631.gbed76 7.3 MB/s | 1.8 MB 00:00 2023-12-01T23:11:43.423 INFO:teuthology.orchestra.run.smithi096.stdout:(52/172): ceph-mgr-diskprediction-local-18.0.0- 9.9 MB/s | 7.4 MB 00:00 2023-12-01T23:11:43.458 INFO:teuthology.orchestra.run.smithi102.stdout:(31/172): ceph-common-debuginfo-18.0.0-7631.gbe 3.7 MB/s | 404 MB 01:49 2023-12-01T23:11:43.824 INFO:teuthology.orchestra.run.smithi096.stdout:(53/172): ceph-mgr-modules-core-18.0.0-7631.gbe 608 kB/s | 243 kB 00:00 2023-12-01T23:11:43.907 INFO:teuthology.orchestra.run.smithi096.stdout:(54/172): ceph-mgr-rook-18.0.0-7631.gbed76814.e 604 kB/s | 50 kB 00:00 2023-12-01T23:11:44.024 INFO:teuthology.orchestra.run.smithi096.stdout:(55/172): ceph-prometheus-alerts-18.0.0-7631.gb 129 kB/s | 15 kB 00:00 2023-12-01T23:11:44.124 INFO:teuthology.orchestra.run.smithi096.stdout:(56/172): ceph-volume-18.0.0-7631.gbed76814.el9 2.6 MB/s | 262 kB 00:00 2023-12-01T23:11:44.308 INFO:teuthology.orchestra.run.smithi096.stdout:(57/172): cephadm-18.0.0-7631.gbed76814.el9.noa 4.1 MB/s | 776 kB 00:00 2023-12-01T23:11:44.317 INFO:teuthology.orchestra.run.smithi102.stdout:(32/172): librgw2-18.0.0-7631.gbed76814.el9.x86 5.6 MB/s | 4.8 MB 00:00 2023-12-01T23:11:44.400 INFO:teuthology.orchestra.run.smithi102.stdout:(33/172): python3-ceph-argparse-18.0.0-7631.gbe 542 kB/s | 45 kB 00:00 2023-12-01T23:11:44.484 INFO:teuthology.orchestra.run.smithi102.stdout:(34/172): python3-ceph-common-18.0.0-7631.gbed7 1.5 MB/s | 129 kB 00:00 2023-12-01T23:11:44.568 INFO:teuthology.orchestra.run.smithi102.stdout:(35/172): python3-cephfs-18.0.0-7631.gbed76814. 1.9 MB/s | 162 kB 00:00 2023-12-01T23:11:44.684 INFO:teuthology.orchestra.run.smithi102.stdout:(36/172): python3-cephfs-debuginfo-18.0.0-7631. 5.2 MB/s | 615 kB 00:00 2023-12-01T23:11:44.760 INFO:teuthology.orchestra.run.smithi102.stdout:(37/172): python3-rados-18.0.0-7631.gbed76814.e 4.2 MB/s | 320 kB 00:00 2023-12-01T23:11:44.885 INFO:teuthology.orchestra.run.smithi102.stdout:(38/172): python3-rados-debuginfo-18.0.0-7631.g 6.0 MB/s | 769 kB 00:00 2023-12-01T23:11:44.969 INFO:teuthology.orchestra.run.smithi102.stdout:(39/172): python3-rbd-18.0.0-7631.gbed76814.el9 3.5 MB/s | 298 kB 00:00 2023-12-01T23:11:45.144 INFO:teuthology.orchestra.run.smithi102.stdout:(40/172): python3-rbd-debuginfo-18.0.0-7631.gbe 6.4 MB/s | 1.1 MB 00:00 2023-12-01T23:11:45.227 INFO:teuthology.orchestra.run.smithi102.stdout:(41/172): python3-rgw-18.0.0-7631.gbed76814.el9 1.2 MB/s | 99 kB 00:00 2023-12-01T23:11:45.328 INFO:teuthology.orchestra.run.smithi102.stdout:(42/172): python3-rgw-debuginfo-18.0.0-7631.gbe 3.3 MB/s | 337 kB 00:00 2023-12-01T23:11:45.403 INFO:teuthology.orchestra.run.smithi102.stdout:(43/172): rbd-fuse-18.0.0-7631.gbed76814.el9.x8 1.1 MB/s | 85 kB 00:00 2023-12-01T23:11:45.504 INFO:teuthology.orchestra.run.smithi102.stdout:(44/172): rbd-fuse-debuginfo-18.0.0-7631.gbed76 4.9 MB/s | 506 kB 00:00 2023-12-01T23:11:45.775 INFO:teuthology.orchestra.run.smithi096.stdout:(58/172): cephfs-top-18.0.0-7631.gbed76814.el9. 12 kB/s | 18 kB 00:01 2023-12-01T23:11:45.925 INFO:teuthology.orchestra.run.smithi096.stdout:(59/172): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-12-01T23:11:45.975 INFO:teuthology.orchestra.run.smithi096.stdout:(60/172): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-12-01T23:11:46.009 INFO:teuthology.orchestra.run.smithi096.stdout:(61/172): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-12-01T23:11:46.042 INFO:teuthology.orchestra.run.smithi096.stdout:(62/172): elfutils-libelf-devel-0.190-1.el9.x86 651 kB/s | 21 kB 00:00 2023-12-01T23:11:46.084 INFO:teuthology.orchestra.run.smithi096.stdout:(63/172): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-01T23:11:46.121 INFO:teuthology.orchestra.run.smithi096.stdout:(64/172): flexiblas-3.0.4-8.el9.x86_64.rpm 868 kB/s | 32 kB 00:00 2023-12-01T23:11:46.212 INFO:teuthology.orchestra.run.smithi102.stdout:(45/172): rbd-mirror-18.0.0-7631.gbed76814.el9. 4.2 MB/s | 3.0 MB 00:00 2023-12-01T23:11:46.230 INFO:teuthology.orchestra.run.smithi096.stdout:(65/172): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-01T23:11:46.263 INFO:teuthology.orchestra.run.smithi096.stdout:(66/172): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2023-12-01T23:11:46.305 INFO:teuthology.orchestra.run.smithi096.stdout:(67/172): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-12-01T23:11:46.331 INFO:teuthology.orchestra.run.smithi096.stdout:(68/172): libaio-devel-0.3.111-13.el9.x86_64.rp 401 kB/s | 10 kB 00:00 2023-12-01T23:11:46.372 INFO:teuthology.orchestra.run.smithi096.stdout:(69/172): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-01T23:11:46.398 INFO:teuthology.orchestra.run.smithi096.stdout:(70/172): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-01T23:11:46.440 INFO:teuthology.orchestra.run.smithi096.stdout:(71/172): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2023-12-01T23:11:46.481 INFO:teuthology.orchestra.run.smithi096.stdout:(72/172): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2023-12-01T23:11:46.515 INFO:teuthology.orchestra.run.smithi096.stdout:(73/172): libuuid-devel-2.37.4-15.el9.x86_64.rp 724 kB/s | 24 kB 00:00 2023-12-01T23:11:46.541 INFO:teuthology.orchestra.run.smithi096.stdout:(74/172): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2023-12-01T23:11:46.583 INFO:teuthology.orchestra.run.smithi096.stdout:(75/172): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-01T23:11:46.616 INFO:teuthology.orchestra.run.smithi096.stdout:(76/172): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-12-01T23:11:46.658 INFO:teuthology.orchestra.run.smithi096.stdout:(77/172): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2023-12-01T23:11:46.684 INFO:teuthology.orchestra.run.smithi096.stdout:(78/172): openblas-0.3.21-2.el9.x86_64.rpm 1.3 MB/s | 34 kB 00:00 2023-12-01T23:11:46.809 INFO:teuthology.orchestra.run.smithi096.stdout:(79/172): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2023-12-01T23:11:46.868 INFO:teuthology.orchestra.run.smithi096.stdout:(80/172): postgresql-13.11-1.el9.x86_64.rpm 26 MB/s | 1.5 MB 00:00 2023-12-01T23:11:46.935 INFO:teuthology.orchestra.run.smithi096.stdout:(81/172): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-12-01T23:11:46.960 INFO:teuthology.orchestra.run.smithi096.stdout:(82/172): postgresql-private-libs-13.11-1.el9.x 5.3 MB/s | 134 kB 00:00 2023-12-01T23:11:47.110 INFO:teuthology.orchestra.run.smithi096.stdout:(83/172): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2023-12-01T23:11:47.261 INFO:teuthology.orchestra.run.smithi096.stdout:(84/172): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2023-12-01T23:11:47.303 INFO:teuthology.orchestra.run.smithi096.stdout:(85/172): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-12-01T23:11:47.336 INFO:teuthology.orchestra.run.smithi096.stdout:(86/172): python3-jsonpatch-1.21-16.el9.noarch. 731 kB/s | 24 kB 00:00 2023-12-01T23:11:47.378 INFO:teuthology.orchestra.run.smithi096.stdout:(87/172): python3-jsonpointer-2.0-4.el9.noarch. 435 kB/s | 18 kB 00:00 2023-12-01T23:11:47.820 INFO:teuthology.orchestra.run.smithi096.stdout:(88/172): rbd-mirror-debuginfo-18.0.0-7631.gbed 6.4 MB/s | 50 MB 00:07 2023-12-01T23:11:47.846 INFO:teuthology.orchestra.run.smithi096.stdout:(89/172): python3-mako-1.1.4-6.el9.noarch.rpm 309 kB/s | 144 kB 00:00 2023-12-01T23:11:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:(90/172): python3-markupsafe-1.1.1-12.el9.x86_6 639 kB/s | 32 kB 00:00 2023-12-01T23:11:47.980 INFO:teuthology.orchestra.run.smithi096.stdout:(91/172): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-01T23:11:48.005 INFO:teuthology.orchestra.run.smithi096.stdout:(92/172): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-01T23:11:48.030 INFO:teuthology.orchestra.run.smithi096.stdout:(93/172): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-01T23:11:48.055 INFO:teuthology.orchestra.run.smithi096.stdout:(94/172): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2023-12-01T23:11:48.106 INFO:teuthology.orchestra.run.smithi096.stdout:(95/172): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-01T23:11:48.131 INFO:teuthology.orchestra.run.smithi096.stdout:(96/172): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2023-12-01T23:11:48.156 INFO:teuthology.orchestra.run.smithi096.stdout:(97/172): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2023-12-01T23:11:48.181 INFO:teuthology.orchestra.run.smithi096.stdout:(98/172): python3-requests-oauthlib-1.3.0-12.el 856 kB/s | 43 kB 00:00 2023-12-01T23:11:48.390 INFO:teuthology.orchestra.run.smithi096.stdout:(99/172): python3-toml-0.10.2-6.el9.noarch.rpm 188 kB/s | 39 kB 00:00 2023-12-01T23:11:48.682 INFO:teuthology.orchestra.run.smithi096.stdout:(100/172): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2023-12-01T23:11:48.708 INFO:teuthology.orchestra.run.smithi096.stdout:(101/172): socat-1.7.4.1-5.el9.x86_64.rpm 955 kB/s | 300 kB 00:00 2023-12-01T23:11:48.724 INFO:teuthology.orchestra.run.smithi096.stdout:(102/172): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-01T23:11:48.750 INFO:teuthology.orchestra.run.smithi096.stdout:(103/172): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 85 kB 00:00 2023-12-01T23:11:48.767 INFO:teuthology.orchestra.run.smithi096.stdout:(104/172): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-01T23:11:48.784 INFO:teuthology.orchestra.run.smithi096.stdout:(105/172): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-01T23:11:48.809 INFO:teuthology.orchestra.run.smithi096.stdout:(106/172): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-12-01T23:11:48.843 INFO:teuthology.orchestra.run.smithi096.stdout:(107/172): libgfortran-11.4.1-2.3.el9.x86_64.rp 13 MB/s | 803 kB 00:00 2023-12-01T23:11:48.868 INFO:teuthology.orchestra.run.smithi096.stdout:(108/172): libquadmath-11.4.1-2.3.el9.x86_64.rp 3.3 MB/s | 195 kB 00:00 2023-12-01T23:11:48.893 INFO:teuthology.orchestra.run.smithi096.stdout:(109/172): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-01T23:11:48.935 INFO:teuthology.orchestra.run.smithi096.stdout:(110/172): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2023-12-01T23:11:48.961 INFO:teuthology.orchestra.run.smithi096.stdout:(111/172): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-01T23:11:48.986 INFO:teuthology.orchestra.run.smithi096.stdout:(112/172): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-12-01T23:11:49.011 INFO:teuthology.orchestra.run.smithi096.stdout:(113/172): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-12-01T23:11:49.037 INFO:teuthology.orchestra.run.smithi096.stdout:(114/172): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-12-01T23:11:49.136 INFO:teuthology.orchestra.run.smithi096.stdout:(115/172): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2023-12-01T23:11:49.297 INFO:teuthology.orchestra.run.smithi102.stdout:(46/172): librbd1-debuginfo-18.0.0-7631.gbed768 5.2 MB/s | 50 MB 00:09 2023-12-01T23:11:49.345 INFO:teuthology.orchestra.run.smithi096.stdout:(116/172): openssl-devel-3.0.7-25.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2023-12-01T23:11:49.554 INFO:teuthology.orchestra.run.smithi096.stdout:(117/172): lua-devel-5.4.4-4.el9.x86_64.rpm 53 kB/s | 22 kB 00:00 2023-12-01T23:11:49.706 INFO:teuthology.orchestra.run.smithi102.stdout:(47/172): rbd-nbd-18.0.0-7631.gbed76814.el9.x86 417 kB/s | 170 kB 00:00 2023-12-01T23:11:49.796 INFO:teuthology.orchestra.run.smithi096.stdout:(118/172): gperftools-libs-2.9.1-2.el9.x86_64.r 689 kB/s | 309 kB 00:00 2023-12-01T23:11:49.904 INFO:teuthology.orchestra.run.smithi096.stdout:(119/172): libarrow-doc-9.0.0-9.el9.noarch.rpm 227 kB/s | 24 kB 00:00 2023-12-01T23:11:49.963 INFO:teuthology.orchestra.run.smithi096.stdout:(120/172): libarrow-9.0.0-9.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2023-12-01T23:11:49.988 INFO:teuthology.orchestra.run.smithi096.stdout:(121/172): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2023-12-01T23:11:50.030 INFO:teuthology.orchestra.run.smithi096.stdout:(122/172): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-12-01T23:11:50.048 INFO:teuthology.orchestra.run.smithi102.stdout:(48/172): rbd-nbd-debuginfo-18.0.0-7631.gbed768 3.6 MB/s | 1.2 MB 00:00 2023-12-01T23:11:50.056 INFO:teuthology.orchestra.run.smithi096.stdout:(123/172): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2023-12-01T23:11:50.114 INFO:teuthology.orchestra.run.smithi096.stdout:(124/172): parquet-libs-9.0.0-9.el9.x86_64.rpm 9.8 MB/s | 837 kB 00:00 2023-12-01T23:11:50.115 INFO:teuthology.orchestra.run.smithi102.stdout:(49/172): ceph-grafana-dashboards-18.0.0-7631.g 422 kB/s | 28 kB 00:00 2023-12-01T23:11:50.139 INFO:teuthology.orchestra.run.smithi096.stdout:(125/172): python3-asyncssh-2.13.2-3.el9.noarch 6.4 MB/s | 548 kB 00:00 2023-12-01T23:11:50.181 INFO:teuthology.orchestra.run.smithi102.stdout:(50/172): ceph-mgr-cephadm-18.0.0-7631.gbed7681 1.9 MB/s | 133 kB 00:00 2023-12-01T23:11:50.182 INFO:teuthology.orchestra.run.smithi096.stdout:(126/172): python3-bcrypt-3.2.2-1.el9.x86_64.rp 659 kB/s | 43 kB 00:00 2023-12-01T23:11:50.208 INFO:teuthology.orchestra.run.smithi096.stdout:(127/172): python3-cachetools-4.2.4-1.el9.noarc 479 kB/s | 32 kB 00:00 2023-12-01T23:11:50.249 INFO:teuthology.orchestra.run.smithi096.stdout:(128/172): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2023-12-01T23:11:50.274 INFO:teuthology.orchestra.run.smithi096.stdout:(129/172): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2023-12-01T23:11:50.316 INFO:teuthology.orchestra.run.smithi096.stdout:(130/172): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2023-12-01T23:11:50.342 INFO:teuthology.orchestra.run.smithi096.stdout:(131/172): python3-google-auth-2.23.4-1.el9.noa 2.9 MB/s | 197 kB 00:00 2023-12-01T23:11:50.383 INFO:teuthology.orchestra.run.smithi096.stdout:(132/172): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2023-12-01T23:11:50.409 INFO:teuthology.orchestra.run.smithi096.stdout:(133/172): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2023-12-01T23:11:50.470 INFO:teuthology.orchestra.run.smithi096.stdout:(134/172): python3-jaraco-collections-3.0.0-8.e 269 kB/s | 23 kB 00:00 2023-12-01T23:11:50.501 INFO:teuthology.orchestra.run.smithi096.stdout:(135/172): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2023-12-01T23:11:50.535 INFO:teuthology.orchestra.run.smithi096.stdout:(136/172): python3-jaraco-text-3.2.0-6.el9.noar 308 kB/s | 20 kB 00:00 2023-12-01T23:11:50.568 INFO:teuthology.orchestra.run.smithi096.stdout:(137/172): python3-jwt+crypto-2.4.0-1.el9.noarc 135 kB/s | 9.0 kB 00:00 2023-12-01T23:11:50.602 INFO:teuthology.orchestra.run.smithi096.stdout:(138/172): python3-jwt-2.4.0-1.el9.noarch.rpm 611 kB/s | 41 kB 00:00 2023-12-01T23:11:50.632 INFO:teuthology.orchestra.run.smithi102.stdout:(51/172): ceph-mgr-dashboard-18.0.0-7631.gbed76 3.9 MB/s | 1.8 MB 00:00 2023-12-01T23:11:50.652 INFO:teuthology.orchestra.run.smithi096.stdout:(139/172): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2023-12-01T23:11:50.678 INFO:teuthology.orchestra.run.smithi096.stdout:(140/172): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2023-12-01T23:11:50.719 INFO:teuthology.orchestra.run.smithi096.stdout:(141/172): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-12-01T23:11:50.828 INFO:teuthology.orchestra.run.smithi096.stdout:(142/172): python3-natsort-7.1.1-5.el9.noarch.r 384 kB/s | 58 kB 00:00 2023-12-01T23:11:50.853 INFO:teuthology.orchestra.run.smithi096.stdout:(143/172): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2023-12-01T23:11:50.895 INFO:teuthology.orchestra.run.smithi096.stdout:(144/172): python3-portend-3.1.0-2.el9.noarch.r 247 kB/s | 16 kB 00:00 2023-12-01T23:11:50.921 INFO:teuthology.orchestra.run.smithi096.stdout:(145/172): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-12-01T23:11:50.954 INFO:teuthology.orchestra.run.smithi096.stdout:(146/172): python3-repoze-lru-0.7-16.el9.noarch 526 kB/s | 31 kB 00:00 2023-12-01T23:11:50.988 INFO:teuthology.orchestra.run.smithi096.stdout:(147/172): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2023-12-01T23:11:51.022 INFO:teuthology.orchestra.run.smithi096.stdout:(148/172): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2023-12-01T23:11:51.055 INFO:teuthology.orchestra.run.smithi096.stdout:(149/172): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2023-12-01T23:11:51.089 INFO:teuthology.orchestra.run.smithi096.stdout:(150/172): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2023-12-01T23:11:51.122 INFO:teuthology.orchestra.run.smithi096.stdout:(151/172): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2023-12-01T23:11:51.156 INFO:teuthology.orchestra.run.smithi096.stdout:(152/172): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2023-12-01T23:11:51.198 INFO:teuthology.orchestra.run.smithi096.stdout:(153/172): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2023-12-01T23:11:51.224 INFO:teuthology.orchestra.run.smithi096.stdout:(154/172): python3-zc-lockfile-2.0-10.el9.noarc 297 kB/s | 20 kB 00:00 2023-12-01T23:11:51.266 INFO:teuthology.orchestra.run.smithi096.stdout:(155/172): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2023-12-01T23:11:51.316 INFO:teuthology.orchestra.run.smithi096.stdout:(156/172): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2023-12-01T23:11:51.941 INFO:teuthology.orchestra.run.smithi096.stdout:(157/172): librbd1-18.0.0-7631.gbed76814.el9.x8 4.8 MB/s | 3.0 MB 00:00 2023-12-01T23:11:51.992 INFO:teuthology.orchestra.run.smithi096.stdout:(158/172): librados2-18.0.0-7631.gbed76814.el9. 4.6 MB/s | 3.3 MB 00:00 2023-12-01T23:11:52.008 INFO:teuthology.orchestra.run.smithi096.stdout:(159/172): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2023-12-01T23:11:52.034 INFO:teuthology.orchestra.run.smithi096.stdout:(160/172): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-01T23:11:52.059 INFO:teuthology.orchestra.run.smithi096.stdout:(161/172): elfutils-debuginfod-client-0.190-1.e 729 kB/s | 36 kB 00:00 2023-12-01T23:11:52.084 INFO:teuthology.orchestra.run.smithi096.stdout:(162/172): elfutils-libelf-0.190-1.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2023-12-01T23:11:52.109 INFO:teuthology.orchestra.run.smithi096.stdout:(163/172): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-01T23:11:52.135 INFO:teuthology.orchestra.run.smithi096.stdout:(164/172): libacl-2.3.1-4.el9.x86_64.rpm 442 kB/s | 22 kB 00:00 2023-12-01T23:11:52.160 INFO:teuthology.orchestra.run.smithi096.stdout:(165/172): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-01T23:11:52.360 INFO:teuthology.orchestra.run.smithi096.stdout:(166/172): NetworkManager-libnm-1.45.7-1.el9.x8 8.9 MB/s | 1.8 MB 00:00 2023-12-01T23:11:52.402 INFO:teuthology.orchestra.run.smithi096.stdout:(167/172): NetworkManager-1.45.7-1.el9.x86_64.r 8.5 MB/s | 2.3 MB 00:00 2023-12-01T23:11:52.428 INFO:teuthology.orchestra.run.smithi096.stdout:(168/172): NetworkManager-team-1.45.7-1.el9.x86 647 kB/s | 43 kB 00:00 2023-12-01T23:11:52.453 INFO:teuthology.orchestra.run.smithi096.stdout:(169/172): NetworkManager-tui-1.45.7-1.el9.x86_ 4.8 MB/s | 246 kB 00:00 2023-12-01T23:11:52.495 INFO:teuthology.orchestra.run.smithi096.stdout:(170/172): openssl-3.0.7-25.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2023-12-01T23:11:52.545 INFO:teuthology.orchestra.run.smithi096.stdout:(171/172): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.2 MB 00:00 2023-12-01T23:11:52.574 INFO:teuthology.orchestra.run.smithi102.stdout:(52/172): ceph-mgr-diskprediction-local-18.0.0- 3.8 MB/s | 7.4 MB 00:01 2023-12-01T23:11:52.690 INFO:teuthology.orchestra.run.smithi102.stdout:(53/172): ceph-mgr-modules-core-18.0.0-7631.gbe 2.0 MB/s | 243 kB 00:00 2023-12-01T23:11:52.757 INFO:teuthology.orchestra.run.smithi102.stdout:(54/172): ceph-mgr-rook-18.0.0-7631.gbed76814.e 754 kB/s | 50 kB 00:00 2023-12-01T23:11:52.816 INFO:teuthology.orchestra.run.smithi102.stdout:(55/172): ceph-prometheus-alerts-18.0.0-7631.gb 260 kB/s | 15 kB 00:00 2023-12-01T23:11:52.949 INFO:teuthology.orchestra.run.smithi102.stdout:(56/172): ceph-volume-18.0.0-7631.gbed76814.el9 1.9 MB/s | 262 kB 00:00 2023-12-01T23:11:53.183 INFO:teuthology.orchestra.run.smithi102.stdout:(57/172): cephadm-18.0.0-7631.gbed76814.el9.noa 3.2 MB/s | 776 kB 00:00 2023-12-01T23:11:53.250 INFO:teuthology.orchestra.run.smithi102.stdout:(58/172): cephfs-top-18.0.0-7631.gbed76814.el9. 273 kB/s | 18 kB 00:00 2023-12-01T23:11:53.354 INFO:teuthology.orchestra.run.smithi096.stdout:(172/172): librbd1-debuginfo-18.0.0-7631.gbed76 2.2 MB/s | 50 MB 00:22 2023-12-01T23:11:53.360 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-12-01T23:11:53.361 INFO:teuthology.orchestra.run.smithi096.stdout:Total 16 MB/s | 2.1 GB 02:14 2023-12-01T23:11:53.384 INFO:teuthology.orchestra.run.smithi102.stdout:(59/172): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2023-12-01T23:11:53.434 INFO:teuthology.orchestra.run.smithi102.stdout:(60/172): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2023-12-01T23:11:53.468 INFO:teuthology.orchestra.run.smithi102.stdout:(61/172): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2023-12-01T23:11:53.493 INFO:teuthology.orchestra.run.smithi102.stdout:(62/172): elfutils-libelf-devel-0.190-1.el9.x86 858 kB/s | 21 kB 00:00 2023-12-01T23:11:53.533 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-12-01T23:11:53.537 INFO:teuthology.orchestra.run.smithi102.stdout:(63/172): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-01T23:11:53.569 INFO:teuthology.orchestra.run.smithi102.stdout:(64/172): flexiblas-3.0.4-8.el9.x86_64.rpm 947 kB/s | 32 kB 00:00 2023-12-01T23:11:53.725 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-12-01T23:11:53.726 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-12-01T23:11:54.019 INFO:teuthology.orchestra.run.smithi102.stdout:(65/172): rbd-mirror-debuginfo-18.0.0-7631.gbed 6.4 MB/s | 50 MB 00:07 2023-12-01T23:11:54.078 INFO:teuthology.orchestra.run.smithi102.stdout:(66/172): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2023-12-01T23:11:54.103 INFO:teuthology.orchestra.run.smithi102.stdout:(67/172): flexiblas-openblas-openmp-3.0.4-8.el9 212 kB/s | 17 kB 00:00 2023-12-01T23:11:54.128 INFO:teuthology.orchestra.run.smithi102.stdout:(68/172): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-01T23:11:54.154 INFO:teuthology.orchestra.run.smithi102.stdout:(69/172): libaio-devel-0.3.111-13.el9.x86_64.rp 200 kB/s | 10 kB 00:00 2023-12-01T23:11:54.179 INFO:teuthology.orchestra.run.smithi102.stdout:(70/172): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-01T23:11:54.204 INFO:teuthology.orchestra.run.smithi102.stdout:(71/172): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2023-12-01T23:11:54.230 INFO:teuthology.orchestra.run.smithi102.stdout:(72/172): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-01T23:11:54.255 INFO:teuthology.orchestra.run.smithi102.stdout:(73/172): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-01T23:11:54.280 INFO:teuthology.orchestra.run.smithi102.stdout:(74/172): libuuid-devel-2.37.4-15.el9.x86_64.rp 496 kB/s | 24 kB 00:00 2023-12-01T23:11:54.306 INFO:teuthology.orchestra.run.smithi102.stdout:(75/172): libzstd-devel-1.5.1-2.el9.x86_64.rpm 924 kB/s | 46 kB 00:00 2023-12-01T23:11:54.331 INFO:teuthology.orchestra.run.smithi102.stdout:(76/172): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-01T23:11:54.356 INFO:teuthology.orchestra.run.smithi102.stdout:(77/172): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-01T23:11:54.381 INFO:teuthology.orchestra.run.smithi102.stdout:(78/172): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-01T23:11:54.407 INFO:teuthology.orchestra.run.smithi102.stdout:(79/172): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2023-12-01T23:11:54.507 INFO:teuthology.orchestra.run.smithi102.stdout:(80/172): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2023-12-01T23:11:54.549 INFO:teuthology.orchestra.run.smithi102.stdout:(81/172): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2023-12-01T23:11:54.574 INFO:teuthology.orchestra.run.smithi102.stdout:(82/172): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2023-12-01T23:11:54.599 INFO:teuthology.orchestra.run.smithi102.stdout:(83/172): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-12-01T23:11:54.716 INFO:teuthology.orchestra.run.smithi102.stdout:(84/172): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2023-12-01T23:11:54.808 INFO:teuthology.orchestra.run.smithi102.stdout:(85/172): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2023-12-01T23:11:54.834 INFO:teuthology.orchestra.run.smithi102.stdout:(86/172): python3-jinja2-2.11.3-4.el9.noarch.rp 1.9 MB/s | 228 kB 00:00 2023-12-01T23:11:54.859 INFO:teuthology.orchestra.run.smithi102.stdout:(87/172): python3-jsonpatch-1.21-16.el9.noarch. 489 kB/s | 24 kB 00:00 2023-12-01T23:11:54.884 INFO:teuthology.orchestra.run.smithi102.stdout:(88/172): python3-jsonpointer-2.0-4.el9.noarch. 361 kB/s | 18 kB 00:00 2023-12-01T23:11:54.926 INFO:teuthology.orchestra.run.smithi102.stdout:(89/172): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-12-01T23:11:54.951 INFO:teuthology.orchestra.run.smithi102.stdout:(90/172): python3-markupsafe-1.1.1-12.el9.x86_6 474 kB/s | 32 kB 00:00 2023-12-01T23:11:55.121 INFO:teuthology.orchestra.run.smithi102.stdout:(91/172): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-12-01T23:11:55.152 INFO:teuthology.orchestra.run.smithi102.stdout:(92/172): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.1 MB/s | 217 kB 00:00 2023-12-01T23:11:55.177 INFO:teuthology.orchestra.run.smithi102.stdout:(93/172): python3-oauthlib-3.1.1-5.el9.noarch.r 3.1 MB/s | 174 kB 00:00 2023-12-01T23:11:55.211 INFO:teuthology.orchestra.run.smithi102.stdout:(94/172): python3-prettytable-0.7.2-27.el9.noar 709 kB/s | 41 kB 00:00 2023-12-01T23:11:55.236 INFO:teuthology.orchestra.run.smithi102.stdout:(95/172): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-01T23:11:55.261 INFO:teuthology.orchestra.run.smithi102.stdout:(96/172): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-01T23:11:55.287 INFO:teuthology.orchestra.run.smithi102.stdout:(97/172): python3-pytz-2021.1-5.el9.noarch.rpm 953 kB/s | 47 kB 00:00 2023-12-01T23:11:55.312 INFO:teuthology.orchestra.run.smithi102.stdout:(98/172): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2023-12-01T23:11:55.488 INFO:teuthology.orchestra.run.smithi102.stdout:(99/172): python3-toml-0.10.2-6.el9.noarch.rpm 222 kB/s | 39 kB 00:00 2023-12-01T23:11:55.713 INFO:teuthology.orchestra.run.smithi102.stdout:(100/172): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2023-12-01T23:11:55.738 INFO:teuthology.orchestra.run.smithi102.stdout:(101/172): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-12-01T23:11:55.755 INFO:teuthology.orchestra.run.smithi102.stdout:(102/172): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2023-12-01T23:11:55.780 INFO:teuthology.orchestra.run.smithi102.stdout:(103/172): xfsprogs-devel-5.19.0-4.el9.x86_64.r 2.0 MB/s | 85 kB 00:00 2023-12-01T23:11:55.797 INFO:teuthology.orchestra.run.smithi102.stdout:(104/172): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-01T23:11:55.814 INFO:teuthology.orchestra.run.smithi102.stdout:(105/172): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-01T23:11:55.839 INFO:teuthology.orchestra.run.smithi102.stdout:(106/172): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-12-01T23:11:55.865 INFO:teuthology.orchestra.run.smithi102.stdout:(107/172): libgfortran-11.4.1-2.3.el9.x86_64.rp 16 MB/s | 803 kB 00:00 2023-12-01T23:11:55.890 INFO:teuthology.orchestra.run.smithi102.stdout:(108/172): libquadmath-11.4.1-2.3.el9.x86_64.rp 3.9 MB/s | 195 kB 00:00 2023-12-01T23:11:55.915 INFO:teuthology.orchestra.run.smithi102.stdout:(109/172): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-01T23:11:55.949 INFO:teuthology.orchestra.run.smithi102.stdout:(110/172): python3-cryptography-36.0.1-4.el9.x8 20 MB/s | 1.1 MB 00:00 2023-12-01T23:11:55.974 INFO:teuthology.orchestra.run.smithi102.stdout:(111/172): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-01T23:11:55.999 INFO:teuthology.orchestra.run.smithi102.stdout:(112/172): python3-pycparser-2.20-6.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-12-01T23:11:56.025 INFO:teuthology.orchestra.run.smithi102.stdout:(113/172): python3-requests-2.25.1-7.el9.noarch 2.2 MB/s | 113 kB 00:00 2023-12-01T23:11:56.050 INFO:teuthology.orchestra.run.smithi102.stdout:(114/172): python3-urllib3-1.26.5-4.el9.noarch. 3.7 MB/s | 187 kB 00:00 2023-12-01T23:11:56.202 INFO:teuthology.orchestra.run.smithi102.stdout:(115/172): python3-devel-3.9.17-2.el9.x86_64.rp 1.6 MB/s | 245 kB 00:00 2023-12-01T23:11:56.384 INFO:teuthology.orchestra.run.smithi102.stdout:(116/172): openssl-devel-3.0.7-25.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2023-12-01T23:11:56.617 INFO:teuthology.orchestra.run.smithi102.stdout:(117/172): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2023-12-01T23:11:56.842 INFO:teuthology.orchestra.run.smithi102.stdout:(118/172): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2023-12-01T23:11:57.034 INFO:teuthology.orchestra.run.smithi102.stdout:(119/172): libarrow-doc-9.0.0-9.el9.noarch.rpm 127 kB/s | 24 kB 00:00 2023-12-01T23:11:57.101 INFO:teuthology.orchestra.run.smithi102.stdout:(120/172): libarrow-9.0.0-9.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2023-12-01T23:11:57.260 INFO:teuthology.orchestra.run.smithi102.stdout:(121/172): liboath-2.6.7-2.el9.x86_64.rpm 216 kB/s | 49 kB 00:00 2023-12-01T23:11:57.285 INFO:teuthology.orchestra.run.smithi102.stdout:(122/172): libunwind-1.6.2-1.el9.x86_64.rpm 426 kB/s | 67 kB 00:00 2023-12-01T23:11:57.444 INFO:teuthology.orchestra.run.smithi102.stdout:(123/172): luarocks-3.9.2-1.el9.noarch.rpm 821 kB/s | 151 kB 00:00 2023-12-01T23:11:57.577 INFO:teuthology.orchestra.run.smithi102.stdout:(124/172): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.1 MB/s | 837 kB 00:00 2023-12-01T23:11:57.644 INFO:teuthology.orchestra.run.smithi102.stdout:(125/172): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2023-12-01T23:11:57.736 INFO:teuthology.orchestra.run.smithi102.stdout:(126/172): python3-bcrypt-3.2.2-1.el9.x86_64.rp 274 kB/s | 43 kB 00:00 2023-12-01T23:11:57.762 INFO:teuthology.orchestra.run.smithi102.stdout:(127/172): python3-cachetools-4.2.4-1.el9.noarc 277 kB/s | 32 kB 00:00 2023-12-01T23:11:57.889 INFO:teuthology.orchestra.run.smithi102.stdout:(128/172): python3-certifi-2021.10.8-2.el9.noar 98 kB/s | 15 kB 00:00 2023-12-01T23:11:57.948 INFO:teuthology.orchestra.run.smithi102.stdout:(129/172): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2023-12-01T23:11:58.081 INFO:teuthology.orchestra.run.smithi102.stdout:(130/172): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-12-01T23:11:58.165 INFO:teuthology.orchestra.run.smithi102.stdout:(131/172): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2023-12-01T23:11:58.190 INFO:teuthology.orchestra.run.smithi102.stdout:(132/172): python3-google-auth-2.23.4-1.el9.noa 819 kB/s | 197 kB 00:00 2023-12-01T23:11:58.299 INFO:teuthology.orchestra.run.smithi102.stdout:(133/172): python3-jaraco-classes-3.2.1-5.el9.n 132 kB/s | 18 kB 00:00 2023-12-01T23:11:58.357 INFO:teuthology.orchestra.run.smithi102.stdout:(134/172): python3-jaraco-collections-3.0.0-8.e 161 kB/s | 23 kB 00:00 2023-12-01T23:11:58.424 INFO:teuthology.orchestra.run.smithi102.stdout:(135/172): python3-jaraco-functools-3.5.0-2.el9 156 kB/s | 19 kB 00:00 2023-12-01T23:11:58.499 INFO:teuthology.orchestra.run.smithi102.stdout:(136/172): python3-jaraco-text-3.2.0-6.el9.noar 139 kB/s | 20 kB 00:00 2023-12-01T23:11:58.525 INFO:teuthology.orchestra.run.smithi102.stdout:(137/172): python3-jwt+crypto-2.4.0-1.el9.noarc 91 kB/s | 9.0 kB 00:00 2023-12-01T23:11:58.667 INFO:teuthology.orchestra.run.smithi102.stdout:(138/172): python3-jwt-2.4.0-1.el9.noarch.rpm 245 kB/s | 41 kB 00:00 2023-12-01T23:11:58.776 INFO:teuthology.orchestra.run.smithi102.stdout:(139/172): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2023-12-01T23:11:58.801 INFO:teuthology.orchestra.run.smithi102.stdout:(140/172): python3-logutils-0.3.5-21.el9.noarch 347 kB/s | 46 kB 00:00 2023-12-01T23:11:58.959 INFO:teuthology.orchestra.run.smithi102.stdout:(141/172): python3-natsort-7.1.1-5.el9.noarch.r 427 kB/s | 58 kB 00:00 2023-12-01T23:11:58.984 INFO:teuthology.orchestra.run.smithi102.stdout:(142/172): python3-more-itertools-8.12.0-2.el9. 378 kB/s | 79 kB 00:00 2023-12-01T23:11:59.101 INFO:teuthology.orchestra.run.smithi102.stdout:(143/172): python3-portend-3.1.0-2.el9.noarch.r 176 kB/s | 16 kB 00:00 2023-12-01T23:11:59.223 INFO:teuthology.orchestra.run.smithi102.stdout:(144/172): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2023-12-01T23:11:59.285 INFO:teuthology.orchestra.run.smithi102.stdout:(145/172): python3-pyOpenSSL-21.0.0-1.el9.noarc 490 kB/s | 90 kB 00:00 2023-12-01T23:11:59.352 INFO:teuthology.orchestra.run.smithi102.stdout:(146/172): python3-repoze-lru-0.7-16.el9.noarch 239 kB/s | 31 kB 00:00 2023-12-01T23:11:59.469 INFO:teuthology.orchestra.run.smithi102.stdout:(147/172): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2023-12-01T23:11:59.494 INFO:teuthology.orchestra.run.smithi102.stdout:(148/172): python3-rsa-4.9-2.el9.noarch.rpm 419 kB/s | 59 kB 00:00 2023-12-01T23:11:59.620 INFO:teuthology.orchestra.run.smithi102.stdout:(149/172): python3-tempora-5.0.0-2.el9.noarch.r 238 kB/s | 36 kB 00:00 2023-12-01T23:11:59.653 INFO:teuthology.orchestra.run.smithi102.stdout:(150/172): python3-typing-extensions-4.4.0-2.el 379 kB/s | 51 kB 00:00 2023-12-01T23:11:59.812 INFO:teuthology.orchestra.run.smithi102.stdout:(151/172): python3-websocket-client-1.2.3-2.el9 665 kB/s | 90 kB 00:00 2023-12-01T23:11:59.871 INFO:teuthology.orchestra.run.smithi102.stdout:(152/172): python3-webob-1.8.7-6.el9.noarch.rpm 916 kB/s | 230 kB 00:00 2023-12-01T23:11:59.988 INFO:teuthology.orchestra.run.smithi102.stdout:(153/172): python3-zc-lockfile-2.0-10.el9.noarc 172 kB/s | 20 kB 00:00 2023-12-01T23:12:00.021 INFO:teuthology.orchestra.run.smithi102.stdout:(154/172): python3-werkzeug-2.0.3-3.el9.1.noarc 2.0 MB/s | 427 kB 00:00 2023-12-01T23:12:00.271 INFO:teuthology.orchestra.run.smithi102.stdout:(155/172): re2-20211101-3.el9.x86_64.rpm 676 kB/s | 192 kB 00:00 2023-12-01T23:12:00.313 INFO:teuthology.orchestra.run.smithi102.stdout:(156/172): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2023-12-01T23:12:01.639 INFO:teuthology.orchestra.run.smithi102.stdout:(157/172): librbd1-18.0.0-7631.gbed76814.el9.x8 2.3 MB/s | 3.0 MB 00:01 2023-12-01T23:12:01.664 INFO:teuthology.orchestra.run.smithi102.stdout:(158/172): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 68 kB 00:00 2023-12-01T23:12:01.698 INFO:teuthology.orchestra.run.smithi102.stdout:(159/172): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-01T23:12:01.740 INFO:teuthology.orchestra.run.smithi102.stdout:(160/172): elfutils-debuginfod-client-0.190-1.e 876 kB/s | 36 kB 00:00 2023-12-01T23:12:01.773 INFO:teuthology.orchestra.run.smithi102.stdout:(161/172): elfutils-libelf-0.190-1.el9.x86_64.r 5.6 MB/s | 192 kB 00:00 2023-12-01T23:12:01.815 INFO:teuthology.orchestra.run.smithi102.stdout:(162/172): elfutils-libs-0.190-1.el9.x86_64.rpm 6.0 MB/s | 255 kB 00:00 2023-12-01T23:12:01.874 INFO:teuthology.orchestra.run.smithi102.stdout:(163/172): librados2-18.0.0-7631.gbed76814.el9. 2.1 MB/s | 3.3 MB 00:01 2023-12-01T23:12:01.899 INFO:teuthology.orchestra.run.smithi102.stdout:(164/172): libacl-2.3.1-4.el9.x86_64.rpm 263 kB/s | 22 kB 00:00 2023-12-01T23:12:01.924 INFO:teuthology.orchestra.run.smithi102.stdout:(165/172): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-01T23:12:02.975 INFO:teuthology.orchestra.run.smithi102.stdout:(166/172): NetworkManager-libnm-1.45.7-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2023-12-01T23:12:03.033 INFO:teuthology.orchestra.run.smithi102.stdout:(167/172): NetworkManager-1.45.7-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2023-12-01T23:12:03.633 INFO:teuthology.orchestra.run.smithi102.stdout:(168/172): NetworkManager-team-1.45.7-1.el9.x86 66 kB/s | 43 kB 00:00 2023-12-01T23:12:03.917 INFO:teuthology.orchestra.run.smithi102.stdout:(169/172): NetworkManager-tui-1.45.7-1.el9.x86_ 279 kB/s | 246 kB 00:00 2023-12-01T23:12:04.651 INFO:teuthology.orchestra.run.smithi102.stdout:(170/172): openssl-3.0.7-25.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:01 2023-12-01T23:12:05.026 INFO:teuthology.orchestra.run.smithi102.stdout:(171/172): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.9 MB/s | 2.2 MB 00:01 2023-12-01T23:12:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-12-01T23:12:06.909 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-12-01T23:12:24.366 INFO:teuthology.orchestra.run.smithi102.stdout:(172/172): ceph-test-debuginfo-18.0.0-7631.gbed 9.0 MB/s | 622 MB 01:09 2023-12-01T23:12:24.369 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2023-12-01T23:12:24.369 INFO:teuthology.orchestra.run.smithi102.stdout:Total 14 MB/s | 2.1 GB 02:35 2023-12-01T23:12:24.536 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2023-12-01T23:12:24.728 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2023-12-01T23:12:24.728 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2023-12-01T23:12:26.904 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-12-01T23:12:27.151 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_6 1/187 2023-12-01T23:12:27.264 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/187 2023-12-01T23:12:27.294 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/187 2023-12-01T23:12:27.342 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/187 2023-12-01T23:12:27.378 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/187 2023-12-01T23:12:27.403 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/187 2023-12-01T23:12:27.454 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/187 2023-12-01T23:12:27.791 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/187 2023-12-01T23:12:27.838 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 9/187 2023-12-01T23:12:27.956 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 9/187 2023-12-01T23:12:27.998 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 10/187 2023-12-01T23:12:28.088 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 10/187 2023-12-01T23:12:28.124 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 11/187 2023-12-01T23:12:28.180 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/187 2023-12-01T23:12:28.357 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/187 2023-12-01T23:12:28.417 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/187 2023-12-01T23:12:28.444 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:12:28.529 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:12:28.554 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 16/187 2023-12-01T23:12:28.759 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 16/187 2023-12-01T23:12:28.875 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/187 2023-12-01T23:12:28.918 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/187 2023-12-01T23:12:29.007 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:12:29.053 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:12:29.255 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:12:29.355 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/187 2023-12-01T23:12:29.418 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/187 2023-12-01T23:12:29.486 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/187 2023-12-01T23:12:29.540 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/187 2023-12-01T23:12:29.569 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/187 2023-12-01T23:12:29.613 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/187 2023-12-01T23:12:29.654 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/187 2023-12-01T23:12:29.727 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/187 2023-12-01T23:12:29.761 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/187 2023-12-01T23:12:29.811 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/187 2023-12-01T23:12:29.839 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/187 2023-12-01T23:12:29.910 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/187 2023-12-01T23:12:29.944 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 31/187 2023-12-01T23:12:29.987 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 32/187 2023-12-01T23:12:30.016 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 33/187 2023-12-01T23:12:30.088 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/187 2023-12-01T23:12:30.164 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/187 2023-12-01T23:12:30.304 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/187 2023-12-01T23:12:30.360 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/187 2023-12-01T23:12:30.910 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/187 2023-12-01T23:12:30.987 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/187 2023-12-01T23:12:31.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/187 2023-12-01T23:12:31.068 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 41/187 2023-12-01T23:12:31.105 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 42/187 2023-12-01T23:12:31.147 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/187 2023-12-01T23:12:31.286 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/187 2023-12-01T23:12:31.348 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/187 2023-12-01T23:12:31.459 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/187 2023-12-01T23:12:31.493 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 47/187 2023-12-01T23:12:31.548 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/187 2023-12-01T23:12:31.621 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/187 2023-12-01T23:12:31.652 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/187 2023-12-01T23:12:31.689 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/187 2023-12-01T23:12:31.735 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/187 2023-12-01T23:12:31.781 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/187 2023-12-01T23:12:31.831 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/187 2023-12-01T23:12:31.977 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/187 2023-12-01T23:12:32.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/187 2023-12-01T23:12:32.071 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 57/187 2023-12-01T23:12:32.165 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/187 2023-12-01T23:12:32.231 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 59/187 2023-12-01T23:12:32.271 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/187 2023-12-01T23:12:32.304 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/187 2023-12-01T23:12:32.589 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 62/187 2023-12-01T23:12:32.843 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/187 2023-12-01T23:12:33.094 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/187 2023-12-01T23:12:33.157 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/187 2023-12-01T23:12:33.357 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/187 2023-12-01T23:12:33.411 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/187 2023-12-01T23:12:33.543 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/187 2023-12-01T23:12:33.598 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/187 2023-12-01T23:12:33.626 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/187 2023-12-01T23:12:33.661 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/187 2023-12-01T23:12:33.695 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/187 2023-12-01T23:12:33.723 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-15.el9.x86_64 73/187 2023-12-01T23:12:33.752 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 74/187 2023-12-01T23:12:33.795 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/187 2023-12-01T23:12:33.831 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/187 2023-12-01T23:12:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/187 2023-12-01T23:12:33.938 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/187 2023-12-01T23:12:33.971 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/187 2023-12-01T23:12:34.005 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/187 2023-12-01T23:12:34.046 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/187 2023-12-01T23:12:34.081 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/187 2023-12-01T23:12:34.172 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/187 2023-12-01T23:12:34.209 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/187 2023-12-01T23:12:34.313 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/187 2023-12-01T23:12:34.368 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/187 2023-12-01T23:12:35.122 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/187 2023-12-01T23:12:35.165 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/187 2023-12-01T23:12:35.199 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/187 2023-12-01T23:12:35.232 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/187 2023-12-01T23:12:35.412 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/187 2023-12-01T23:12:35.438 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/187 2023-12-01T23:12:35.514 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/187 2023-12-01T23:12:36.207 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/187 2023-12-01T23:12:36.313 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/187 2023-12-01T23:12:37.606 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/187 2023-12-01T23:12:37.689 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/187 2023-12-01T23:12:37.712 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 98/187 2023-12-01T23:12:37.743 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-16.el9.x86_64 99/187 2023-12-01T23:12:37.772 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/187 2023-12-01T23:12:37.805 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 101/187 2023-12-01T23:12:38.006 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2023-12-01T23:12:38.006 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2023-12-01T23:12:38.105 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/187 2023-12-01T23:12:38.135 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 103/187 2023-12-01T23:12:38.225 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 103/187 2023-12-01T23:12:38.256 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 104/187 2023-12-01T23:12:38.293 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/187 2023-12-01T23:12:38.720 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 106/187 2023-12-01T23:12:38.754 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 107/187 2023-12-01T23:12:38.809 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 107/187 2023-12-01T23:12:38.831 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 108/187 2023-12-01T23:12:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:12:40.970 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:12:41.512 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:12:41.548 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 110/187 2023-12-01T23:12:41.637 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 110/187 2023-12-01T23:12:41.637 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-01T23:12:41.638 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-01T23:12:41.638 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:41.675 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 111/187 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 111/187 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2023-12-01T23:12:53.093 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2023-12-01T23:12:53.094 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2023-12-01T23:12:53.094 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2023-12-01T23:12:53.094 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:53.263 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 112/187 2023-12-01T23:12:53.278 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 112/187 2023-12-01T23:12:53.278 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:53.278 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-01T23:12:53.278 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:54.832 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 113/187 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 113/187 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-01T23:12:54.860 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:55.069 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 114/187 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 114/187 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-01T23:12:55.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:55.562 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 115/187 2023-12-01T23:12:55.584 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 115/187 2023-12-01T23:12:55.584 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:55.584 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-01T23:12:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-01T23:12:55.585 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-01T23:12:55.585 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:55.680 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.2-8.el9.noarch 116/187 2023-12-01T23:12:56.135 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 117/187 2023-12-01T23:12:56.162 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 117/187 2023-12-01T23:12:56.183 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 118/187 2023-12-01T23:12:56.237 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 119/187 2023-12-01T23:12:56.261 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 120/187 2023-12-01T23:12:56.487 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 120/187 2023-12-01T23:12:56.520 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 121/187 2023-12-01T23:12:57.491 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 121/187 2023-12-01T23:12:57.520 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 122/187 2023-12-01T23:12:57.620 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 122/187 2023-12-01T23:12:57.779 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 123/187 2023-12-01T23:12:57.806 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 124/187 2023-12-01T23:12:57.828 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 124/187 2023-12-01T23:12:57.828 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:57.828 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-01T23:12:57.829 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-01T23:12:57.829 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-01T23:12:57.829 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:57.865 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 125/187 2023-12-01T23:12:57.875 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 125/187 2023-12-01T23:12:57.920 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 126/187 2023-12-01T23:12:58.058 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2023-12-01T23:12:58.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_6 1/187 2023-12-01T23:12:58.284 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 2/187 2023-12-01T23:12:58.318 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 3/187 2023-12-01T23:12:58.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/187 2023-12-01T23:12:58.401 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/187 2023-12-01T23:12:58.426 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/187 2023-12-01T23:12:58.478 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/187 2023-12-01T23:12:58.714 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-45.el9.x86_64 127/187 2023-12-01T23:12:58.742 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 128/187 2023-12-01T23:12:58.764 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 128/187 2023-12-01T23:12:58.764 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:58.764 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-01T23:12:58.764 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-01T23:12:58.764 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-01T23:12:58.765 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:58.801 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 129/187 2023-12-01T23:12:58.818 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/187 2023-12-01T23:12:58.822 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7631.gbed76 129/187 2023-12-01T23:12:58.822 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:58.822 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-01T23:12:58.822 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:58.868 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/187 2023-12-01T23:12:58.877 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 9/187 2023-12-01T23:12:58.890 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/187 2023-12-01T23:12:58.890 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:58.890 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-01T23:12:58.890 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-01T23:12:58.890 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-01T23:12:58.891 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:58.988 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 9/187 2023-12-01T23:12:59.012 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 10/187 2023-12-01T23:12:59.095 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 10/187 2023-12-01T23:12:59.131 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 11/187 2023-12-01T23:12:59.174 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 12/187 2023-12-01T23:12:59.185 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 131/187 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 131/187 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-01T23:12:59.208 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:12:59.363 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 13/187 2023-12-01T23:12:59.414 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/187 2023-12-01T23:12:59.442 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:12:59.542 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:12:59.568 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 16/187 2023-12-01T23:12:59.761 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 16/187 2023-12-01T23:12:59.872 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/187 2023-12-01T23:12:59.924 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 17/187 2023-12-01T23:13:00.039 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:13:00.092 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:13:00.392 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 18/187 2023-12-01T23:13:00.620 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/187 2023-12-01T23:13:00.655 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/187 2023-12-01T23:13:00.726 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/187 2023-12-01T23:13:00.778 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 22/187 2023-12-01T23:13:00.808 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/187 2023-12-01T23:13:00.860 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 24/187 2023-12-01T23:13:00.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 25/187 2023-12-01T23:13:00.974 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/187 2023-12-01T23:13:01.008 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/187 2023-12-01T23:13:01.042 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/187 2023-12-01T23:13:01.069 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/187 2023-12-01T23:13:01.141 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/187 2023-12-01T23:13:01.175 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 31/187 2023-12-01T23:13:01.219 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 32/187 2023-12-01T23:13:01.246 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 33/187 2023-12-01T23:13:01.316 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/187 2023-12-01T23:13:01.404 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/187 2023-12-01T23:13:01.562 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/187 2023-12-01T23:13:01.614 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/187 2023-12-01T23:13:02.137 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/187 2023-12-01T23:13:02.218 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/187 2023-12-01T23:13:02.257 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/187 2023-12-01T23:13:02.306 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 41/187 2023-12-01T23:13:02.343 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 42/187 2023-12-01T23:13:02.386 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/187 2023-12-01T23:13:02.543 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/187 2023-12-01T23:13:02.595 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/187 2023-12-01T23:13:02.701 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/187 2023-12-01T23:13:02.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 47/187 2023-12-01T23:13:02.795 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/187 2023-12-01T23:13:02.868 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/187 2023-12-01T23:13:02.899 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/187 2023-12-01T23:13:02.937 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/187 2023-12-01T23:13:02.984 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/187 2023-12-01T23:13:03.029 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/187 2023-12-01T23:13:03.042 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 132/187 2023-12-01T23:13:03.071 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/187 2023-12-01T23:13:03.088 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 133/187 2023-12-01T23:13:03.130 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 134/187 2023-12-01T23:13:03.161 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 135/187 2023-12-01T23:13:03.207 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/187 2023-12-01T23:13:03.248 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/187 2023-12-01T23:13:03.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 57/187 2023-12-01T23:13:03.352 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 136/187 2023-12-01T23:13:03.392 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/187 2023-12-01T23:13:03.432 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 59/187 2023-12-01T23:13:03.469 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 137/187 2023-12-01T23:13:03.481 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/187 2023-12-01T23:13:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 138/187 2023-12-01T23:13:03.522 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/187 2023-12-01T23:13:03.535 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 139/187 2023-12-01T23:13:03.602 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 140/187 2023-12-01T23:13:03.620 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 62/187 2023-12-01T23:13:03.662 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 141/187 2023-12-01T23:13:03.666 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 63/187 2023-12-01T23:13:03.704 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 142/187 2023-12-01T23:13:03.724 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 64/187 2023-12-01T23:13:03.733 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 143/187 2023-12-01T23:13:03.779 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 144/187 2023-12-01T23:13:03.790 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 65/187 2023-12-01T23:13:03.983 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 66/187 2023-12-01T23:13:04.029 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 67/187 2023-12-01T23:13:04.171 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 68/187 2023-12-01T23:13:04.223 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 69/187 2023-12-01T23:13:04.252 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 70/187 2023-12-01T23:13:04.286 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 71/187 2023-12-01T23:13:04.321 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/187 2023-12-01T23:13:04.349 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-15.el9.x86_64 73/187 2023-12-01T23:13:04.377 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 74/187 2023-12-01T23:13:04.415 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 75/187 2023-12-01T23:13:04.433 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:04.448 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 76/187 2023-12-01T23:13:04.470 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:04.478 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/187 2023-12-01T23:13:04.489 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:04.555 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/187 2023-12-01T23:13:04.589 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/187 2023-12-01T23:13:04.622 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/187 2023-12-01T23:13:04.663 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/187 2023-12-01T23:13:04.698 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/187 2023-12-01T23:13:04.789 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/187 2023-12-01T23:13:04.827 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/187 2023-12-01T23:13:04.930 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/187 2023-12-01T23:13:04.977 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/187 2023-12-01T23:13:05.306 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 146/187 2023-12-01T23:13:05.722 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/187 2023-12-01T23:13:05.799 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/187 2023-12-01T23:13:05.833 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/187 2023-12-01T23:13:05.874 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/187 2023-12-01T23:13:06.052 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/187 2023-12-01T23:13:06.080 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/187 2023-12-01T23:13:06.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/187 2023-12-01T23:13:06.849 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/187 2023-12-01T23:13:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/187 2023-12-01T23:13:08.207 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/187 2023-12-01T23:13:08.272 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/187 2023-12-01T23:13:08.303 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 98/187 2023-12-01T23:13:08.334 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : jq-1.6-16.el9.x86_64 99/187 2023-12-01T23:13:08.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 100/187 2023-12-01T23:13:08.397 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 101/187 2023-12-01T23:13:08.696 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 102/187 2023-12-01T23:13:08.726 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 103/187 2023-12-01T23:13:08.800 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 103/187 2023-12-01T23:13:08.833 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 104/187 2023-12-01T23:13:08.875 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 105/187 2023-12-01T23:13:09.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 106/187 2023-12-01T23:13:09.329 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 107/187 2023-12-01T23:13:09.400 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 107/187 2023-12-01T23:13:09.423 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 108/187 2023-12-01T23:13:11.448 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:13:11.488 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:13:12.021 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 109/187 2023-12-01T23:13:12.065 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 110/187 2023-12-01T23:13:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 110/187 2023-12-01T23:13:12.160 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-01T23:13:12.160 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-01T23:13:12.160 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:12.199 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 111/187 2023-12-01T23:13:12.907 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 147/187 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 111/187 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2023-12-01T23:13:24.433 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:24.600 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 112/187 2023-12-01T23:13:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 112/187 2023-12-01T23:13:24.615 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:24.615 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-01T23:13:24.615 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:26.182 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 113/187 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 113/187 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-01T23:13:26.207 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:26.408 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 114/187 2023-12-01T23:13:26.429 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 114/187 2023-12-01T23:13:26.429 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:26.429 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-01T23:13:26.429 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-01T23:13:26.430 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-01T23:13:26.430 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:26.892 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 115/187 2023-12-01T23:13:26.913 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 115/187 2023-12-01T23:13:26.913 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:26.913 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-01T23:13:26.914 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-01T23:13:26.914 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-01T23:13:26.914 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:27.010 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 116/187 2023-12-01T23:13:27.473 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 117/187 2023-12-01T23:13:27.508 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 117/187 2023-12-01T23:13:27.538 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 118/187 2023-12-01T23:13:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 119/187 2023-12-01T23:13:27.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 120/187 2023-12-01T23:13:27.848 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 120/187 2023-12-01T23:13:27.874 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 121/187 2023-12-01T23:13:28.841 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 121/187 2023-12-01T23:13:28.866 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 122/187 2023-12-01T23:13:28.966 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 122/187 2023-12-01T23:13:29.131 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 123/187 2023-12-01T23:13:29.160 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 124/187 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 124/187 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-01T23:13:29.183 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:29.228 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 125/187 2023-12-01T23:13:29.238 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 125/187 2023-12-01T23:13:29.286 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 126/187 2023-12-01T23:13:30.067 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-45.el9.x86_64 127/187 2023-12-01T23:13:30.096 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 128/187 2023-12-01T23:13:30.118 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 128/187 2023-12-01T23:13:30.119 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:30.119 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-01T23:13:30.119 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-01T23:13:30.119 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-01T23:13:30.119 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:30.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 129/187 2023-12-01T23:13:30.177 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7631.gbed76 129/187 2023-12-01T23:13:30.177 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:30.177 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-01T23:13:30.177 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:30.222 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/187 2023-12-01T23:13:30.244 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 130/187 2023-12-01T23:13:30.244 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:30.244 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-01T23:13:30.244 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-01T23:13:30.245 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-01T23:13:30.245 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:30.545 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 131/187 2023-12-01T23:13:30.567 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 131/187 2023-12-01T23:13:30.567 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-01T23:13:30.567 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-01T23:13:30.568 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-01T23:13:30.568 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-01T23:13:30.568 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:13:34.410 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 132/187 2023-12-01T23:13:34.460 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 133/187 2023-12-01T23:13:34.500 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 134/187 2023-12-01T23:13:34.533 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 135/187 2023-12-01T23:13:34.708 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 136/187 2023-12-01T23:13:34.832 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 137/187 2023-12-01T23:13:34.865 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 138/187 2023-12-01T23:13:34.897 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 139/187 2023-12-01T23:13:34.985 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 140/187 2023-12-01T23:13:35.040 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 141/187 2023-12-01T23:13:35.074 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 142/187 2023-12-01T23:13:35.103 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 143/187 2023-12-01T23:13:35.141 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 144/187 2023-12-01T23:13:35.845 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:35.883 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:35.902 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 145/187 2023-12-01T23:13:36.710 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 146/187 2023-12-01T23:13:44.330 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 147/187 2023-12-01T23:13:51.396 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9. 148/187 2023-12-01T23:13:52.003 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el 149/187 2023-12-01T23:13:52.175 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9. 150/187 2023-12-01T23:13:56.716 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 151/187 2023-12-01T23:13:58.735 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x 152/187 2023-12-01T23:14:09.752 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x 153/187 2023-12-01T23:14:22.965 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9. 148/187 2023-12-01T23:14:23.560 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el 149/187 2023-12-01T23:14:23.727 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9. 150/187 2023-12-01T23:14:27.986 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 151/187 2023-12-01T23:14:30.276 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x 152/187 2023-12-01T23:14:39.830 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x 154/187 2023-12-01T23:14:41.407 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x 153/187 2023-12-01T23:14:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x 155/187 2023-12-01T23:15:11.699 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x 154/187 2023-12-01T23:15:28.364 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x 155/187 2023-12-01T23:15:58.814 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.e 156/187 2023-12-01T23:15:59.548 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9. 157/187 2023-12-01T23:15:59.594 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9 158/187 2023-12-01T23:16:04.198 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-debuginfo-2:18.0.0-7631.gbed76814 159/187 2023-12-01T23:16:09.646 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados2-debuginfo-2:18.0.0-7631.gbed76814.el9. 160/187 2023-12-01T23:16:09.982 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 161/187 2023-12-01T23:16:10.297 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814 162/187 2023-12-01T23:16:10.584 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-debuginfo-2:18.0.0-7631.gbed76814. 163/187 2023-12-01T23:16:10.648 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el 164/187 2023-12-01T23:16:10.728 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el 165/187 2023-12-01T23:16:16.065 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x 166/187 2023-12-01T23:16:16.468 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9 167/187 2023-12-01T23:16:17.434 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 168/187 2023-12-01T23:16:17.555 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 169/187 2023-12-01T23:16:18.107 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 170/187 2023-12-01T23:16:18.261 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.4-9.el9.x86_64 171/187 2023-12-01T23:16:18.301 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.7.4-5.el9.x86_64 172/187 2023-12-01T23:16:18.326 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 173/187 2023-12-01T23:16:18.351 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 174/187 2023-12-01T23:16:18.378 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 175/187 2023-12-01T23:16:18.378 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/187 2023-12-01T23:16:18.471 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/187 2023-12-01T23:16:18.500 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 177/187 2023-12-01T23:16:18.541 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 178/187 2023-12-01T23:16:18.571 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 179/187 2023-12-01T23:16:18.572 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/187 2023-12-01T23:16:18.648 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/187 2023-12-01T23:16:18.672 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 181/187 2023-12-01T23:16:18.683 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:18.683 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:18.875 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:18.875 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:18.974 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:19.000 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 184/187 2023-12-01T23:16:19.025 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 185/187 2023-12-01T23:16:19.060 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 186/187 2023-12-01T23:16:19.134 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 187/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 187/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 1/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9. 3/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 4/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el 5/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_6 6/187 2023-12-01T23:16:28.015 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 7/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9. 8/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 9/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 10/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 11/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x 12/187 2023-12-01T23:16:28.016 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 13/187 2023-12-01T23:16:28.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x 14/187 2023-12-01T23:16:28.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:16:28.017 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x 16/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 17/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x 18/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 19/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.e 20/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 21/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 22/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9. 23/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 24/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 25/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 26/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9 27/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 28/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 29/187 2023-12-01T23:16:28.018 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-7631.gbed76814 30/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-debuginfo-2:18.0.0-7631.gbed76814.el9. 31/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 32/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 33/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 34/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 35/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 36/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 37/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814 38/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 39/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-7631.gbed76814. 40/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 41/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el 42/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 43/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el 44/187 2023-12-01T23:16:28.019 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 45/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x 46/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 47/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9 48/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 49/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 50/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 51/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 52/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 53/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 54/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 55/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 56/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 57/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 58/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 59/187 2023-12-01T23:16:28.020 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 60/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 63/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 64/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-16.el9.x86_64 69/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/187 2023-12-01T23:16:28.021 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 79/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 80/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 81/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 87/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 88/187 2023-12-01T23:16:28.022 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 89/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 90/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 91/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 92/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 93/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 94/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 96/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 97/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 98/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 99/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 100/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 101/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 102/187 2023-12-01T23:16:28.023 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 103/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 104/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 105/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 106/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 107/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 108/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 109/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 110/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 111/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 112/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 113/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 114/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 115/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 116/187 2023-12-01T23:16:28.024 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 117/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 118/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 119/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 120/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 121/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 122/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 123/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 124/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 125/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 126/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 127/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 128/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 129/187 2023-12-01T23:16:28.025 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 130/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 131/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 132/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 133/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 134/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 135/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 137/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 138/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 139/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 140/187 2023-12-01T23:16:28.026 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 141/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 142/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 143/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 144/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 145/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 146/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 147/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 148/187 2023-12-01T23:16:28.027 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 149/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 150/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 151/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 152/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 153/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 154/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 155/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 156/187 2023-12-01T23:16:28.028 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 157/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 158/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 159/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 160/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 161/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 162/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 163/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : acl-2.3.1-4.el9.x86_64 164/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : acl-2.3.1-3.el9.x86_64 165/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 166/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 167/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 168/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 169/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 170/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 171/187 2023-12-01T23:16:28.029 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 176/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 177/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 178/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 179/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 180/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 181/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 182/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 184/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 185/187 2023-12-01T23:16:28.030 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 186/187 2023-12-01T23:16:30.103 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.e 156/187 2023-12-01T23:16:30.680 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 187/187 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: acl-2.3.1-4.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-01T23:16:30.681 INFO:teuthology.orchestra.run.smithi096.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.2-8.el9.noarch 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.7.4-5.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.683 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.684 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.4-9.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: jq-1.6-16.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.685 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.686 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: lua-5.4.4-4.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-01T23:16:30.687 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-13.11-1.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-01T23:16:30.688 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-01T23:16:30.689 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-01T23:16:30.690 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-01T23:16:30.691 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:16:30.692 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-01T23:16:30.693 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:16:30.694 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-12-01T23:16:30.732 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9. 157/187 2023-12-01T23:16:30.787 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9 158/187 2023-12-01T23:16:31.345 DEBUG:teuthology.parallel:result is None 2023-12-01T23:16:35.416 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-debuginfo-2:18.0.0-7631.gbed76814 159/187 2023-12-01T23:16:40.866 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados2-debuginfo-2:18.0.0-7631.gbed76814.el9. 160/187 2023-12-01T23:16:41.186 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 161/187 2023-12-01T23:16:41.466 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814 162/187 2023-12-01T23:16:41.862 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-debuginfo-2:18.0.0-7631.gbed76814. 163/187 2023-12-01T23:16:42.161 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el 164/187 2023-12-01T23:16:42.515 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el 165/187 2023-12-01T23:16:47.840 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x 166/187 2023-12-01T23:16:47.985 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9 167/187 2023-12-01T23:16:48.865 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 168/187 2023-12-01T23:16:48.999 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 169/187 2023-12-01T23:16:49.533 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 170/187 2023-12-01T23:16:49.798 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 171/187 2023-12-01T23:16:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 172/187 2023-12-01T23:16:50.312 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 173/187 2023-12-01T23:16:50.396 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 174/187 2023-12-01T23:16:50.422 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 175/187 2023-12-01T23:16:50.423 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/187 2023-12-01T23:16:50.515 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/187 2023-12-01T23:16:50.544 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 177/187 2023-12-01T23:16:50.585 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 178/187 2023-12-01T23:16:50.615 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 179/187 2023-12-01T23:16:50.616 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/187 2023-12-01T23:16:50.691 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/187 2023-12-01T23:16:50.716 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 181/187 2023-12-01T23:16:50.724 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:50.724 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:50.911 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 182/187 2023-12-01T23:16:50.911 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:50.978 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:51.010 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 184/187 2023-12-01T23:16:51.044 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 185/187 2023-12-01T23:16:51.070 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 186/187 2023-12-01T23:16:51.135 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 187/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 187/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:18.0.0-7631.gbed76814.el9.x86_64 1/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9. 3/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 4/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el 5/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_6 6/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 7/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9. 8/187 2023-12-01T23:16:59.839 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7631.gbed76 9/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.0.0-7 10/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 11/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x 12/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 13/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x 14/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 15/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x 16/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 17/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x 18/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 19/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.e 20/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 21/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 22/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9. 23/187 2023-12-01T23:16:59.840 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 24/187 2023-12-01T23:16:59.841 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_ 25/187 2023-12-01T23:16:59.841 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 26/187 2023-12-01T23:16:59.841 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9 27/187 2023-12-01T23:16:59.841 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 28/187 2023-12-01T23:16:59.841 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:18.0.0-7631.gbed76814.el9.x86_6 29/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-debuginfo-2:18.0.0-7631.gbed76814 30/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-debuginfo-2:18.0.0-7631.gbed76814.el9. 31/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86 32/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 33/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 34/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7631.gbed76814.el 35/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:18.0.0-7631.gbed76814.el9. 36/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_6 37/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814 38/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 39/187 2023-12-01T23:16:59.842 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-debuginfo-2:18.0.0-7631.gbed76814. 40/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 41/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el 42/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 43/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el 44/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 45/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x 46/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 47/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9 48/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 49/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x8 50/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7631.gbed76814. 51/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noa 52/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.n 53/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed 54/187 2023-12-01T23:16:59.843 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el 55/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 56/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.e 57/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 58/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:18.0.0-7631.gbed76814.el9.noarch 59/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 60/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 63/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 64/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : jq-1.6-16.el9.x86_64 69/187 2023-12-01T23:16:59.844 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 70/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 74/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 75/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 76/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 77/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 78/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 79/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 80/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 81/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.11-1.el9.x86_64 82/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 83/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 84/187 2023-12-01T23:16:59.845 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 85/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 87/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 88/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 89/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 90/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 91/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 92/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 93/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 94/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 96/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 97/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 98/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 99/187 2023-12-01T23:16:59.846 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 100/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 101/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 102/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 103/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 104/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 105/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 106/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 107/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 108/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 109/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 110/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 111/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 112/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 113/187 2023-12-01T23:16:59.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 114/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 115/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 116/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 117/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 118/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 119/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 120/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 121/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 122/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 123/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 124/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 125/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 126/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 127/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 128/187 2023-12-01T23:16:59.848 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 129/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 130/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 131/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 132/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 133/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 134/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 135/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 136/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 137/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 138/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 139/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 140/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 141/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 142/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 143/187 2023-12-01T23:16:59.849 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 144/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 145/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 146/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 147/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 148/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 149/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 150/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 151/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 152/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 153/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 154/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 155/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-3.el9.x86_64 156/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 157/187 2023-12-01T23:16:59.850 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:18.0.0-7631.gbed76814.el9.x86_64 158/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 159/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 160/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 161/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 162/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 163/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-4.el9.x86_64 164/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : acl-2.3.1-3.el9.x86_64 165/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 166/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 167/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 168/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 169/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 170/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 171/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 172/187 2023-12-01T23:16:59.851 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 173/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 174/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 175/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 176/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 177/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 178/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 179/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 180/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 181/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 182/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 183/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 184/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 185/187 2023-12-01T23:16:59.852 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 186/187 2023-12-01T23:17:02.669 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 187/187 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: acl-2.3.1-4.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-01T23:17:02.670 INFO:teuthology.orchestra.run.smithi102.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.671 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.672 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.673 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.674 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:18.0.0-7631.gbed76814.el9.noarch 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-01T23:17:02.675 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: jq-1.6-16.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-01T23:17:02.676 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-01T23:17:02.677 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.11-1.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-01T23:17:02.678 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-01T23:17:02.679 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-01T23:17:02.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-01T23:17:02.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-01T23:17:02.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-debuginfo-2:18.0.0-7631.gbed76814.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-3.el9.x86_64 2023-12-01T23:17:02.683 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:02.684 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2023-12-01T23:17:03.315 DEBUG:teuthology.parallel:result is None 2023-12-01T23:17:03.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:17:03.536 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-01T23:17:03.561 INFO:teuthology.orchestra.run.smithi096.stdout:18.0.0-7631.gbed76814.el9 2023-12-01T23:17:03.562 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7631.gbed76814.el9 2023-12-01T23:17:03.562 INFO:teuthology.task.install:The correct ceph version 18.0.0-7631.gbed76814 is installed. 2023-12-01T23:17:03.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:17:03.706 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-01T23:17:03.730 INFO:teuthology.orchestra.run.smithi102.stdout:18.0.0-7631.gbed76814.el9 2023-12-01T23:17:03.730 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7631.gbed76814.el9 2023-12-01T23:17:03.731 INFO:teuthology.task.install:The correct ceph version 18.0.0-7631.gbed76814 is installed. 2023-12-01T23:17:03.731 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-01T23:17:03.731 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:03.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T23:17:03.765 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:03.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T23:17:03.801 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-01T23:17:03.801 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:03.801 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T23:17:03.836 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T23:17:03.905 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:03.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T23:17:03.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T23:17:04.000 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-01T23:17:04.000 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:04.000 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T23:17:04.031 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T23:17:04.102 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:04.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T23:17:04.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T23:17:04.195 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-01T23:17:04.195 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:04.195 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T23:17:04.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T23:17:04.289 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:04.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T23:17:04.315 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T23:17:04.383 INFO:teuthology.run_tasks:Running task ceph... 2023-12-01T23:17:04.458 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-01T23:17:04.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2023-12-01T23:17:04.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2023-12-01T23:17:04.486 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-01T23:17:04.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-01T23:17:04.527 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-01T23:17:04.554 INFO:tasks.ceph:Creating extra log directories... 2023-12-01T23:17:04.554 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-01T23:17:04.594 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-01T23:17:04.626 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-01T23:17:04.626 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-01T23:17:04.626 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-01T23:17:04.626 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:04.626 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-01T23:17:04.674 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:04.793 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:04.819 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:04.819 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-01T23:17:04.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:04.953 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:04.988 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-01T23:17:04.988 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-01T23:17:04.989 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453', 'branch': 'main', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7474453', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1991, 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5u9+uNlGB2YWutX3Cmr7b6ud89iTWgYtn5XMcLs4DdTp8j0oxlfDvkBy0pyaEvFYIQjLgWqbo2HtWPfGBa7kA=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoqpsyrcBEMH2A5n6a8bsSeKBPM4Y72Gd+vAxFAmxwZHLJJnTUq2/QNgjtMlgdLqfmCc/XAZefFGkJSmG4+TWc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bed7681480ccb0192b91a35e691658867e1e96b7', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-01_17:57:53', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-01T23:17:04.989 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-01T23:17:04.991 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-01T23:17:05.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2023-12-01T23:17:05.046 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2023-12-01T23:17:05.103 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:05.103 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T23:17:05.126 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T23:17:05.126 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-12-01 23:16:19.461037459 +0000 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-12-01 23:08:45.606352298 +0000 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-12-01 23:08:45.606352298 +0000 2023-12-01T23:17:05.180 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-12-01 23:08:45.606352298 +0000 2023-12-01T23:17:05.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T23:17:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-12-01T23:17:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-12-01T23:17:05.246 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000196065 s, 2.6 MB/s 2023-12-01T23:17:05.247 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T23:17:05.302 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2023-12-01T23:17:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T23:17:05.357 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:05.357 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-01T23:17:05.357 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:05.358 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:05.358 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-12-01 23:16:19.461037459 +0000 2023-12-01T23:17:05.358 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-12-01 23:08:46.152339016 +0000 2023-12-01T23:17:05.358 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-12-01 23:08:46.152339016 +0000 2023-12-01T23:17:05.358 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-12-01 23:08:46.152339016 +0000 2023-12-01T23:17:05.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T23:17:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-12-01T23:17:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-12-01T23:17:05.423 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000249216 s, 2.1 MB/s 2023-12-01T23:17:05.424 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T23:17:05.482 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2023-12-01T23:17:05.537 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T23:17:05.537 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:05.537 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-01T23:17:05.537 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-12-01 23:16:19.462037435 +0000 2023-12-01T23:17:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-12-01 23:08:46.638327194 +0000 2023-12-01T23:17:05.538 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-12-01 23:08:46.638327194 +0000 2023-12-01T23:17:05.538 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-12-01 23:08:46.638327194 +0000 2023-12-01T23:17:05.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T23:17:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-12-01T23:17:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-12-01T23:17:05.603 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000223687 s, 2.3 MB/s 2023-12-01T23:17:05.604 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T23:17:05.660 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-12-01 23:16:19.462037435 +0000 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-12-01 23:08:47.131315202 +0000 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-12-01 23:08:47.131315202 +0000 2023-12-01T23:17:05.715 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2023-12-01 23:08:47.131315202 +0000 2023-12-01T23:17:05.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T23:17:05.781 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-12-01T23:17:05.781 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-12-01T23:17:05.781 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000190518 s, 2.7 MB/s 2023-12-01T23:17:05.782 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T23:17:05.838 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:05.838 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:05.838 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T23:17:05.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T23:17:05.854 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 657 Links: 1 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:05.910 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-12-01 23:16:51.466364384 +0000 2023-12-01T23:17:05.911 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-12-01 23:08:45.616465217 +0000 2023-12-01T23:17:05.911 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-12-01 23:08:45.616465217 +0000 2023-12-01T23:17:05.911 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-12-01 23:08:45.616465217 +0000 2023-12-01T23:17:05.911 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T23:17:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-12-01T23:17:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-12-01T23:17:05.977 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000201888 s, 2.5 MB/s 2023-12-01T23:17:05.978 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T23:17:06.035 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 679 Links: 1 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-12-01 23:16:51.467364364 +0000 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-12-01 23:08:46.107455343 +0000 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-12-01 23:08:46.107455343 +0000 2023-12-01T23:17:06.091 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-12-01 23:08:46.107455343 +0000 2023-12-01T23:17:06.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T23:17:06.156 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-12-01T23:17:06.156 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-12-01T23:17:06.156 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000188789 s, 2.7 MB/s 2023-12-01T23:17:06.157 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T23:17:06.212 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 697 Links: 1 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-12-01 23:16:51.467364364 +0000 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-12-01 23:08:46.600445428 +0000 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-12-01 23:08:46.600445428 +0000 2023-12-01T23:17:06.268 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-12-01 23:08:46.600445428 +0000 2023-12-01T23:17:06.269 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T23:17:06.333 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-12-01T23:17:06.333 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-12-01T23:17:06.333 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000229338 s, 2.2 MB/s 2023-12-01T23:17:06.334 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T23:17:06.390 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2023-12-01T23:17:06.445 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T23:17:06.445 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 715 Links: 1 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2023-12-01 23:16:51.468364344 +0000 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2023-12-01 23:08:47.086435654 +0000 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2023-12-01 23:08:47.086435654 +0000 2023-12-01T23:17:06.446 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2023-12-01 23:08:47.086435654 +0000 2023-12-01T23:17:06.446 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T23:17:06.511 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2023-12-01T23:17:06.511 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2023-12-01T23:17:06.511 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000162396 s, 3.2 MB/s 2023-12-01T23:17:06.512 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T23:17:06.567 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:06.567 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-01T23:17:06.567 INFO:tasks.ceph:Generating config... 2023-12-01T23:17:06.568 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-01T23:17:06.569 INFO:tasks.ceph:[client] debug client = 20 2023-12-01T23:17:06.569 INFO:tasks.ceph:[client] debug ms = 1 2023-12-01T23:17:06.569 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-01T23:17:06.569 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-01T23:17:06.569 INFO:tasks.ceph:[global] mds beacon grace = 60 2023-12-01T23:17:06.569 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2023-12-01T23:17:06.569 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] mds valgrind exit = True 2023-12-01T23:17:06.569 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-01T23:17:06.570 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-12-01T23:17:06.570 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-01T23:17:06.570 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-12-01T23:17:06.570 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-01T23:17:06.570 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-01T23:17:06.571 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-01T23:17:06.571 INFO:tasks.ceph:Setting up mon.a... 2023-12-01T23:17:06.572 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-01T23:17:06.624 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2023-12-01T23:17:06.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-01T23:17:06.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T23:17:06.700 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]')] 2023-12-01T23:17:06.701 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-01T23:17:06.701 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:06.701 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-01T23:17:06.755 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --add b 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:06.841 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid 427efaec-98ee-4c98-922b-5db70b583575 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:fsid 427efaec-98ee-4c98-922b-5db70b583575 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2023-12-01T23:17:06.841279+0000 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:created 2023-12-01T23:17:06.841279+0000 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 16 (pacific) 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2023-12-01T23:17:06.842 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-01T23:17:06.844 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-01T23:17:06.858 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 427efaec-98ee-4c98-922b-5db70b583575... 2023-12-01T23:17:06.859 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-01T23:17:06.901 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-01T23:17:06.948 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2023-12-01T23:17:06.949 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2023-12-01T23:17:06.950 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2023-12-01T23:17:06.951 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: mds beacon grace = 60 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: mds heartbeat grace = 60 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd heartbeat grace = 60 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 427efaec-98ee-4c98-922b-5db70b583575 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2023-12-01T23:17:06.952 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug trim objects = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2023-12-01T23:17:06.953 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2023-12-01T23:17:06.954 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: osd fast shutdown = False 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2023-12-01T23:17:06.955 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2023-12-01T23:17:06.956 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon op complaint time = 120 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd crush smoke test = False 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-01T23:17:06.957 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout: client mount timeout = 600 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout: debug client = 20 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.e] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2023-12-01T23:17:06.958 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.f] 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout:[mds] 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds = 20 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug mds balancer = 20 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug frag = True 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: mds debug scatterstat = True 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: mds op complaint time = 180 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: mds valgrind exit = True 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: mds verify scatter = True 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: osd op complaint time = 180 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: rados mon op timeout = 900 2023-12-01T23:17:06.959 INFO:teuthology.orchestra.run.smithi096.stdout: rados osd op timeout = 900 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2023-12-01T23:17:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.961 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-01T23:17:06.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.96,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mds beacon grace = 60 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: mds heartbeat grace = 60 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: osd heartbeat grace = 60 2023-12-01T23:17:06.963 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 427efaec-98ee-4c98-922b-5db70b583575 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2023-12-01T23:17:06.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2023-12-01T23:17:06.965 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore compression mode = aggressive 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2023-12-01T23:17:06.966 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd fast shutdown = False 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-12-01T23:17:06.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2023-12-01T23:17:06.968 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-01T23:17:06.969 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd crush smoke test = False 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2023-12-01T23:17:06.970 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2023-12-01T23:17:06.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2023-12-01T23:17:06.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2023-12-01T23:17:06.973 INFO:teuthology.orchestra.run.smithi102.stdout: mds valgrind exit = True 2023-12-01T23:17:06.973 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2023-12-01T23:17:06.973 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2023-12-01T23:17:06.973 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2023-12-01T23:17:06.973 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2023-12-01T23:17:06.975 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-01T23:17:06.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-01T23:17:07.069 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-01T23:17:07.070 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:07.070 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-01T23:17:07.084 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:07.084 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-01T23:17:07.139 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:17:07.139 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:07.139 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-01T23:17:07.139 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T23:17:07.219 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:07.219 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:07.273 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:17:07.273 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:07.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-01T23:17:07.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-01T23:17:07.314 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:07.314 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:07.368 INFO:tasks.ceph:Setting up mon nodes... 2023-12-01T23:17:07.369 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-01T23:17:07.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-01T23:17:07.423 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-01T23:17:07.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-01T23:17:07.498 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-01T23:17:07.500 INFO:tasks.ceph:Setting up mds nodes... 2023-12-01T23:17:07.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-01T23:17:07.555 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-01T23:17:07.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-01T23:17:07.584 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-01T23:17:07.679 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-01T23:17:07.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-01T23:17:07.708 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-12-01T23:17:07.802 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-12-01T23:17:07.804 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-12-01T23:17:07.830 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-01T23:17:07.886 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-01T23:17:07.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-01T23:17:07.914 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-01T23:17:08.009 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-01T23:17:08.011 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-01T23:17:08.037 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-12-01T23:17:08.132 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-12-01T23:17:08.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-12-01T23:17:08.161 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-01T23:17:08.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-01T23:17:08.203 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-01T23:17:08.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-01T23:17:08.219 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-01T23:17:08.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-01T23:17:08.285 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:08.285 INFO:tasks.ceph:role: osd.0 2023-12-01T23:17:08.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:17:08.285 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-01T23:17:08.359 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:08.359 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:08.360 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:08.878 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-12-01T23:17:08.880 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-12-01T23:17:08.880 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-01T23:17:09.001 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-01T23:17:09.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-01T23:17:09.104 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:09.104 INFO:tasks.ceph:role: osd.1 2023-12-01T23:17:09.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:17:09.105 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-01T23:17:09.178 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:09.179 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:09.632 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-12-01T23:17:09.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-12-01T23:17:09.634 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-01T23:17:09.730 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-01T23:17:09.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-01T23:17:09.827 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:09.828 INFO:tasks.ceph:role: osd.2 2023-12-01T23:17:09.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:17:09.828 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-01T23:17:09.901 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:09.901 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:09.901 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:09.902 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:10.395 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-12-01T23:17:10.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-12-01T23:17:10.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-01T23:17:10.523 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-01T23:17:10.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-01T23:17:10.624 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:10.624 INFO:tasks.ceph:role: osd.3 2023-12-01T23:17:10.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:17:10.625 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-01T23:17:10.700 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:10.701 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:11.192 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-12-01T23:17:11.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-12-01T23:17:11.194 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-01T23:17:11.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-01T23:17:11.353 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:11.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.450+0000 7fe08b00c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-01T23:17:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.450+0000 7fe08b00c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-01T23:17:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.450+0000 7fe08b00c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T23:17:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.450+0000 7fe08b00c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T23:17:11.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.450+0000 7fe08b00c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-01T23:17:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:11.452+0000 7fe08b00c500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-01T23:17:14.315 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-01T23:17:14.346 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.435+0000 7ff697611500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-01T23:17:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.435+0000 7ff697611500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-01T23:17:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.435+0000 7ff697611500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T23:17:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.435+0000 7ff697611500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T23:17:14.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.435+0000 7ff697611500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-01T23:17:14.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:14.436+0000 7ff697611500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-01T23:17:17.293 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-01T23:17:17.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:17.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.415+0000 7fb6cf2ad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-01T23:17:17.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.415+0000 7fb6cf2ad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-01T23:17:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.415+0000 7fb6cf2ad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T23:17:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.415+0000 7fb6cf2ad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T23:17:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.415+0000 7fb6cf2ad500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-01T23:17:17.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:17.416+0000 7fb6cf2ad500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-01T23:17:20.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-01T23:17:20.300 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:20.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.389+0000 7faee300e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-01T23:17:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.389+0000 7faee300e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-01T23:17:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.389+0000 7faee300e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T23:17:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.389+0000 7faee300e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T23:17:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.389+0000 7faee300e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-01T23:17:20.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:20.390+0000 7faee300e500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-01T23:17:23.235 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-01T23:17:23.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-01T23:17:23.297 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:23.297 INFO:tasks.ceph:role: osd.4 2023-12-01T23:17:23.297 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:17:23.298 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:23.374 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:23.375 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:23.906 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-12-01T23:17:23.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-12-01T23:17:23.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-01T23:17:24.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-01T23:17:24.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-01T23:17:24.125 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:24.125 INFO:tasks.ceph:role: osd.5 2023-12-01T23:17:24.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:17:24.126 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:24.205 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-12-01T23:17:24.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-12-01T23:17:24.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-01T23:17:24.759 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-01T23:17:24.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-01T23:17:24.868 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:24.868 INFO:tasks.ceph:role: osd.6 2023-12-01T23:17:24.868 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:17:24.869 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-01T23:17:24.947 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:24.947 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:24.947 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:24.947 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:24.947 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:24.948 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:24.948 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:24.948 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:24.948 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:24.948 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:25.432 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-12-01T23:17:25.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-12-01T23:17:25.435 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-01T23:17:25.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-01T23:17:25.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-01T23:17:25.693 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-01T23:17:25.693 INFO:tasks.ceph:role: osd.7 2023-12-01T23:17:25.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:17:25.694 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-01T23:17:25.770 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-01T23:17:25.771 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-01T23:17:26.292 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2023-12-01T23:17:26.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2023-12-01T23:17:26.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-01T23:17:26.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-01T23:17:26.449 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.548+0000 7fab60e11500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.549+0000 7fab60e11500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.549+0000 7fab60e11500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.549+0000 7fab60e11500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.549+0000 7fab60e11500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-01T23:17:26.551 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:26.549+0000 7fab60e11500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-01T23:17:29.401 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-01T23:17:29.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:29.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.526+0000 7f8174c8a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-01T23:17:29.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.526+0000 7f8174c8a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-01T23:17:29.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.526+0000 7f8174c8a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-01T23:17:29.527 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.526+0000 7f8174c8a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-01T23:17:29.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.526+0000 7f8174c8a500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-01T23:17:29.528 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:29.527+0000 7f8174c8a500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-01T23:17:32.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-01T23:17:32.406 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:32.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.495+0000 7fb5722b6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-01T23:17:32.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.495+0000 7fb5722b6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-01T23:17:32.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.495+0000 7fb5722b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-01T23:17:32.496 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.495+0000 7fb5722b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-01T23:17:32.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.495+0000 7fb5722b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-01T23:17:32.497 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:32.496+0000 7fb5722b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-01T23:17:34.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:34.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:17:35.349 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-01T23:17:35.380 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:35.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.470+0000 7f4872b92500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-01T23:17:35.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.470+0000 7f4872b92500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-01T23:17:35.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.470+0000 7f4872b92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-01T23:17:35.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.470+0000 7f4872b92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-01T23:17:35.471 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.470+0000 7f4872b92500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-01T23:17:35.472 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:17:35.471+0000 7f4872b92500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-01T23:17:38.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-01T23:17:38.362 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-01T23:17:38.362 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-01T23:17:38.394 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.394 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-01T23:17:38.464 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-01T23:17:38.533 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-12-01T23:17:38.602 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.602 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-01T23:17:38.671 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.671 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-01T23:17:38.738 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-01T23:17:38.805 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:38.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-01T23:17:38.871 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:38.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-01T23:17:38.902 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:38.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-01T23:17:38.972 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:38.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-01T23:17:39.040 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:39.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-12-01T23:17:39.108 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:39.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-01T23:17:39.175 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:39.175 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-01T23:17:39.241 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:39.241 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-01T23:17:39.310 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:17:39.310 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-01T23:17:39.376 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:17:39.376 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-01T23:17:39.391 INFO:tasks.ceph:Adding keys to all mons... 2023-12-01T23:17:39.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-01T23:17:39.434 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-01T23:17:39.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2023-12-01T23:17:39.457 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWpl/09GGRAAmp2K88nB4o8DcJlqZRN8rg== 2023-12-01T23:17:39.457 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWplPvUkIRAAGvQJNv1I6JidI/qzpjBv9w== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWplHmR+KBAAguGCy/OLTCcxS4+EY9pwMw== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.e] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWplH3jTLxAAijkc0NFHYPfYArnmRiDGgw== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB3aWplwG/qGhAAiHdzISpFCzVNJYxb3Xo1DQ== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB6aWpl49P9GRAAXr7r0q7WH3gPXtUtSyBdow== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB9aWplAcHRGBAAMVXaayLM355zPt3BYc5j/w== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCAaWpljhREFxAA/NJ93r9XLzDCMmUWfefr3g== 2023-12-01T23:17:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWplKq2yHRAAolnPMbg6uxVGTweoNWz3PA== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBzaWplu8rRNBAAJ9izAbfY6j/4nFG+NNarLg== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB0aWplbNCQABAAqOD6p10erqfjhWMrE18YuA== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.f] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB0aWplxbDoBxAAIxo8dkz+mXCW7HF2pVAQPg== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCGaWpldnLHIBAA9mkk/PaRvhGNwHgGyvScbQ== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCJaWplo2BsHxAA/kl+e6EOANpdSYIZTxo18g== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCMaWpl37eWHRAAyWgHWPBnQSVoX+Yrn1FBLA== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCPaWplW5sVHBAAqaicsZrYmwFd3UYC9iu7IA== 2023-12-01T23:17:39.459 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2023-12-01T23:17:39.460 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQB0aWpl0PMqDBAAT3TCHNQaOyhaa5459WoNAQ== 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWpl/09GGRAAmp2K88nB4o8DcJlqZRN8rg== 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWplPvUkIRAAGvQJNv1I6JidI/qzpjBv9w== 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWplHmR+KBAAguGCy/OLTCcxS4+EY9pwMw== 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e] 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWplH3jTLxAAijkc0NFHYPfYArnmRiDGgw== 2023-12-01T23:17:39.461 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB3aWplwG/qGhAAiHdzISpFCzVNJYxb3Xo1DQ== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB6aWpl49P9GRAAXr7r0q7WH3gPXtUtSyBdow== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB9aWplAcHRGBAAMVXaayLM355zPt3BYc5j/w== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAaWpljhREFxAA/NJ93r9XLzDCMmUWfefr3g== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWplKq2yHRAAolnPMbg6uxVGTweoNWz3PA== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzaWplu8rRNBAAJ9izAbfY6j/4nFG+NNarLg== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB0aWplbNCQABAAqOD6p10erqfjhWMrE18YuA== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f] 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB0aWplxbDoBxAAIxo8dkz+mXCW7HF2pVAQPg== 2023-12-01T23:17:39.462 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCGaWpldnLHIBAA9mkk/PaRvhGNwHgGyvScbQ== 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCJaWplo2BsHxAA/kl+e6EOANpdSYIZTxo18g== 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCMaWpl37eWHRAAyWgHWPBnQSVoX+Yrn1FBLA== 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCPaWplW5sVHBAAqaicsZrYmwFd3UYC9iu7IA== 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2023-12-01T23:17:39.463 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB0aWpl0PMqDBAAT3TCHNQaOyhaa5459WoNAQ== 2023-12-01T23:17:39.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T23:17:39.504 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T23:17:39.555 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.611 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.613 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.669 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.723 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.832 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:39.937 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T23:17:39.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-01T23:17:39.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:39.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:40.047 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:40.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:40.103 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:40.106 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-01T23:17:40.160 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.163 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.214 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.267 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-01T23:17:40.374 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-01T23:17:40.376 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-01T23:17:40.430 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-01T23:17:40.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-01T23:17:40.457 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T23:17:40.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-01T23:17:40.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-01T23:17:40.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T23:17:40.703 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-01T23:17:40.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-01T23:17:40.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-01T23:17:40.893 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-01T23:17:40.919 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:40.922 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-01T23:17:40.974 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-01T23:17:40.975 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-01T23:17:40.975 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-01T23:17:40.975 DEBUG:teuthology.orchestra.run.smithi096:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-12-01T23:17:40.977 INFO:tasks.ceph.mon.a:Started 2023-12-01T23:17:40.977 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-01T23:17:40.978 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-01T23:17:40.978 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-12-01T23:17:41.017 INFO:tasks.ceph.mon.b:Started 2023-12-01T23:17:41.017 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-01T23:17:41.018 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-01T23:17:41.018 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-12-01T23:17:41.020 INFO:tasks.ceph.mon.c:Started 2023-12-01T23:17:41.020 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-01T23:17:41.020 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-01T23:17:41.020 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-12-01T23:17:41.022 INFO:tasks.ceph.mgr.y:Started 2023-12-01T23:17:41.022 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-01T23:17:41.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-12-01T23:17:41.024 INFO:tasks.ceph.mgr.x:Started 2023-12-01T23:17:41.024 INFO:tasks.ceph:Setting crush tunables to default 2023-12-01T23:17:41.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2023-12-01T23:17:41.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.124+0000 7f8b180e5640 1 Processor -- start 2023-12-01T23:17:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.124+0000 7f8b180e5640 1 -- start start 2023-12-01T23:17:41.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.124+0000 7f8b180e5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b180e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10159ba0 con 0x7f8b100c82b0 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b180e5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1015a3e0 con 0x7f8b1015d600 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b180e5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8b1006f720 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b15e81640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 msgr2=0x7f8b100c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b15680640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8b100c82b0 legacy=0x7f8b10159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:41.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.125+0000 7f8b16682640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8b10163e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:41.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.326+0000 7f8b15e81640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 msgr2=0x7f8b100c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2023-12-01T23:17:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.326+0000 7f8b15680640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8b100c82b0 legacy=0x7f8b10159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.326+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:41.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.326+0000 7f8b16682640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8b10163e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:41.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.727+0000 7f8b15680640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8b100c82b0 legacy=0x7f8b10159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:41.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.727+0000 7f8b15e81640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 msgr2=0x7f8b100c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2023-12-01T23:17:41.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.727+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:41.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:41.727+0000 7f8b16682640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8b10163e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:42.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:42.528+0000 7f8b15e81640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 msgr2=0x7f8b100c7040 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.96:3300/0 2023-12-01T23:17:42.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:42.528+0000 7f8b15680640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8b100c82b0 legacy=0x7f8b10159490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:42.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:42.528+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:42.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:42.528+0000 7f8b16682640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8b10163e10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 -- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 msgr2=0x7f8b100c7040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8b1006f720 0x7f8b100c7040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8b10163e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8b100c82b0 legacy=0x7f8b10159490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8af40036a0 2023-12-01T23:17:44.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b077fe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4008ca0 con 0x7f8af4006110 2023-12-01T23:17:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b15e81640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 msgr2=0x7f8af4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b15680640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b15e81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:44.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.125+0000 7f8b15680640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:44.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.325+0000 7f8b15680640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.325+0000 7f8b15e81640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 msgr2=0x7f8af4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.325+0000 7f8b15680640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:44.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.325+0000 7f8b15e81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:44.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.726+0000 7f8b15e81640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 msgr2=0x7f8af4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.726+0000 7f8b15680640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.726+0000 7f8b15680640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:44.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:44.726+0000 7f8b15e81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:45.527+0000 7f8b15e81640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 msgr2=0x7f8af4005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:45.527+0000 7f8b15680640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:45.527+0000 7f8b15680640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:45.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:45.527+0000 7f8b15e81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:47.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 msgr2=0x7f8af4005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af40036a0 0x7f8af4005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b16682640 1 -- reap_dead start 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10159e20 con 0x7f8af4003ad0 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10159ba0 con 0x7f8b1015d600 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b077fe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8af4006110 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b16682640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af400c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:47.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b15e81640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b15680640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8af400af70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:47.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.124+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:47.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.325+0000 7f8b16682640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af400c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.325+0000 7f8b15680640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8af400af70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.325+0000 7f8b15e81640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:47.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.325+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.726+0000 7f8b16682640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af400c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.726+0000 7f8b15e81640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.726+0000 7f8b15680640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8af400af70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:47.726+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:48.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:48.527+0000 7f8b16682640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af400c690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.96:6789/0 2023-12-01T23:17:48.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:48.528+0000 7f8b15e81640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3301/0 2023-12-01T23:17:48.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:48.528+0000 7f8b15680640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8af400af70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.102:6789/0 2023-12-01T23:17:48.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:48.528+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:48.637 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:00:07.543 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:48.951 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:00:07.857 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:49.042 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:00:07.894 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:49.048 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:00:07.899 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:49.368 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:00:08.219 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:49.374 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:00:08.226 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:17:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 -- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af4006110 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 -- >> v1:172.21.15.102:6789/0 conn(0x7f8b1015d600 legacy=0x7f8af400af70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:50.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 -- >> v1:172.21.15.96:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af400c690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8af400eeb0 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b077fe640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af4008ca0 con 0x7f8af400f9b0 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b15680640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:50.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.125+0000 7f8b15680640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.326+0000 7f8b15680640 1 -- >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.102:3300/0 2023-12-01T23:17:50.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.326+0000 7f8b15680640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:50.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.367+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:50.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.387+0000 7f8b15e81640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35846/0 (socket says 172.21.15.96:35846) 2023-12-01T23:17:50.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.387+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 learned_addr learned my addr 172.21.15.96:0/3662151496 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:17:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.517+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.517+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.517+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:50.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.517+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:50.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.719+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:50.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.720+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:50.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.720+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:50.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.720+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:50.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.720+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:50.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.883+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.991+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.991+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:50.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.991+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:50.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:50.991+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:51.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.121+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.122+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.122+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.122+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:51.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.122+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:51.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.834+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:51.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.939+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:51.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.940+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T23:17:51.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.940+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:51.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.940+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:51.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.940+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.950+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.950+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.950+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:51.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:51.950+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 msgr2=0x7f8af400de40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af400f9b0 0x7f8af400de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 msgr2=0x7f8af400f2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400eeb0 0x7f8af400f2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 reap_dead start 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8af400dee0 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af4008ca0 con 0x7f8af4003ad0 2023-12-01T23:17:53.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.125+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af400b110 con 0x7f8af400e490 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.126+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.126+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:53.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T23:17:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.127+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:53.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.168+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.172+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.172+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.172+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.172+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:53.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.328+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.328+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:53.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.329+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:53.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.374+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.374+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.374+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.374+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.374+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T23:17:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.730+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.730+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.731+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T23:17:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.731+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.731+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.731+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:53.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.732+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.732+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.732+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.732+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:53.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.776+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.777+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:53.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.777+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:53.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.777+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:53.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:53.777+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T23:17:54.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.533+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:54.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.533+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:54.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b15680640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:54.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:54.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.534+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:54.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.578+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:54.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.580+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-01T23:17:54.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.580+0000 7f8b15e81640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:54.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.580+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:54.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:54.580+0000 7f8b15e81640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T23:17:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 msgr2=0x7f8af400e940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400e490 0x7f8af400e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.102:3300/0 conn(0x7f8af4003ad0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 msgr2=0x7f8af40085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> v2:172.21.15.96:3300/0 conn(0x7f8af400dee0 0x7f8af40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1015a3e0 con 0x7f8af400b3f0 2023-12-01T23:17:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:56.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10159e20 con 0x7f8af400d8b0 2023-12-01T23:17:59.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v1:172.21.15.102:6789/0 conn(0x7f8af400d8b0 legacy=0x7f8af40136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 >> v1:172.21.15.96:6789/0 conn(0x7f8af400b3f0 legacy=0x7f8af400ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 reap_dead start 2023-12-01T23:17:59.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8af400f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b10159ba0 con 0x7f8af4015e10 2023-12-01T23:17:59.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af40169d0 con 0x7f8af4003ad0 2023-12-01T23:17:59.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.126+0000 7f8b077fe640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8af400d8b0 2023-12-01T23:17:59.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.127+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8af400f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:59.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.128+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-01T23:17:59.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.128+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-01T23:17:59.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.128+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8af400f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T23:17:59.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.128+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T23:17:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.175+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941125865 0 0) 0x7f8af40169d0 con 0x7f8af4003ad0 2023-12-01T23:17:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.175+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8afc003520 con 0x7f8af4003ad0 2023-12-01T23:17:59.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.246+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687834720 0 0) 0x7f8b10159ba0 con 0x7f8af4015e10 2023-12-01T23:17:59.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.246+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af40169d0 con 0x7f8af4015e10 2023-12-01T23:17:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2630965970 0 0) 0x7f8af40169d0 con 0x7f8af4015e10 2023-12-01T23:17:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 msgr2=0x7f8af400f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T23:17:59.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8af400f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 >> v1:172.21.15.102:6789/0 conn(0x7f8af4003ad0 legacy=0x7f8af4008f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4016bb0 con 0x7f8af4015e10 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f8b00015470 con 0x7f8af4015e10 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 >> v1:172.21.15.96:6789/0 conn(0x7f8af4015e10 legacy=0x7f8af40161f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8afc003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8afc004090 0x7f8afc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8afc004d00 0x7f8afc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015da90 con 0x7f8afc004090 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc00bb90 con 0x7f8afc004d00 2023-12-01T23:17:59.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.294+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc00bd50 con 0x7f8af400d8b0 2023-12-01T23:17:59.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.321+0000 7f8b15680640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8afc004090 0x7f8afc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:59.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.330+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8afc004d00 0x7f8afc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:59.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.333+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 msgr2=0x7f8afc003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:17:59.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.333+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af400d8b0 0x7f8afc003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.333+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8afc004090 msgr2=0x7f8afc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:17:59.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.333+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8afc004090 0x7f8afc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.333+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af40169d0 con 0x7f8afc004d00 2023-12-01T23:17:59.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.336+0000 7f8b16682640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8afc004d00 0x7f8afc005180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b100ccf40 tx=0x7f8afc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4fe75f9282743a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:17:59.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.407+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800c040 con 0x7f8afc004d00 2023-12-01T23:17:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0800d040 con 0x7f8afc004d00 2023-12-01T23:17:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b14e7f640 1 -- 172.21.15.96:0/3662151496 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08035630 con 0x7f8afc004d00 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 -- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8afc004d00 msgr2=0x7f8afc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 --2- 172.21.15.96:0/3662151496 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8afc004d00 0x7f8afc005180 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8b100ccf40 tx=0x7f8afc0057f0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b16682640 1 -- 172.21.15.96:0/3662151496 reap_dead start 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 -- 172.21.15.96:0/3662151496 shutdown_connections 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 -- 172.21.15.96:0/3662151496 >> 172.21.15.96:0/3662151496 conn(0x7f8b100cbef0 msgr2=0x7f8b100cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 -- 172.21.15.96:0/3662151496 shutdown_connections 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.408+0000 7f8b180e5640 1 -- 172.21.15.96:0/3662151496 wait complete. 2023-12-01T23:17:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 Processor -- start 2023-12-01T23:17:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 -- start start 2023-12-01T23:17:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 0x7f8b100c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 0x7f8b101efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b1006b830 0x7f8b101f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:17:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b101ef760 con 0x7f8b1014bc60 2023-12-01T23:17:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10154e00 con 0x7f8b1014c040 2023-12-01T23:17:59.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.410+0000 7f8b180e5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10154280 con 0x7f8b1006b830 2023-12-01T23:17:59.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.412+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 0x7f8b100c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.413+0000 7f8b15680640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 0x7f8b101efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:17:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.413+0000 7f8b15e81640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 0x7f8b100c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47200/0 (socket says 172.21.15.96:47200) 2023-12-01T23:17:59.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.413+0000 7f8b15e81640 1 -- 172.21.15.96:0/3282366489 learned_addr learned my addr 172.21.15.96:0/3282366489 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:17:59.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.444+0000 7f8b15680640 1 -- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b1006b830 msgr2=0x7f8b101f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.444+0000 7f8b15680640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b1006b830 0x7f8b101f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.444+0000 7f8b15680640 1 -- 172.21.15.96:0/3282366489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 msgr2=0x7f8b100c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.444+0000 7f8b15680640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 0x7f8b100c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.444+0000 7f8b15680640 1 -- 172.21.15.96:0/3282366489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10154560 con 0x7f8b1014c040 2023-12-01T23:17:59.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.446+0000 7f8b15680640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 0x7f8b101efbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8af400f980 tx=0x7f8b0c009f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:17:59.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.456+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c00ae20 con 0x7f8b1014c040 2023-12-01T23:17:59.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.456+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c011040 con 0x7f8b1014c040 2023-12-01T23:17:59.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.456+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c01f620 con 0x7f8b1014c040 2023-12-01T23:17:59.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.456+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b10154840 con 0x7f8b1014c040 2023-12-01T23:17:59.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.457+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b10153db0 con 0x7f8b1014c040 2023-12-01T23:17:59.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.457+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b101ef8d0 con 0x7f8b1014c040 2023-12-01T23:17:59.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.673+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8b0c005bd0 con 0x7f8b1014c040 2023-12-01T23:17:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.683+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8b0c0060d0 con 0x7f8b1014c040 2023-12-01T23:17:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.683+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8b0c024060 con 0x7f8b1014c040 2023-12-01T23:17:59.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.749+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8b101ef550 con 0x7f8b1014c040 2023-12-01T23:17:59.914 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:17:59.913+0000 7ffbc5a32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T23:17:59.968 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:17:59.967+0000 7ffbc5a32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T23:17:59.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.992+0000 7f8b067fc640 1 -- 172.21.15.96:0/3282366489 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8b0c01f780 con 0x7f8b1014c040 2023-12-01T23:17:59.993 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2023-12-01T23:17:59.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 msgr2=0x7f8b101efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:17:59.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 0x7f8b101efbf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8af400f980 tx=0x7f8b0c009f40 comp rx=0 tx=0).stop 2023-12-01T23:17:59.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 shutdown_connections 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b1006b830 0x7f8b101f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b1014c040 0x7f8b101efbf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 --2- 172.21.15.96:0/3282366489 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b1014bc60 0x7f8b100c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 >> 172.21.15.96:0/3282366489 conn(0x7f8b100cbef0 msgr2=0x7f8b1014ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 shutdown_connections 2023-12-01T23:17:59.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:17:59.993+0000 7f8b180e5640 1 -- 172.21.15.96:0/3282366489 wait complete. 2023-12-01T23:18:00.005 INFO:tasks.ceph:check_enable_crimson: False 2023-12-01T23:18:00.005 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-01T23:18:00.005 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:00.005 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-01T23:18:00.034 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:00.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-01T23:18:00.042 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.040+0000 7fcaaee2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T23:18:00.101 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.099+0000 7fcaaee2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T23:18:00.101 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:00.102 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-01T23:18:00.168 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:00.168 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-01T23:18:00.237 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:18:00.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-01T23:18:00.265 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:18:00.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-01T23:18:00.331 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:18:00.331 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-01T23:18:00.398 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2023-12-01T23:18:00.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-01T23:18:00.470 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 275b2c35-691f-4d44-9283-4e3c0fdd037d 0 2023-12-01T23:18:00.523 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.523+0000 7ffbc5a32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T23:18:00.575 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.574+0000 7ffbc5a32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T23:18:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.609+0000 7f83fb7a9640 1 Processor -- start 2023-12-01T23:18:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.609+0000 7f83fb7a9640 1 -- start start 2023-12-01T23:18:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.610+0000 7f83fb7a9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 0x7f83f40c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.610+0000 7f83fb7a9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83f40c2bf0 0x7f83f40c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.610+0000 7f83fb7a9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40c0ea0 con 0x7f83f406eef0 2023-12-01T23:18:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.610+0000 7f83fb7a9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40c8500 con 0x7f83f4150470 2023-12-01T23:18:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.610+0000 7f83fb7a9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40c7f30 con 0x7f83f40c2bf0 2023-12-01T23:18:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.611+0000 7f83f9d46640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83f40c2bf0 0x7f83f40c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.611+0000 7f83f9545640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 0x7f83f40c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.611+0000 7f83f9545640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 0x7f83f40c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.102:49468/0 (socket says 172.21.15.102:49468) 2023-12-01T23:18:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.611+0000 7f83f9545640 1 -- 172.21.15.102:0/3235964649 learned_addr learned my addr 172.21.15.102:0/3235964649 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:00.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.614+0000 7f83f9d46640 1 -- 172.21.15.102:0/3235964649 >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 msgr2=0x7f83f40c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:00.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.614+0000 7f83f9d46640 1 --2- 172.21.15.102:0/3235964649 >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 0x7f83f40c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.614+0000 7f83f9d46640 1 -- 172.21.15.102:0/3235964649 >> v1:172.21.15.102:6789/0 conn(0x7f83f406eef0 legacy=0x7f83f406e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:00.615 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.614+0000 7f83f9d46640 1 -- 172.21.15.102:0/3235964649 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40c16b0 con 0x7f83f40c2bf0 2023-12-01T23:18:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.619+0000 7f83f9d46640 1 --2- 172.21.15.102:0/3235964649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40c2bf0 0x7f83f40c7070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83f40c8920 tx=0x7f83ec02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f6d752138ae590 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:00.621 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.620+0000 7ffbc5a32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T23:18:00.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.623+0000 7f83ebfff640 1 -- 172.21.15.102:0/3235964649 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec02cc80 con 0x7f83f40c2bf0 2023-12-01T23:18:00.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.623+0000 7f83ebfff640 1 -- 172.21.15.102:0/3235964649 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec02cde0 con 0x7f83f40c2bf0 2023-12-01T23:18:00.624 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.623+0000 7f83ebfff640 1 -- 172.21.15.102:0/3235964649 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec034660 con 0x7f83f40c2bf0 2023-12-01T23:18:00.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3235964649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40c2bf0 msgr2=0x7f83f40c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:00.625 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3235964649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40c2bf0 0x7f83f40c7070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f83f40c8920 tx=0x7f83ec02bed0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3235964649 shutdown_connections 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3235964649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40c2bf0 0x7f83f40c7070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3235964649 >> v2:172.21.15.96:3300/0 conn(0x7f83f4150470 0x7f83f40c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3235964649 >> 172.21.15.102:0/3235964649 conn(0x7f83f4072930 msgr2=0x7f83f40cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3235964649 shutdown_connections 2023-12-01T23:18:00.626 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.624+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3235964649 wait complete. 2023-12-01T23:18:00.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.626+0000 7f83fb7a9640 1 Processor -- start 2023-12-01T23:18:00.627 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.626+0000 7f83fb7a9640 1 -- start start 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f406eef0 0x7f83f40c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f40c2bf0 0x7f83f4143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41537e0 con 0x7f83f406eef0 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41429d0 con 0x7f83f4150470 2023-12-01T23:18:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.627+0000 7f83fb7a9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40c4910 con 0x7f83f40c2bf0 2023-12-01T23:18:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.628+0000 7f83f9d46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.628+0000 7f83f9545640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f406eef0 0x7f83f40c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.628+0000 7f83f8d44640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f40c2bf0 0x7f83f4143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.628+0000 7f83f9d46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38358/0 (socket says 172.21.15.102:38358) 2023-12-01T23:18:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.628+0000 7f83f9d46640 1 -- 172.21.15.102:0/3620122015 learned_addr learned my addr 172.21.15.102:0/3620122015 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.632+0000 7f83f9d46640 1 -- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f40c2bf0 msgr2=0x7f83f4143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.632+0000 7f83f9d46640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f40c2bf0 0x7f83f4143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.632+0000 7f83f9d46640 1 -- 172.21.15.102:0/3620122015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f406eef0 msgr2=0x7f83f40c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.632+0000 7f83f9d46640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f406eef0 0x7f83f40c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.632+0000 7f83f9d46640 1 -- 172.21.15.102:0/3620122015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009a70 con 0x7f83f4150470 2023-12-01T23:18:00.634 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.634+0000 7f83f9d46640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83ec02c4e0 tx=0x7f83ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.637+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec040070 con 0x7f83f4150470 2023-12-01T23:18:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.637+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec035dd0 con 0x7f83f4150470 2023-12-01T23:18:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.637+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec046420 con 0x7f83f4150470 2023-12-01T23:18:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.637+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4152e40 con 0x7f83f4150470 2023-12-01T23:18:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.637+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f4153400 con 0x7f83f4150470 2023-12-01T23:18:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.638+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f4153920 con 0x7f83f4150470 2023-12-01T23:18:00.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.641+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83ec044070 con 0x7f83f4150470 2023-12-01T23:18:00.642 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.642+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83ec0508e0 con 0x7f83f4150470 2023-12-01T23:18:00.649 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.648+0000 7fcaaee2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T23:18:00.677 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.677+0000 7ffbc5a32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T23:18:00.703 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.702+0000 7fcaaee2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T23:18:00.719 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.718+0000 7ffbc5a32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T23:18:00.749 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.748+0000 7fcaaee2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T23:18:00.758 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.757+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f83f4153920 con 0x7f83f4150470 2023-12-01T23:18:00.805 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.804+0000 7fcaaee2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T23:18:00.818 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.817+0000 7ffbc5a32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T23:18:00.830 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.829+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "275b2c35-691f-4d44-9283-4e3c0fdd037d", "id": 0} v 0) v1 -- 0x7f83f40740e0 con 0x7f83f4150470 2023-12-01T23:18:00.849 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.848+0000 7fcaaee2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T23:18:00.889 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.888+0000 7ffbc5a32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T23:18:00.938 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.937+0000 7ffbc5a32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T23:18:00.951 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:00.949+0000 7fcaaee2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T23:18:00.987 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.986+0000 7f83e9ffb640 1 -- 172.21.15.102:0/3620122015 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "275b2c35-691f-4d44-9283-4e3c0fdd037d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83ec04b070 con 0x7f83f4150470 2023-12-01T23:18:00.988 INFO:teuthology.orchestra.run.smithi102.stdout:0 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 msgr2=0x7f83f41ec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83ec02c4e0 tx=0x7f83ec004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 shutdown_connections 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4150470 0x7f83f41ec050 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f40c2bf0 0x7f83f4143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 --2- 172.21.15.102:0/3620122015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f406eef0 0x7f83f40c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 >> 172.21.15.102:0/3620122015 conn(0x7f83f4072930 msgr2=0x7f83f4156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.987+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 shutdown_connections 2023-12-01T23:18:00.989 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:00.988+0000 7f83fb7a9640 1 -- 172.21.15.102:0/3620122015 wait complete. 2023-12-01T23:18:00.993 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:00.992+0000 7ffbc5a32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T23:18:00.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 6ac67309-748d-4b73-afb8-3b3ca05690a3 1 2023-12-01T23:18:01.025 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.024+0000 7fcaaee2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T23:18:01.040 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.039+0000 7ffbc5a32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T23:18:01.074 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.073+0000 7fcaaee2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T23:18:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.098+0000 7f7bcbbce640 1 Processor -- start 2023-12-01T23:18:01.099 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.098+0000 7f7bcbbce640 1 -- start start 2023-12-01T23:18:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.099+0000 7f7bcbbce640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7bc40cd230 0x7f7bc40c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.099+0000 7f7bcbbce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 0x7f7bc406f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.099+0000 7f7bcbbce640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc415a0d0 con 0x7f7bc40cd610 2023-12-01T23:18:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.099+0000 7f7bcbbce640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c8db0 con 0x7f7bc40cd230 2023-12-01T23:18:01.100 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.099+0000 7f7bcbbce640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc406d180 con 0x7f7bc406c270 2023-12-01T23:18:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.100+0000 7f7bca16b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 0x7f7bc406f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.100+0000 7f7bc996a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7bc40cd230 0x7f7bc40c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.101 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.100+0000 7f7bc9169640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f7bc40cd610 0x7f7bc406bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.102:41724/0 (socket says 172.21.15.102:41724) 2023-12-01T23:18:01.102 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.100+0000 7f7bc9169640 1 -- 172.21.15.102:0/1187959419 learned_addr learned my addr 172.21.15.102:0/1187959419 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-12-01T23:18:01.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.103+0000 7f7bca16b640 1 -- 172.21.15.102:0/1187959419 >> v2:172.21.15.96:3300/0 conn(0x7f7bc40cd230 msgr2=0x7f7bc40c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:01.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.103+0000 7f7bca16b640 1 --2- 172.21.15.102:0/1187959419 >> v2:172.21.15.96:3300/0 conn(0x7f7bc40cd230 0x7f7bc40c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.103+0000 7f7bca16b640 1 -- 172.21.15.102:0/1187959419 >> v1:172.21.15.96:6789/0 conn(0x7f7bc40cd610 legacy=0x7f7bc406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.104 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.103+0000 7f7bca16b640 1 -- 172.21.15.102:0/1187959419 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc406fa20 con 0x7f7bc406c270 2023-12-01T23:18:01.105 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.105+0000 7f7bca16b640 1 --2- 172.21.15.102:0/1187959419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 0x7f7bc406f4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009d90 tx=0x7f7bbc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=377cb2e95999f036 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:01.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bc8968640 1 -- 172.21.15.102:0/1187959419 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc02cce0 con 0x7f7bc406c270 2023-12-01T23:18:01.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bc8968640 1 -- 172.21.15.102:0/1187959419 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc02ce40 con 0x7f7bc406c270 2023-12-01T23:18:01.112 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bc8968640 1 -- 172.21.15.102:0/1187959419 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc034660 con 0x7f7bc406c270 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 -- 172.21.15.102:0/1187959419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 msgr2=0x7f7bc406f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/1187959419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 0x7f7bc406f4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009d90 tx=0x7f7bbc02bf30 comp rx=0 tx=0).stop 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 -- 172.21.15.102:0/1187959419 shutdown_connections 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/1187959419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc406c270 0x7f7bc406f4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/1187959419 >> v2:172.21.15.96:3300/0 conn(0x7f7bc40cd230 0x7f7bc40c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.111+0000 7f7bcbbce640 1 -- 172.21.15.102:0/1187959419 >> 172.21.15.102:0/1187959419 conn(0x7f7bc4061100 msgr2=0x7f7bc40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:01.113 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.112+0000 7f7bcbbce640 1 -- 172.21.15.102:0/1187959419 shutdown_connections 2023-12-01T23:18:01.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.112+0000 7f7bcbbce640 1 -- 172.21.15.102:0/1187959419 wait complete. 2023-12-01T23:18:01.114 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 Processor -- start 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 -- start start 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc40cd230 0x7f7bc415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 0x7f7bc415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41eeb10 con 0x7f7bc40cd610 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41eed90 con 0x7f7bc406c270 2023-12-01T23:18:01.115 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.113+0000 7f7bcbbce640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41ef070 con 0x7f7bc40cd230 2023-12-01T23:18:01.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.114+0000 7f7bca16b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 0x7f7bc415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.114+0000 7f7bc996a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.115+0000 7f7bc996a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38364/0 (socket says 172.21.15.102:38364) 2023-12-01T23:18:01.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.115+0000 7f7bc996a640 1 -- 172.21.15.102:0/2655279641 learned_addr learned my addr 172.21.15.102:0/2655279641 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:01.116 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.115+0000 7f7bca16b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 0x7f7bc415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.102:49494/0 (socket says 172.21.15.102:49494) 2023-12-01T23:18:01.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.118+0000 7f7bc996a640 1 -- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc40cd230 msgr2=0x7f7bc415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.118+0000 7f7bc996a640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc40cd230 0x7f7bc415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.118+0000 7f7bc996a640 1 -- 172.21.15.102:0/2655279641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 msgr2=0x7f7bc415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.118+0000 7f7bc996a640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 0x7f7bc415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.119 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.118+0000 7f7bc996a640 1 -- 172.21.15.102:0/2655279641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc009a70 con 0x7f7bc406c270 2023-12-01T23:18:01.122 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.121+0000 7f7bc996a640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400e9b0 tx=0x7f7bb400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.125+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4009670 con 0x7f7bc406c270 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.125+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400c9a0 con 0x7f7bc406c270 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.125+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc41ef350 con 0x7f7bc406c270 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.125+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400cd50 con 0x7f7bc406c270 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.125+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc41ef910 con 0x7f7bc406c270 2023-12-01T23:18:01.128 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.126+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40740e0 con 0x7f7bc406c270 2023-12-01T23:18:01.133 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.132+0000 7fcaaee2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T23:18:01.182 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.181+0000 7fcaaee2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T23:18:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.227+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7bb4005c90 con 0x7f7bc406c270 2023-12-01T23:18:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.227+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7bb4013820 con 0x7f7bc406c270 2023-12-01T23:18:01.228 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.227+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7bb4021060 con 0x7f7bc406c270 2023-12-01T23:18:01.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.305+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6ac67309-748d-4b73-afb8-3b3ca05690a3", "id": 1} v 0) v1 -- 0x7f7bc40caec0 con 0x7f7bc406c270 2023-12-01T23:18:01.417 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.416+0000 7f7bba7fc640 1 -- 172.21.15.102:0/2655279641 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ac67309-748d-4b73-afb8-3b3ca05690a3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7bb4017070 con 0x7f7bc406c270 2023-12-01T23:18:01.417 INFO:teuthology.orchestra.run.smithi102.stdout:1 2023-12-01T23:18:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 msgr2=0x7f7bc415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400e9b0 tx=0x7f7bb400ee70 comp rx=0 tx=0).stop 2023-12-01T23:18:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 shutdown_connections 2023-12-01T23:18:01.418 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7bc40cd610 0x7f7bc415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bc40cd230 0x7f7bc415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 --2- 172.21.15.102:0/2655279641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bc406c270 0x7f7bc415aa80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 >> 172.21.15.102:0/2655279641 conn(0x7f7bc4061100 msgr2=0x7f7bc40c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 shutdown_connections 2023-12-01T23:18:01.419 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.417+0000 7f7bcbbce640 1 -- 172.21.15.102:0/2655279641 wait complete. 2023-12-01T23:18:01.428 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 2363cd32-cd62-427a-8bb9-682c6387c607 2 2023-12-01T23:18:01.443 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.442+0000 7ffbc5a32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T23:18:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.567+0000 7f5ea42d3640 1 Processor -- start 2023-12-01T23:18:01.568 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.567+0000 7f5ea42d3640 1 -- start start 2023-12-01T23:18:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.568+0000 7f5ea42d3640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 0x7f5e9c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.568+0000 7f5ea42d3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 0x7f5e9c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.568+0000 7f5ea42d3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c0c5f60 con 0x7f5e9c0c7190 2023-12-01T23:18:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.568+0000 7f5ea42d3640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c2c60 con 0x7f5e9c1504e0 2023-12-01T23:18:01.569 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.568+0000 7f5ea42d3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c2f20 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.569+0000 7f5ea2870640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 0x7f5e9c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.569+0000 7f5ea206f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 0x7f5e9c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.569+0000 7f5ea206f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 0x7f5e9c06e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38374/0 (socket says 172.21.15.102:38374) 2023-12-01T23:18:01.570 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.569+0000 7f5ea206f640 1 -- 172.21.15.102:0/2846017172 learned_addr learned my addr 172.21.15.102:0/2846017172 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.571+0000 7f5ea2870640 1 -- 172.21.15.102:0/2846017172 >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 msgr2=0x7f5e9c06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.571+0000 7f5ea2870640 1 --2- 172.21.15.102:0/2846017172 >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 0x7f5e9c06e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.571+0000 7f5ea2870640 1 -- 172.21.15.102:0/2846017172 >> v1:172.21.15.102:6789/0 conn(0x7f5e9c0c7190 legacy=0x7f5e9c0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:01.572 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.571+0000 7f5ea2870640 1 -- 172.21.15.102:0/2846017172 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0c61b0 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.574 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.573+0000 7f5ea2870640 1 --2- 172.21.15.102:0/2846017172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 0x7f5e9c06e6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400bfa0 tx=0x7f5e9402df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babecb101d12f104 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:01.574 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.574+0000 7ffbc5a32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T23:18:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea106d640 1 -- 172.21.15.102:0/2846017172 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9402e920 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea106d640 1 -- 172.21.15.102:0/2846017172 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9402ea80 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.578 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea106d640 1 -- 172.21.15.102:0/2846017172 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9402ee10 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 -- 172.21.15.102:0/2846017172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 msgr2=0x7f5e9c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/2846017172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 0x7f5e9c06e6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400bfa0 tx=0x7f5e9402df80 comp rx=0 tx=0).stop 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 -- 172.21.15.102:0/2846017172 shutdown_connections 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/2846017172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c0c83f0 0x7f5e9c06e6e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/2846017172 >> v2:172.21.15.102:3300/0 conn(0x7f5e9c1504e0 0x7f5e9c06e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 -- 172.21.15.102:0/2846017172 >> 172.21.15.102:0/2846017172 conn(0x7f5e9c0cbef0 msgr2=0x7f5e9c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.577+0000 7f5ea42d3640 1 -- 172.21.15.102:0/2846017172 shutdown_connections 2023-12-01T23:18:01.579 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.578+0000 7f5ea42d3640 1 -- 172.21.15.102:0/2846017172 wait complete. 2023-12-01T23:18:01.579 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.579+0000 7fcaaee2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T23:18:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 Processor -- start 2023-12-01T23:18:01.580 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 -- start start 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 0x7f5e9c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e9c0c83f0 0x7f5e9c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 0x7f5e9c0cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.579+0000 7f5ea42d3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c154700 con 0x7f5e9c0c83f0 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea42d3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c4b80 con 0x7f5e9c0c7190 2023-12-01T23:18:01.582 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea42d3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c4e60 con 0x7f5e9c1504e0 2023-12-01T23:18:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea206f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 0x7f5e9c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea2870640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 0x7f5e9c0cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea186e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e9c0c83f0 0x7f5e9c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea206f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 0x7f5e9c0c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38390/0 (socket says 172.21.15.102:38390) 2023-12-01T23:18:01.583 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.580+0000 7f5ea206f640 1 -- 172.21.15.102:0/1341455262 learned_addr learned my addr 172.21.15.102:0/1341455262 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.584+0000 7f5ea2870640 1 -- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 msgr2=0x7f5e9c0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.584+0000 7f5ea2870640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 0x7f5e9c0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.584+0000 7f5ea2870640 1 -- 172.21.15.102:0/1341455262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e9c0c83f0 msgr2=0x7f5e9c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.584+0000 7f5ea2870640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e9c0c83f0 0x7f5e9c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.585 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.584+0000 7f5ea2870640 1 -- 172.21.15.102:0/1341455262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9400bc80 con 0x7f5e9c1504e0 2023-12-01T23:18:01.586 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.586+0000 7f5ea2870640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 0x7f5e9c0cb0a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e94034000 tx=0x7f5e94004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.589+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400b660 con 0x7f5e9c1504e0 2023-12-01T23:18:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.589+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94040450 con 0x7f5e9c1504e0 2023-12-01T23:18:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.589+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c0c5140 con 0x7f5e9c1504e0 2023-12-01T23:18:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.590+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94040800 con 0x7f5e9c1504e0 2023-12-01T23:18:01.591 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.590+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c0ca8a0 con 0x7f5e9c1504e0 2023-12-01T23:18:01.592 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.591+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c067710 con 0x7f5e9c1504e0 2023-12-01T23:18:01.597 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.597+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e94040c60 con 0x7f5e9c1504e0 2023-12-01T23:18:01.598 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.597+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5e94053c30 con 0x7f5e9c1504e0 2023-12-01T23:18:01.699 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.698+0000 7ffbc5a32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T23:18:01.719 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.718+0000 7fcaaee2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T23:18:01.743 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.742+0000 7ffbc5a32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T23:18:01.768 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.767+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5e94045020 con 0x7f5e9c1504e0 2023-12-01T23:18:01.835 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.834+0000 7fcaaee2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T23:18:01.838 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.838+0000 7ffbc5a32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T23:18:01.839 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.838+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2363cd32-cd62-427a-8bb9-682c6387c607", "id": 2} v 0) v1 -- 0x7f5e9c0c2210 con 0x7f5e9c1504e0 2023-12-01T23:18:01.882 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.881+0000 7fcaaee2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T23:18:01.936 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:01.936+0000 7ffbc5a32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T23:18:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.943+0000 7f5e8effd640 1 -- 172.21.15.102:0/1341455262 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2363cd32-cd62-427a-8bb9-682c6387c607", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e9c0c2210 con 0x7f5e9c1504e0 2023-12-01T23:18:01.944 INFO:teuthology.orchestra.run.smithi102.stdout:2 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 msgr2=0x7f5e9c0cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 0x7f5e9c0cb0a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e94034000 tx=0x7f5e94004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 shutdown_connections 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e9c1504e0 0x7f5e9c0cb0a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e9c0c83f0 0x7f5e9c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 --2- 172.21.15.102:0/1341455262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e9c0c7190 0x7f5e9c0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 >> 172.21.15.102:0/1341455262 conn(0x7f5e9c0cbef0 msgr2=0x7f5e9c14eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 shutdown_connections 2023-12-01T23:18:01.946 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:01.944+0000 7f5ea42d3640 1 -- 172.21.15.102:0/1341455262 wait complete. 2023-12-01T23:18:01.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 63fdf9ef-afed-4359-bea1-95ef96c3a1ba 3 2023-12-01T23:18:01.990 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:01.989+0000 7fcaaee2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T23:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.058+0000 7f730cdec640 1 Processor -- start 2023-12-01T23:18:02.059 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.058+0000 7f730cdec640 1 -- start start 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.059+0000 7f730cdec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f73080b1d90 0x7f730806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.059+0000 7f730cdec640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730806b480 con 0x7f73080c94a0 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.059+0000 7f730cdec640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730806e0c0 con 0x7f7308151760 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.059+0000 7f730cdec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c3990 con 0x7f73080b1d90 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.060+0000 7f7305d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f73080b1d90 0x7f730806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.060 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.060+0000 7f7306d9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f73080c94a0 0x7f7308161e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.102:41730/0 (socket says 172.21.15.102:41730) 2023-12-01T23:18:02.061 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.060+0000 7f7306d9d640 1 -- 172.21.15.102:0/3790481340 learned_addr learned my addr 172.21.15.102:0/3790481340 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-12-01T23:18:02.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.062+0000 7f730559a640 1 -- 172.21.15.102:0/3790481340 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403042199 0 0) 0x7f730806b480 con 0x7f73080c94a0 2023-12-01T23:18:02.063 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.063+0000 7f730559a640 1 -- 172.21.15.102:0/3790481340 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f0003520 con 0x7f73080c94a0 2023-12-01T23:18:02.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.063+0000 7f7305d9b640 1 -- 172.21.15.102:0/3790481340 >> v1:172.21.15.102:6789/0 conn(0x7f7308151760 legacy=0x7f730806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.063+0000 7f7305d9b640 1 -- 172.21.15.102:0/3790481340 >> v1:172.21.15.96:6789/0 conn(0x7f73080c94a0 legacy=0x7f7308161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.064 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.063+0000 7f7305d9b640 1 -- 172.21.15.102:0/3790481340 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730806ec60 con 0x7f73080b1d90 2023-12-01T23:18:02.067 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.066+0000 7f7305d9b640 1 --2- 172.21.15.102:0/3790481340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730806a500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72f80097a0 tx=0x7f72f802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6878230bacaab73a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.071+0000 7f730559a640 1 -- 172.21.15.102:0/3790481340 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8030610 con 0x7f73080b1d90 2023-12-01T23:18:02.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.071+0000 7f730559a640 1 -- 172.21.15.102:0/3790481340 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8030770 con 0x7f73080b1d90 2023-12-01T23:18:02.072 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.071+0000 7f730559a640 1 -- 172.21.15.102:0/3790481340 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8030b00 con 0x7f73080b1d90 2023-12-01T23:18:02.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 -- 172.21.15.102:0/3790481340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 msgr2=0x7f730806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 --2- 172.21.15.102:0/3790481340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730806a500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f72f80097a0 tx=0x7f72f802b960 comp rx=0 tx=0).stop 2023-12-01T23:18:02.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 -- 172.21.15.102:0/3790481340 shutdown_connections 2023-12-01T23:18:02.073 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 --2- 172.21.15.102:0/3790481340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730806a500 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 -- 172.21.15.102:0/3790481340 >> 172.21.15.102:0/3790481340 conn(0x7f73080c8980 msgr2=0x7f73080c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 -- 172.21.15.102:0/3790481340 shutdown_connections 2023-12-01T23:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.072+0000 7f730cdec640 1 -- 172.21.15.102:0/3790481340 wait complete. 2023-12-01T23:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.073+0000 7f730cdec640 1 Processor -- start 2023-12-01T23:18:02.074 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.073+0000 7f730cdec640 1 -- start start 2023-12-01T23:18:02.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730814caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.075 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7308151760 0x7f73081590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308157c40 con 0x7f73080c94a0 2023-12-01T23:18:02.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308158c40 con 0x7f73080b1d90 2023-12-01T23:18:02.076 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.074+0000 7f730cdec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730814f630 con 0x7f7308151760 2023-12-01T23:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.075+0000 7f7305d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.075+0000 7f7306d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7308151760 0x7f73081590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.076+0000 7f7305d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.102:49508/0 (socket says 172.21.15.102:49508) 2023-12-01T23:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.076+0000 7f7305d9b640 1 -- 172.21.15.102:0/966156169 learned_addr learned my addr 172.21.15.102:0/966156169 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:02.077 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.076+0000 7f730659c640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730814caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.081 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.080+0000 7f7305d9b640 1 -- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7308151760 msgr2=0x7f73081590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.080+0000 7f7305d9b640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7308151760 0x7f73081590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.080+0000 7f7305d9b640 1 -- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 msgr2=0x7f730814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.080+0000 7f7305d9b640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730814caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.082 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.080+0000 7f7305d9b640 1 -- 172.21.15.102:0/966156169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009400 con 0x7f73080c94a0 2023-12-01T23:18:02.082 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:02.081+0000 7ffbc5a32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T23:18:02.085 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.084+0000 7f7305d9b640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f72f802bf70 tx=0x7f72f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.090+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f803e040 con 0x7f73080c94a0 2023-12-01T23:18:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.090+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8039a40 con 0x7f73080c94a0 2023-12-01T23:18:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.090+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730814e4b0 con 0x7f73080c94a0 2023-12-01T23:18:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.090+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8039df0 con 0x7f73080c94a0 2023-12-01T23:18:02.091 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.090+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730814ea70 con 0x7f73080c94a0 2023-12-01T23:18:02.092 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.091+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308074aa0 con 0x7f73080c94a0 2023-12-01T23:18:02.092 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:02.091+0000 7fcaaee2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T23:18:02.128 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:02.127+0000 7ffbc5a32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T23:18:02.208 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.207+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72f804e740 con 0x7f73080c94a0 2023-12-01T23:18:02.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.215+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f72f804d840 con 0x7f73080c94a0 2023-12-01T23:18:02.216 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.215+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f72f8049070 con 0x7f73080c94a0 2023-12-01T23:18:02.233 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:02.232+0000 7fcaaee2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T23:18:02.275 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:02.274+0000 7ffbc5a32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T23:18:02.276 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:02.275+0000 7fcaaee2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T23:18:02.289 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.287+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "63fdf9ef-afed-4359-bea1-95ef96c3a1ba", "id": 3} v 0) v1 -- 0x7f73080ca400 con 0x7f73080c94a0 2023-12-01T23:18:02.345 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.343+0000 7f72f6ffd640 1 -- 172.21.15.102:0/966156169 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "63fdf9ef-afed-4359-bea1-95ef96c3a1ba", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72f8034070 con 0x7f73080c94a0 2023-12-01T23:18:02.345 INFO:teuthology.orchestra.run.smithi102.stdout:3 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 msgr2=0x7f7308157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f72f802bf70 tx=0x7f72f8004730 comp rx=0 tx=0).stop 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 shutdown_connections 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7308151760 0x7f73081590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73080c94a0 0x7f7308157f00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 --2- 172.21.15.102:0/966156169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73080b1d90 0x7f730814caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 >> 172.21.15.102:0/966156169 conn(0x7f73080c8980 msgr2=0x7f73080ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 shutdown_connections 2023-12-01T23:18:02.346 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.344+0000 7f730cdec640 1 -- 172.21.15.102:0/966156169 wait complete. 2023-12-01T23:18:02.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 7f2dc942-202c-4386-99ab-e6a5bb9d1df1 4 2023-12-01T23:18:02.442 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:02.440+0000 7fcaaee2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.497+0000 7f2ab1397640 1 Processor -- start 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.497+0000 7f2ab1397640 1 -- start start 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2ab1397640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2ab1397640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2aac15a920 0x7f2aac0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2ab1397640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac0c63d0 con 0x7f2aac0c8090 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2ab1397640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0c3900 con 0x7f2aac15a920 2023-12-01T23:18:02.500 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2ab1397640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac151b40 con 0x7f2aac151760 2023-12-01T23:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.498+0000 7f2aab7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2aac15a920 0x7f2aac0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.499+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:36258/0 (socket says 172.21.15.102:36258) 2023-12-01T23:18:02.501 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.499+0000 7f2aaaffd640 1 -- 172.21.15.102:0/3896501176 learned_addr learned my addr 172.21.15.102:0/3896501176 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.501+0000 7f2aaaffd640 1 -- 172.21.15.102:0/3896501176 >> v2:172.21.15.96:3300/0 conn(0x7f2aac15a920 msgr2=0x7f2aac0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.501+0000 7f2aaaffd640 1 --2- 172.21.15.102:0/3896501176 >> v2:172.21.15.96:3300/0 conn(0x7f2aac15a920 0x7f2aac0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.501+0000 7f2aaaffd640 1 -- 172.21.15.102:0/3896501176 >> v1:172.21.15.96:6789/0 conn(0x7f2aac0c8090 legacy=0x7f2aac0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.502 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.501+0000 7f2aaaffd640 1 -- 172.21.15.102:0/3896501176 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0c7140 con 0x7f2aac151760 2023-12-01T23:18:02.503 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.502+0000 7f2aaaffd640 1 --2- 172.21.15.102:0/3896501176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009870 tx=0x7f2a9c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a152acebf06572f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.508 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.506+0000 7f2aaa7fc640 1 -- 172.21.15.102:0/3896501176 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c031640 con 0x7f2aac151760 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.506+0000 7f2aaa7fc640 1 -- 172.21.15.102:0/3896501176 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c0317a0 con 0x7f2aac151760 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.506+0000 7f2aaa7fc640 1 -- 172.21.15.102:0/3896501176 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c031b30 con 0x7f2aac151760 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 -- 172.21.15.102:0/3896501176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 msgr2=0x7f2aac06e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 --2- 172.21.15.102:0/3896501176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009870 tx=0x7f2a9c02b8f0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 -- 172.21.15.102:0/3896501176 shutdown_connections 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 --2- 172.21.15.102:0/3896501176 >> v2:172.21.15.96:3300/0 conn(0x7f2aac15a920 0x7f2aac0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 --2- 172.21.15.102:0/3896501176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac06e780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.509 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 -- 172.21.15.102:0/3896501176 >> 172.21.15.102:0/3896501176 conn(0x7f2aac072930 msgr2=0x7f2aac0cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:02.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 -- 172.21.15.102:0/3896501176 shutdown_connections 2023-12-01T23:18:02.510 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.507+0000 7f2ab1397640 1 -- 172.21.15.102:0/3896501176 wait complete. 2023-12-01T23:18:02.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.508+0000 7f2ab1397640 1 Processor -- start 2023-12-01T23:18:02.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.508+0000 7f2ab1397640 1 -- start start 2023-12-01T23:18:02.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.512 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aac15a920 0x7f2aac145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac14a8b0 con 0x7f2aac15a920 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac1457e0 con 0x7f2aac0c8090 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.509+0000 7f2ab1397640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac14d290 con 0x7f2aac151760 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aab7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aac15a920 0x7f2aac145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:36272/0 (socket says 172.21.15.102:36272) 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aaaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38422/0 (socket says 172.21.15.102:38422) 2023-12-01T23:18:02.513 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.510+0000 7f2aa3fff640 1 -- 172.21.15.102:0/2653363412 learned_addr learned my addr 172.21.15.102:0/2653363412 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:02.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.513+0000 7f2aaaffd640 1 -- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 msgr2=0x7f2aac148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.513+0000 7f2aaaffd640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.513+0000 7f2aaaffd640 1 -- 172.21.15.102:0/2653363412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aac15a920 msgr2=0x7f2aac145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.513+0000 7f2aaaffd640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aac15a920 0x7f2aac145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.514 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.513+0000 7f2aaaffd640 1 -- 172.21.15.102:0/2653363412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c0094d0 con 0x7f2aac0c8090 2023-12-01T23:18:02.516 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.516+0000 7f2aaaffd640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c033000 tx=0x7f2a9c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.519+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0307b0 con 0x7f2aac0c8090 2023-12-01T23:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.519+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c030930 con 0x7f2aac0c8090 2023-12-01T23:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.519+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c030ce0 con 0x7f2aac0c8090 2023-12-01T23:18:02.520 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.519+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac14dd40 con 0x7f2aac0c8090 2023-12-01T23:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.519+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac14a5d0 con 0x7f2aac0c8090 2023-12-01T23:18:02.521 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.520+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac0740e0 con 0x7f2aac0c8090 2023-12-01T23:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.523+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a9c02f050 con 0x7f2aac0c8090 2023-12-01T23:18:02.525 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.523+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2a9c030e40 con 0x7f2aac0c8090 2023-12-01T23:18:02.636 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.635+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2a9c04b070 con 0x7f2aac0c8090 2023-12-01T23:18:02.709 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.708+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f2dc942-202c-4386-99ab-e6a5bb9d1df1", "id": 4} v 0) v1 -- 0x7f2aac147270 con 0x7f2aac0c8090 2023-12-01T23:18:02.785 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.784+0000 7f2aa37fe640 1 -- 172.21.15.102:0/2653363412 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f2dc942-202c-4386-99ab-e6a5bb9d1df1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a9c035020 con 0x7f2aac0c8090 2023-12-01T23:18:02.785 INFO:teuthology.orchestra.run.smithi102.stdout:4 2023-12-01T23:18:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 msgr2=0x7f2aac148960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c033000 tx=0x7f2a9c004730 comp rx=0 tx=0).stop 2023-12-01T23:18:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 shutdown_connections 2023-12-01T23:18:02.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2aac15a920 0x7f2aac145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aac151760 0x7f2aac148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 --2- 172.21.15.102:0/2653363412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aac0c8090 0x7f2aac148960 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 >> 172.21.15.102:0/2653363412 conn(0x7f2aac072930 msgr2=0x7f2aac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:02.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 shutdown_connections 2023-12-01T23:18:02.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.785+0000 7f2ab1397640 1 -- 172.21.15.102:0/2653363412 wait complete. 2023-12-01T23:18:02.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new bfde523c-f5b8-45e6-b1c4-df8d336d6597 5 2023-12-01T23:18:02.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.900+0000 7f8e45aec640 1 Processor -- start 2023-12-01T23:18:02.901 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.900+0000 7f8e45aec640 1 -- start start 2023-12-01T23:18:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e45aec640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8e4006eef0 0x7f8e400c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e45aec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 0x7f8e400c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e45aec640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400c0ea0 con 0x7f8e40150470 2023-12-01T23:18:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e45aec640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e400c8500 con 0x7f8e4006eef0 2023-12-01T23:18:02.902 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e45aec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c7f30 con 0x7f8e400c2bf0 2023-12-01T23:18:02.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 0x7f8e400c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.903 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e3f7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8e40150470 0x7f8e4006e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:46380/0 (socket says 172.21.15.102:46380) 2023-12-01T23:18:02.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.901+0000 7f8e3f7fe640 1 -- 172.21.15.102:0/2730979461 learned_addr learned my addr 172.21.15.102:0/2730979461 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-12-01T23:18:02.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.902+0000 7f8e3effd640 1 --2- 172.21.15.102:0/2730979461 >> v2:172.21.15.96:3300/0 conn(0x7f8e4006eef0 0x7f8e400c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.904+0000 7f8e3ffff640 1 -- 172.21.15.102:0/2730979461 >> v2:172.21.15.96:3300/0 conn(0x7f8e4006eef0 msgr2=0x7f8e400c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:02.905 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.904+0000 7f8e3ffff640 1 --2- 172.21.15.102:0/2730979461 >> v2:172.21.15.96:3300/0 conn(0x7f8e4006eef0 0x7f8e400c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.904+0000 7f8e3ffff640 1 -- 172.21.15.102:0/2730979461 >> v1:172.21.15.102:6789/0 conn(0x7f8e40150470 legacy=0x7f8e4006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.906 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.904+0000 7f8e3ffff640 1 -- 172.21.15.102:0/2730979461 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400c16b0 con 0x7f8e400c2bf0 2023-12-01T23:18:02.907 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.906+0000 7f8e3ffff640 1 --2- 172.21.15.102:0/2730979461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 0x7f8e400c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009d90 tx=0x7f8e3802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c4973a0636b9ab server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e3e7fc640 1 -- 172.21.15.102:0/2730979461 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3802cc50 con 0x7f8e400c2bf0 2023-12-01T23:18:02.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e3e7fc640 1 -- 172.21.15.102:0/2730979461 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3802cdb0 con 0x7f8e400c2bf0 2023-12-01T23:18:02.911 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e3e7fc640 1 -- 172.21.15.102:0/2730979461 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38034660 con 0x7f8e400c2bf0 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 -- 172.21.15.102:0/2730979461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 msgr2=0x7f8e400c7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 --2- 172.21.15.102:0/2730979461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 0x7f8e400c7070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009d90 tx=0x7f8e3802bea0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 -- 172.21.15.102:0/2730979461 shutdown_connections 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 --2- 172.21.15.102:0/2730979461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e400c2bf0 0x7f8e400c7070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 --2- 172.21.15.102:0/2730979461 >> v2:172.21.15.96:3300/0 conn(0x7f8e4006eef0 0x7f8e400c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 -- 172.21.15.102:0/2730979461 >> 172.21.15.102:0/2730979461 conn(0x7f8e40072930 msgr2=0x7f8e400cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 -- 172.21.15.102:0/2730979461 shutdown_connections 2023-12-01T23:18:02.912 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.910+0000 7f8e45aec640 1 -- 172.21.15.102:0/2730979461 wait complete. 2023-12-01T23:18:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.911+0000 7f8e45aec640 1 Processor -- start 2023-12-01T23:18:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 -- start start 2023-12-01T23:18:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4006eef0 0x7f8e4014be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.913 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e40150470 0x7f8e4006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:02.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40157cd0 con 0x7f8e4006eef0 2023-12-01T23:18:02.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40151860 con 0x7f8e400c2bf0 2023-12-01T23:18:02.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.912+0000 7f8e45aec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40151580 con 0x7f8e40150470 2023-12-01T23:18:02.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.913+0000 7f8e3effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.914 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.913+0000 7f8e3f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4006eef0 0x7f8e4014be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.913+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e40150470 0x7f8e4006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:02.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.913+0000 7f8e3effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38424/0 (socket says 172.21.15.102:38424) 2023-12-01T23:18:02.915 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.913+0000 7f8e3effd640 1 -- 172.21.15.102:0/3252368059 learned_addr learned my addr 172.21.15.102:0/3252368059 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:02.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.916+0000 7f8e3effd640 1 -- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e40150470 msgr2=0x7f8e4006a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.916+0000 7f8e3effd640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e40150470 0x7f8e4006a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.917 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.916+0000 7f8e3effd640 1 -- 172.21.15.102:0/3252368059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4006eef0 msgr2=0x7f8e4014be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:02.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.916+0000 7f8e3effd640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4006eef0 0x7f8e4014be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:02.918 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.916+0000 7f8e3effd640 1 -- 172.21.15.102:0/3252368059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009a70 con 0x7f8e400c2bf0 2023-12-01T23:18:02.920 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.919+0000 7f8e3effd640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400e980 tx=0x7f8e3400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.923+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e34009670 con 0x7f8e400c2bf0 2023-12-01T23:18:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.923+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3400ca00 con 0x7f8e400c2bf0 2023-12-01T23:18:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.923+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4014ca80 con 0x7f8e400c2bf0 2023-12-01T23:18:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.923+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3400cd90 con 0x7f8e400c2bf0 2023-12-01T23:18:02.924 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.923+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4014d040 con 0x7f8e400c2bf0 2023-12-01T23:18:02.925 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.924+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e400740e0 con 0x7f8e400c2bf0 2023-12-01T23:18:02.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.927+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8e34005c90 con 0x7f8e400c2bf0 2023-12-01T23:18:02.928 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:02.927+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8e340139f0 con 0x7f8e400c2bf0 2023-12-01T23:18:03.028 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.027+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8e34021060 con 0x7f8e400c2bf0 2023-12-01T23:18:03.097 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:03.096+0000 7ffbc5a32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T23:18:03.103 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.102+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfde523c-f5b8-45e6-b1c4-df8d336d6597", "id": 5} v 0) v1 -- 0x7f8e4006ecd0 con 0x7f8e400c2bf0 2023-12-01T23:18:03.179 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.177+0000 7f8e27fff640 1 -- 172.21.15.102:0/3252368059 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfde523c-f5b8-45e6-b1c4-df8d336d6597", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8e34017070 con 0x7f8e400c2bf0 2023-12-01T23:18:03.180 INFO:teuthology.orchestra.run.smithi102.stdout:5 2023-12-01T23:18:03.180 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 msgr2=0x7f8e40151fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e3400e980 tx=0x7f8e3400ee40 comp rx=0 tx=0).stop 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 shutdown_connections 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e40150470 0x7f8e4006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e400c2bf0 0x7f8e40151fa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 --2- 172.21.15.102:0/3252368059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e4006eef0 0x7f8e4014be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.178+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 >> 172.21.15.102:0/3252368059 conn(0x7f8e40072930 msgr2=0x7f8e4006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.179+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 shutdown_connections 2023-12-01T23:18:03.181 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.179+0000 7f8e45aec640 1 -- 172.21.15.102:0/3252368059 wait complete. 2023-12-01T23:18:03.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 8c318859-a0f4-4986-a66f-bf6e248c1021 6 2023-12-01T23:18:03.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.289+0000 7f83f9f25640 1 Processor -- start 2023-12-01T23:18:03.290 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.289+0000 7f83f9f25640 1 -- start start 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f9f25640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83f4153890 0x7f83f415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f9f25640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83f40ceef0 0x7f83f40cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f9f25640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f415a700 con 0x7f83f4153c70 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f9f25640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40cf840 con 0x7f83f4153890 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f9f25640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40ca870 con 0x7f83f40ceef0 2023-12-01T23:18:03.291 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.290+0000 7f83f3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83f40ceef0 0x7f83f40cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.291+0000 7f83f37fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f83f4153890 0x7f83f415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.291+0000 7f83f3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83f40ceef0 0x7f83f40cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38428/0 (socket says 172.21.15.102:38428) 2023-12-01T23:18:03.292 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.291+0000 7f83f3fff640 1 -- 172.21.15.102:0/3312537759 learned_addr learned my addr 172.21.15.102:0/3312537759 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:03.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.293+0000 7f83f3fff640 1 -- 172.21.15.102:0/3312537759 >> v2:172.21.15.96:3300/0 conn(0x7f83f4153890 msgr2=0x7f83f415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:03.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.293+0000 7f83f3fff640 1 --2- 172.21.15.102:0/3312537759 >> v2:172.21.15.96:3300/0 conn(0x7f83f4153890 0x7f83f415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.293+0000 7f83f3fff640 1 -- 172.21.15.102:0/3312537759 >> v1:172.21.15.102:6789/0 conn(0x7f83f4153c70 legacy=0x7f83f40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.294 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.293+0000 7f83f3fff640 1 -- 172.21.15.102:0/3312537759 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4159af0 con 0x7f83f40ceef0 2023-12-01T23:18:03.299 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.298+0000 7f83f3fff640 1 --2- 172.21.15.102:0/3312537759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40ceef0 0x7f83f40cf300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83f40c9ab0 tx=0x7f83ec02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4df98ecb3e367e42 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.302+0000 7f83f27fc640 1 -- 172.21.15.102:0/3312537759 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec02cbb0 con 0x7f83f40ceef0 2023-12-01T23:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.302+0000 7f83f27fc640 1 -- 172.21.15.102:0/3312537759 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec02cd10 con 0x7f83f40ceef0 2023-12-01T23:18:03.303 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.302+0000 7f83f27fc640 1 -- 172.21.15.102:0/3312537759 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec034610 con 0x7f83f40ceef0 2023-12-01T23:18:03.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 -- 172.21.15.102:0/3312537759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40ceef0 msgr2=0x7f83f40cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.304 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 --2- 172.21.15.102:0/3312537759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40ceef0 0x7f83f40cf300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83f40c9ab0 tx=0x7f83ec02c010 comp rx=0 tx=0).stop 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 -- 172.21.15.102:0/3312537759 shutdown_connections 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 --2- 172.21.15.102:0/3312537759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f40ceef0 0x7f83f40cf300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 --2- 172.21.15.102:0/3312537759 >> v2:172.21.15.96:3300/0 conn(0x7f83f4153890 0x7f83f415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 -- 172.21.15.102:0/3312537759 >> 172.21.15.102:0/3312537759 conn(0x7f83f406ba00 msgr2=0x7f83f406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 -- 172.21.15.102:0/3312537759 shutdown_connections 2023-12-01T23:18:03.305 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.303+0000 7f83f9f25640 1 -- 172.21.15.102:0/3312537759 wait complete. 2023-12-01T23:18:03.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.305+0000 7f83f9f25640 1 Processor -- start 2023-12-01T23:18:03.306 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.305+0000 7f83f9f25640 1 -- start start 2023-12-01T23:18:03.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f40ceef0 0x7f83f41f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f4153890 0x7f83f41ef030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.307 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4147cb0 con 0x7f83f40ceef0 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41ef570 con 0x7f83f4153c70 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.306+0000 7f83f9f25640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4142bd0 con 0x7f83f4153890 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.307+0000 7f83f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.307+0000 7f83f2ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f4153890 0x7f83f41ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.307+0000 7f83f37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f40ceef0 0x7f83f41f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.308 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.307+0000 7f83f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38438/0 (socket says 172.21.15.102:38438) 2023-12-01T23:18:03.309 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.307+0000 7f83f3fff640 1 -- 172.21.15.102:0/1299537841 learned_addr learned my addr 172.21.15.102:0/1299537841 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:03.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.312+0000 7f83f3fff640 1 -- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f4153890 msgr2=0x7f83f41ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.312+0000 7f83f3fff640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f4153890 0x7f83f41ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.312+0000 7f83f3fff640 1 -- 172.21.15.102:0/1299537841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f40ceef0 msgr2=0x7f83f41f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.312+0000 7f83f3fff640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f40ceef0 0x7f83f41f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.313 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.312+0000 7f83f3fff640 1 -- 172.21.15.102:0/1299537841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009b30 con 0x7f83f4153c70 2023-12-01T23:18:03.315 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.315+0000 7f83f3fff640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83ec036040 tx=0x7f83ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.319+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec03e450 con 0x7f83f4153c70 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.319+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec03e5b0 con 0x7f83f4153c70 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.319+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec03e960 con 0x7f83f4153c70 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.319+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4147ee0 con 0x7f83f4153c70 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.319+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f41481a0 con 0x7f83f4153c70 2023-12-01T23:18:03.320 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.320+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f4067500 con 0x7f83f4153c70 2023-12-01T23:18:03.329 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:03.328+0000 7fcaaee2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T23:18:03.377 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:03.376+0000 7ffbc5a32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T23:18:03.429 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:03.428+0000 7ffbc5a32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T23:18:03.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.435+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83ec051430 con 0x7f83f4153c70 2023-12-01T23:18:03.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.435+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f83ec03edc0 con 0x7f83f4153c70 2023-12-01T23:18:03.436 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.435+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f83ec043020 con 0x7f83f4153c70 2023-12-01T23:18:03.531 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:03.530+0000 7ffbc5a32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T23:18:03.536 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.535+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c318859-a0f4-4986-a66f-bf6e248c1021", "id": 6} v 0) v1 -- 0x7f83f41571c0 con 0x7f83f4153c70 2023-12-01T23:18:03.633 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:03.632+0000 7fcaaee2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T23:18:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.667+0000 7f83dbfff640 1 -- 172.21.15.102:0/1299537841 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c318859-a0f4-4986-a66f-bf6e248c1021", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83ec051820 con 0x7f83f4153c70 2023-12-01T23:18:03.669 INFO:teuthology.orchestra.run.smithi102.stdout:6 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 msgr2=0x7f83f4142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83ec036040 tx=0x7f83ec004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 shutdown_connections 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83f4153c70 0x7f83f4142690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83f4153890 0x7f83f41ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 --2- 172.21.15.102:0/1299537841 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f83f40ceef0 0x7f83f41f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 >> 172.21.15.102:0/1299537841 conn(0x7f83f406ba00 msgr2=0x7f83f4149190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 shutdown_connections 2023-12-01T23:18:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.668+0000 7f83f9f25640 1 -- 172.21.15.102:0/1299537841 wait complete. 2023-12-01T23:18:03.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 2e101d87-81cd-436a-a8a6-fb5d2ce70b33 7 2023-12-01T23:18:03.701 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:03.700+0000 7fcaaee2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T23:18:03.786 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.785+0000 7f118577c640 1 Processor -- start 2023-12-01T23:18:03.787 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.785+0000 7f118577c640 1 -- start start 2023-12-01T23:18:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.787+0000 7f118577c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f118015d7e0 0x7f118006e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.787+0000 7f118577c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118006e8b0 con 0x7f1180153a60 2023-12-01T23:18:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.787+0000 7f118577c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118006d6b0 con 0x7f118015a050 2023-12-01T23:18:03.788 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.787+0000 7f118577c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118015a4b0 con 0x7f118015d7e0 2023-12-01T23:18:03.808 INFO:tasks.ceph.mgr.x.smithi102.stderr:2023-12-01T23:18:03.807+0000 7fcaaee2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T23:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.841+0000 7f117effd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1180153a60 0x7f11800c72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.102:54602/0 (socket says 172.21.15.102:54602) 2023-12-01T23:18:03.842 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.841+0000 7f117effd640 1 -- 172.21.15.102:0/2525728049 learned_addr learned my addr 172.21.15.102:0/2525728049 (peer_addr_for_me v1:172.21.15.102:0/0) 2023-12-01T23:18:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.851+0000 7f117dffb640 1 -- 172.21.15.102:0/2525728049 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577342966 0 0) 0x7f1170001110 con 0x7f1180153a60 2023-12-01T23:18:03.852 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.851+0000 7f117dffb640 1 -- 172.21.15.102:0/2525728049 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1168003520 con 0x7f1180153a60 2023-12-01T23:18:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.867+0000 7f117f7fe640 1 --2- 172.21.15.102:0/2525728049 >> v2:172.21.15.102:3300/0 conn(0x7f118015d7e0 0x7f118006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.870+0000 7f117f7fe640 1 -- 172.21.15.102:0/2525728049 >> v1:172.21.15.102:6789/0 conn(0x7f118015a050 legacy=0x7f118015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.870+0000 7f117f7fe640 1 -- 172.21.15.102:0/2525728049 >> v1:172.21.15.96:6789/0 conn(0x7f1180153a60 legacy=0x7f11800c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.870+0000 7f117f7fe640 1 -- 172.21.15.102:0/2525728049 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118015cbf0 con 0x7f118015d7e0 2023-12-01T23:18:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.876+0000 7f117f7fe640 1 --2- 172.21.15.102:0/2525728049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f118006e370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f117802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a36e28071c55dbda server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f117dffb640 1 -- 172.21.15.102:0/2525728049 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117802cd80 con 0x7f118015d7e0 2023-12-01T23:18:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f117dffb640 1 -- 172.21.15.102:0/2525728049 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178034440 con 0x7f118015d7e0 2023-12-01T23:18:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f117dffb640 1 -- 172.21.15.102:0/2525728049 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11780347d0 con 0x7f118015d7e0 2023-12-01T23:18:03.881 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 -- 172.21.15.102:0/2525728049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 msgr2=0x7f118006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 --2- 172.21.15.102:0/2525728049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f118006e370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f117802bfd0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 -- 172.21.15.102:0/2525728049 shutdown_connections 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 --2- 172.21.15.102:0/2525728049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f118006e370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 -- 172.21.15.102:0/2525728049 >> 172.21.15.102:0/2525728049 conn(0x7f118006fa90 msgr2=0x7f118006fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 -- 172.21.15.102:0/2525728049 shutdown_connections 2023-12-01T23:18:03.882 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.880+0000 7f118577c640 1 -- 172.21.15.102:0/2525728049 wait complete. 2023-12-01T23:18:03.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.882+0000 7f118577c640 1 Processor -- start 2023-12-01T23:18:03.883 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.882+0000 7f118577c640 1 -- start start 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1180153a60 0x7f11801511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f118015a050 0x7f1180149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11801f39a0 con 0x7f118015a050 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118014a2d0 con 0x7f118015d7e0 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f118577c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118014f640 con 0x7f1180153a60 2023-12-01T23:18:03.884 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.883+0000 7f117f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:03.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.884+0000 7f117f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54144/0 (socket says 172.21.15.102:54144) 2023-12-01T23:18:03.885 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.884+0000 7f117f7fe640 1 -- 172.21.15.102:0/4096535164 learned_addr learned my addr 172.21.15.102:0/4096535164 (peer_addr_for_me v2:172.21.15.102:0/0) 2023-12-01T23:18:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.887+0000 7f117f7fe640 1 -- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1180153a60 msgr2=0x7f11801511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.887+0000 7f117f7fe640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1180153a60 0x7f11801511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.887+0000 7f117f7fe640 1 -- 172.21.15.102:0/4096535164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f118015a050 msgr2=0x7f1180149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.887+0000 7f117f7fe640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f118015a050 0x7f1180149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:03.888 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.887+0000 7f117f7fe640 1 -- 172.21.15.102:0/4096535164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1178009a70 con 0x7f118015d7e0 2023-12-01T23:18:03.889 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.889+0000 7f117f7fe640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f1178004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.892+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178040650 con 0x7f118015d7e0 2023-12-01T23:18:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.892+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11780407b0 con 0x7f118015d7e0 2023-12-01T23:18:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.892+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1178040b60 con 0x7f118015d7e0 2023-12-01T23:18:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.892+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800cc9b0 con 0x7f118015d7e0 2023-12-01T23:18:03.893 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.892+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118014e860 con 0x7f118015d7e0 2023-12-01T23:18:03.894 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.893+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1180067710 con 0x7f118015d7e0 2023-12-01T23:18:03.908 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:03.908+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7f1178040cc0 con 0x7f118015d7e0 2023-12-01T23:18:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.008+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f117803e800 con 0x7f118015d7e0 2023-12-01T23:18:04.009 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.008+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f117803d990 con 0x7f118015d7e0 2023-12-01T23:18:04.086 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.086+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e101d87-81cd-436a-a8a6-fb5d2ce70b33", "id": 7} v 0) v1 -- 0x7f11800cc9b0 con 0x7f118015d7e0 2023-12-01T23:18:04.339 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.338+0000 7f11677fe640 1 -- 172.21.15.102:0/4096535164 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e101d87-81cd-436a-a8a6-fb5d2ce70b33", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11800cc9b0 con 0x7f118015d7e0 2023-12-01T23:18:04.339 INFO:teuthology.orchestra.run.smithi102.stdout:7 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.338+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 msgr2=0x7f1180149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1178009d90 tx=0x7f1178004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 shutdown_connections 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f118015d7e0 0x7f1180149d90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f118015a050 0x7f1180149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.340 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 --2- 172.21.15.102:0/4096535164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1180153a60 0x7f11801511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 >> 172.21.15.102:0/4096535164 conn(0x7f118006fa90 msgr2=0x7f11800c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 shutdown_connections 2023-12-01T23:18:04.341 INFO:teuthology.orchestra.run.smithi102.stderr:2023-12-01T23:18:04.339+0000 7f118577c640 1 -- 172.21.15.102:0/4096535164 wait complete. 2023-12-01T23:18:04.351 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-01T23:18:04.352 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2023-12-01T23:18:04.354 INFO:tasks.ceph.osd.0:Started 2023-12-01T23:18:04.354 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-01T23:18:04.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2023-12-01T23:18:04.356 INFO:tasks.ceph.osd.1:Started 2023-12-01T23:18:04.356 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-01T23:18:04.356 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2023-12-01T23:18:04.358 INFO:tasks.ceph.osd.2:Started 2023-12-01T23:18:04.358 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-01T23:18:04.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2023-12-01T23:18:04.361 INFO:tasks.ceph.osd.3:Started 2023-12-01T23:18:04.361 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-01T23:18:04.361 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2023-12-01T23:18:04.394 INFO:tasks.ceph.osd.4:Started 2023-12-01T23:18:04.394 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-01T23:18:04.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2023-12-01T23:18:04.396 INFO:tasks.ceph.osd.5:Started 2023-12-01T23:18:04.396 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-01T23:18:04.397 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2023-12-01T23:18:04.398 INFO:tasks.ceph.osd.6:Started 2023-12-01T23:18:04.399 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-01T23:18:04.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2023-12-01T23:18:04.401 INFO:tasks.ceph.osd.7:Started 2023-12-01T23:18:04.401 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:04.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.518+0000 7f3837fb6640 1 Processor -- start 2023-12-01T23:18:04.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.518+0000 7f3837fb6640 1 -- start start 2023-12-01T23:18:04.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3837fb6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3830153c70 0x7f383015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3837fb6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f38300ceef0 0x7f38300cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3837fb6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383015a700 con 0x7f3830153890 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3837fb6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300cf840 con 0x7f38300ceef0 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3837fb6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300ca870 con 0x7f3830153c70 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.519+0000 7f3835551640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3830153c70 0x7f383015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:04.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.520+0000 7f3835551640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3830153c70 0x7f383015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:60638/0 (socket says 172.21.15.96:60638) 2023-12-01T23:18:04.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.520+0000 7f3835551640 1 -- 172.21.15.96:0/2780493634 learned_addr learned my addr 172.21.15.96:0/2780493634 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:04.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.522+0000 7f3835551640 1 -- 172.21.15.96:0/2780493634 >> v2:172.21.15.96:3300/0 conn(0x7f38300ceef0 msgr2=0x7f38300cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:04.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.522+0000 7f3835551640 1 --2- 172.21.15.96:0/2780493634 >> v2:172.21.15.96:3300/0 conn(0x7f38300ceef0 0x7f38300cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.522+0000 7f3835551640 1 -- 172.21.15.96:0/2780493634 >> v1:172.21.15.102:6789/0 conn(0x7f3830153890 legacy=0x7f38300c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:04.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.522+0000 7f3835551640 1 -- 172.21.15.96:0/2780493634 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830159af0 con 0x7f3830153c70 2023-12-01T23:18:04.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.526+0000 7f3835551640 1 --2- 172.21.15.96:0/2780493634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3830153c70 0x7f383015d950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38300c6290 tx=0x7f382002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74648d549964d78f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:04.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.570+0000 7f3834d50640 1 -- 172.21.15.96:0/2780493634 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820030860 con 0x7f3830153c70 2023-12-01T23:18:04.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.570+0000 7f3834d50640 1 -- 172.21.15.96:0/2780493634 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200309c0 con 0x7f3830153c70 2023-12-01T23:18:04.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.570+0000 7f3834d50640 1 -- 172.21.15.96:0/2780493634 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820030d50 con 0x7f3830153c70 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 -- 172.21.15.96:0/2780493634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3830153c70 msgr2=0x7f383015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 --2- 172.21.15.96:0/2780493634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3830153c70 0x7f383015d950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38300c6290 tx=0x7f382002b9a0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 -- 172.21.15.96:0/2780493634 shutdown_connections 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 --2- 172.21.15.96:0/2780493634 >> v2:172.21.15.96:3300/0 conn(0x7f38300ceef0 0x7f38300cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 --2- 172.21.15.96:0/2780493634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3830153c70 0x7f383015d950 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 -- 172.21.15.96:0/2780493634 >> 172.21.15.96:0/2780493634 conn(0x7f383006ba00 msgr2=0x7f383006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:04.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 -- 172.21.15.96:0/2780493634 shutdown_connections 2023-12-01T23:18:04.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.571+0000 7f3837fb6640 1 -- 172.21.15.96:0/2780493634 wait complete. 2023-12-01T23:18:04.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.572+0000 7f3837fb6640 1 Processor -- start 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.572+0000 7f3837fb6640 1 -- start start 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38300ceef0 0x7f3830154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3830153c70 0x7f38301f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38301f0040 con 0x7f3830153890 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830156c00 con 0x7f38300ceef0 2023-12-01T23:18:04.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3837fb6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3830154ca0 con 0x7f3830153c70 2023-12-01T23:18:04.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3835551640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:04.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.573+0000 7f3836553640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3830153c70 0x7f38301f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:04.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.574+0000 7f3835551640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47320/0 (socket says 172.21.15.96:47320) 2023-12-01T23:18:04.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.574+0000 7f3835551640 1 -- 172.21.15.96:0/4059971475 learned_addr learned my addr 172.21.15.96:0/4059971475 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:04.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.577+0000 7f3835551640 1 -- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3830153c70 msgr2=0x7f38301f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.577+0000 7f3835551640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3830153c70 0x7f38301f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.577+0000 7f3835551640 1 -- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38300ceef0 msgr2=0x7f3830154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.577+0000 7f3835551640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38300ceef0 0x7f3830154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.577+0000 7f3835551640 1 -- 172.21.15.96:0/4059971475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094d0 con 0x7f3830153890 2023-12-01T23:18:04.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.579+0000 7f3835551640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.586+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820039e20 con 0x7f3830153890 2023-12-01T23:18:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.586+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820043400 con 0x7f3830153890 2023-12-01T23:18:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.586+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200437b0 con 0x7f3830153890 2023-12-01T23:18:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.586+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38301f0460 con 0x7f3830153890 2023-12-01T23:18:04.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.586+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38301ef6a0 con 0x7f3830153890 2023-12-01T23:18:04.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.587+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3830067500 con 0x7f3830153890 2023-12-01T23:18:04.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.822+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7f3820043910 con 0x7f3830153890 2023-12-01T23:18:04.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.828+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f382003e070 con 0x7f3830153890 2023-12-01T23:18:04.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.828+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f38200577b0 con 0x7f3830153890 2023-12-01T23:18:04.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:04.889+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38301571c0 con 0x7f3830153890 2023-12-01T23:18:04.977 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:18:04.976+0000 7fafa3acf500 -1 Falling back to public interface 2023-12-01T23:18:04.990 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:18:04.989+0000 7f8b91425500 -1 Falling back to public interface 2023-12-01T23:18:04.991 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:18:04.989+0000 7fa3fea14500 -1 Falling back to public interface 2023-12-01T23:18:04.991 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:18:04.989+0000 7fa3fd417640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2023-12-01T23:18:04.991 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:18:04.990+0000 7f8b903cc640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6812/0: (98) Address already in use 2023-12-01T23:18:05.008 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:18:05.007+0000 7f8fdabbe500 -1 Falling back to public interface 2023-12-01T23:18:05.011 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:18:05.010+0000 7efe68a25500 -1 Falling back to public interface 2023-12-01T23:18:05.035 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:18:05.034+0000 7f3c02b90500 -1 Falling back to public interface 2023-12-01T23:18:05.035 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:18:05.034+0000 7f1567f94500 -1 Falling back to public interface 2023-12-01T23:18:05.035 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:18:05.034+0000 7f3c01b37640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-12-01T23:18:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.064+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 3) v1 ==== 89069+0+0 (secure 0 0 0) 0x7f382004ccb0 con 0x7f3830153890 2023-12-01T23:18:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.064+0000 7f38267fc640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 0x7f381406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:05.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.064+0000 7f3835d52640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 0x7f381406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.065+0000 7f3835d52640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 0x7f381406d8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f382c001560 tx=0x7f382c007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:05.067 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:18:05.067+0000 7f05f5e1f500 -1 Falling back to public interface 2023-12-01T23:18:05.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.112+0000 7f38267fc640 1 -- 172.21.15.96:0/4059971475 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3820065d80 con 0x7f3830153890 2023-12-01T23:18:05.113 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:05.113 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:04.199976+0000","last_up_change":"0.000000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 msgr2=0x7f381406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 0x7f381406d8e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f382c001560 tx=0x7f382c007990 comp rx=0 tx=0).stop 2023-12-01T23:18:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 msgr2=0x7f38300b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3820000c00 tx=0x7f3820004730 comp rx=0 tx=0).stop 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 shutdown_connections 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f381406b4f0 0x7f381406d8e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3830153c70 0x7f38301f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3830153890 0x7f38300b43e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 --2- 172.21.15.96:0/4059971475 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38300ceef0 0x7f3830154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 >> 172.21.15.96:0/4059971475 conn(0x7f383006ba00 msgr2=0x7f3830158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 shutdown_connections 2023-12-01T23:18:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:05.113+0000 7f3837fb6640 1 -- 172.21.15.96:0/4059971475 wait complete. 2023-12-01T23:18:05.125 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-01T23:18:05.125 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-01T23:18:05.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:18:05.172 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:18:05.268 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:05.267+0000 7ffb66662640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-01T23:18:05.289 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-12-01T23:18:05.288+0000 7ffb66662640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-01T23:18:05.930 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:06.020 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.019+0000 7fb1e715a640 1 Processor -- start 2023-12-01T23:18:06.021 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.020+0000 7fb1e715a640 1 -- start start 2023-12-01T23:18:06.021 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.020+0000 7fb1e715a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1e00cb440 0x7fb1e015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:06.021 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.020+0000 7fb1e715a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e00ca5f0 con 0x7fb1e01538b0 2023-12-01T23:18:06.021 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.020+0000 7fb1e715a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e0159b30 con 0x7fb1e01596a0 2023-12-01T23:18:06.021 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.020+0000 7fb1e715a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e00c6230 con 0x7fb1e00cb440 2023-12-01T23:18:06.022 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.021+0000 7fb1e56f7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb1e01596a0 0x7fb1e00ced40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:54674/0 (socket says 172.21.15.96:54674) 2023-12-01T23:18:06.022 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.021+0000 7fb1dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1e00cb440 0x7fb1e015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:06.022 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.021+0000 7fb1e56f7640 1 -- 172.21.15.96:0/1324506328 learned_addr learned my addr 172.21.15.96:0/1324506328 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:06.024 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.023+0000 7fb1df7fe640 1 -- 172.21.15.96:0/1324506328 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992560859 0 0) 0x7fb1e0159b30 con 0x7fb1e01596a0 2023-12-01T23:18:06.024 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.023+0000 7fb1df7fe640 1 -- 172.21.15.96:0/1324506328 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d0003520 con 0x7fb1e01596a0 2023-12-01T23:18:06.025 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.024+0000 7fb1dffff640 1 -- 172.21.15.96:0/1324506328 >> v1:172.21.15.102:6789/0 conn(0x7fb1e01596a0 legacy=0x7fb1e00ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.025 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.024+0000 7fb1dffff640 1 -- 172.21.15.96:0/1324506328 >> v1:172.21.15.96:6789/0 conn(0x7fb1e01538b0 legacy=0x7fb1e00c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.025 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.024+0000 7fb1dffff640 1 -- 172.21.15.96:0/1324506328 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0159e10 con 0x7fb1e00cb440 2023-12-01T23:18:06.028 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.027+0000 7fb1dffff640 1 --2- 172.21.15.96:0/1324506328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e00cb440 0x7fb1e015d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0097a0 tx=0x7fb1cc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b66e104312f33 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:06.031 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.030+0000 7fb1df7fe640 1 -- 172.21.15.96:0/1324506328 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc02f810 con 0x7fb1e00cb440 2023-12-01T23:18:06.031 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.030+0000 7fb1df7fe640 1 -- 172.21.15.96:0/1324506328 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc02f970 con 0x7fb1e00cb440 2023-12-01T23:18:06.031 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.030+0000 7fb1df7fe640 1 -- 172.21.15.96:0/1324506328 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc02fd00 con 0x7fb1e00cb440 2023-12-01T23:18:06.033 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 -- 172.21.15.96:0/1324506328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e00cb440 msgr2=0x7fb1e015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.033 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 --2- 172.21.15.96:0/1324506328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e00cb440 0x7fb1e015d2d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0097a0 tx=0x7fb1cc02b9f0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.033 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 -- 172.21.15.96:0/1324506328 shutdown_connections 2023-12-01T23:18:06.033 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 --2- 172.21.15.96:0/1324506328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e00cb440 0x7fb1e015d2d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.033 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 -- 172.21.15.96:0/1324506328 >> 172.21.15.96:0/1324506328 conn(0x7fb1e006b970 msgr2=0x7fb1e006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:06.034 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 -- 172.21.15.96:0/1324506328 shutdown_connections 2023-12-01T23:18:06.034 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.031+0000 7fb1e715a640 1 -- 172.21.15.96:0/1324506328 wait complete. 2023-12-01T23:18:06.034 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.032+0000 7fb1e715a640 1 Processor -- start 2023-12-01T23:18:06.034 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.032+0000 7fb1e715a640 1 -- start start 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e00cb440 0x7fb1e0151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1e015c7f0 0x7fb1e00c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01ef090 con 0x7fb1e01538b0 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00c3650 con 0x7fb1e00cb440 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1e715a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e01f0040 con 0x7fb1e015c7f0 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.033+0000 7fb1dffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.034+0000 7fb1e4ef6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e00cb440 0x7fb1e0151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.034+0000 7fb1dffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47334/0 (socket says 172.21.15.96:47334) 2023-12-01T23:18:06.035 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.034+0000 7fb1dffff640 1 -- 172.21.15.96:0/347349347 learned_addr learned my addr 172.21.15.96:0/347349347 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:06.036 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.034+0000 7fb1e56f7640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1e015c7f0 0x7fb1e00c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:06.038 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.037+0000 7fb1dffff640 1 -- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1e015c7f0 msgr2=0x7fb1e00c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.038 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.037+0000 7fb1dffff640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1e015c7f0 0x7fb1e00c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.038 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.037+0000 7fb1dffff640 1 -- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e00cb440 msgr2=0x7fb1e0151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.038 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.037+0000 7fb1dffff640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e00cb440 0x7fb1e0151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.038 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.037+0000 7fb1dffff640 1 -- 172.21.15.96:0/347349347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc009400 con 0x7fb1e01538b0 2023-12-01T23:18:06.040 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.039+0000 7fb1dffff640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc02c000 tx=0x7fb1cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:06.043 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.042+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc03c040 con 0x7fb1e01538b0 2023-12-01T23:18:06.043 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.042+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0378f0 con 0x7fb1e01538b0 2023-12-01T23:18:06.043 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.042+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc037ca0 con 0x7fb1e01538b0 2023-12-01T23:18:06.043 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.042+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e01efbb0 con 0x7fb1e01538b0 2023-12-01T23:18:06.044 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.042+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e0151a30 con 0x7fb1e01538b0 2023-12-01T23:18:06.044 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.043+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e0067210 con 0x7fb1e01538b0 2023-12-01T23:18:06.063 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.062+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 3) v1 ==== 89069+0+0 (secure 0 0 0) 0x7fb1cc02d3a0 con 0x7fb1e01538b0 2023-12-01T23:18:06.063 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.062+0000 7fb1dd7fa640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 0x7fb1c406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:06.063 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.063+0000 7fb1e4ef6640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 0x7fb1c406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:06.064 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.063+0000 7fb1e4ef6640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 0x7fb1c406d150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4000f60 tx=0x7fb1d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:06.065 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.065+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb1cc07a3c0 con 0x7fb1e01538b0 2023-12-01T23:18:06.297 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.296+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1cc076700 con 0x7fb1e01538b0 2023-12-01T23:18:06.480 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.480+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fb1cc076ad0 con 0x7fb1e01538b0 2023-12-01T23:18:06.488 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.487+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1e00c87a0 con 0x7fb1e01538b0 2023-12-01T23:18:06.509 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.508+0000 7fb1dd7fa640 1 -- 172.21.15.96:0/347349347 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb1cc0a62a0 con 0x7fb1e01538b0 2023-12-01T23:18:06.509 INFO:teuthology.misc.health.smithi096.stdout: 2023-12-01T23:18:06.509 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":10,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:04.199976+0000","last_up_change":"0.000000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 msgr2=0x7fb1c406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 0x7fb1c406d150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4000f60 tx=0x7fb1d4009040 comp rx=0 tx=0).stop 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 msgr2=0x7fb1e0152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc02c000 tx=0x7fb1cc004730 comp rx=0 tx=0).stop 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 shutdown_connections 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1c406ac90 0x7fb1c406d150 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.511 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1e015c7f0 0x7fb1e00c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.512 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1e01538b0 0x7fb1e0152250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.512 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 --2- 172.21.15.96:0/347349347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1e00cb440 0x7fb1e0151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:06.512 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 >> 172.21.15.96:0/347349347 conn(0x7fb1e006b970 msgr2=0x7fb1e014ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:06.512 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 shutdown_connections 2023-12-01T23:18:06.512 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:06.510+0000 7fb1e715a640 1 -- 172.21.15.96:0/347349347 wait complete. 2023-12-01T23:18:06.520 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-01T23:18:08.438 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:18:08.438+0000 7fafa3acf500 -1 osd.1 0 log_to_monitors true 2023-12-01T23:18:08.453 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:18:08.451+0000 7f8fdabbe500 -1 osd.4 0 log_to_monitors true 2023-12-01T23:18:08.482 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:18:08.481+0000 7fa3fea14500 -1 osd.2 0 log_to_monitors true 2023-12-01T23:18:08.483 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:18:08.483+0000 7f8b91425500 -1 osd.0 0 log_to_monitors true 2023-12-01T23:18:08.493 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:18:08.492+0000 7f1567f94500 -1 osd.6 0 log_to_monitors true 2023-12-01T23:18:08.517 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:18:08.516+0000 7efe68a25500 -1 osd.3 0 log_to_monitors true 2023-12-01T23:18:08.528 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:18:08.527+0000 7f3c02b90500 -1 osd.5 0 log_to_monitors true 2023-12-01T23:18:08.537 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:18:08.536+0000 7f05f5e1f500 -1 osd.7 0 log_to_monitors true 2023-12-01T23:18:10.446 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:18:10.444+0000 7faf9fa5d640 -1 osd.1 0 waiting for initial osdmap 2023-12-01T23:18:10.452 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:18:10.451+0000 7f1563f24640 -1 osd.6 0 waiting for initial osdmap 2023-12-01T23:18:10.494 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:18:10.493+0000 7faf97883640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:10.506 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:18:10.505+0000 7f155bd4a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:10.520 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:18:10.519+0000 7f8fd6b4e640 -1 osd.4 0 waiting for initial osdmap 2023-12-01T23:18:10.548 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:18:10.547+0000 7fa3fa3fe640 -1 osd.2 0 waiting for initial osdmap 2023-12-01T23:18:10.555 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:18:10.554+0000 7f8fce974640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:10.580 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:18:10.580+0000 7fa3f2224640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:11.703 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:18:11.702+0000 7f8b8d3b3640 -1 osd.0 0 waiting for initial osdmap 2023-12-01T23:18:11.714 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:18:11.714+0000 7efe642f4640 -1 osd.3 0 waiting for initial osdmap 2023-12-01T23:18:11.725 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:18:11.724+0000 7f05f16ed640 -1 osd.7 0 waiting for initial osdmap 2023-12-01T23:18:11.729 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:18:11.729+0000 7f3bfeb1e640 -1 osd.5 0 waiting for initial osdmap 2023-12-01T23:18:11.739 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:18:11.738+0000 7f8b851d9640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:11.742 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:18:11.742+0000 7efe5c11a640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:11.743 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:18:11.743+0000 7f05e9513640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:11.748 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:18:11.748+0000 7f3bf6944640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T23:18:13.327 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:13.418 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.417+0000 7fe4f3890640 1 Processor -- start 2023-12-01T23:18:13.418 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.417+0000 7fe4f3890640 1 -- start start 2023-12-01T23:18:13.419 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.418+0000 7fe4f3890640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:13.419 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.418+0000 7fe4f3890640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0caef0 con 0x7fe4ec151510 2023-12-01T23:18:13.419 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.418+0000 7fe4f3890640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0cb1c0 con 0x7fe4ec1518f0 2023-12-01T23:18:13.419 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.418+0000 7fe4f3890640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec158360 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.432 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.431+0000 7fe4f1e2d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:13.432 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.432+0000 7fe4f1e2d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56734/0 (socket says 172.21.15.96:56734) 2023-12-01T23:18:13.432 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.432+0000 7fe4f1e2d640 1 -- 172.21.15.96:0/2221669324 learned_addr learned my addr 172.21.15.96:0/2221669324 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:13.435 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.434+0000 7fe4f1e2d640 1 -- 172.21.15.96:0/2221669324 >> v1:172.21.15.102:6789/0 conn(0x7fe4ec1518f0 legacy=0x7fe4ec0c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:13.435 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.434+0000 7fe4f1e2d640 1 -- 172.21.15.96:0/2221669324 >> v1:172.21.15.96:6789/0 conn(0x7fe4ec151510 legacy=0x7fe4ec0708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:13.435 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.434+0000 7fe4f1e2d640 1 -- 172.21.15.96:0/2221669324 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0cb480 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.437 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.436+0000 7fe4f1e2d640 1 --2- 172.21.15.96:0/2221669324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009e80 tx=0x7fe4e402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be398947ede45720 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:13.444 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.443+0000 7fe4e3fff640 1 -- 172.21.15.96:0/2221669324 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e402c9c0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.444 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.443+0000 7fe4e3fff640 1 -- 172.21.15.96:0/2221669324 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e402cb20 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.444 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.443+0000 7fe4e3fff640 1 -- 172.21.15.96:0/2221669324 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40343f0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 -- 172.21.15.96:0/2221669324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 msgr2=0x7fe4ec157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 --2- 172.21.15.96:0/2221669324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009e80 tx=0x7fe4e402be20 comp rx=0 tx=0).stop 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 -- 172.21.15.96:0/2221669324 shutdown_connections 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 --2- 172.21.15.96:0/2221669324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec157e20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 -- 172.21.15.96:0/2221669324 >> 172.21.15.96:0/2221669324 conn(0x7fe4ec0669f0 msgr2=0x7fe4ec06ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 -- 172.21.15.96:0/2221669324 shutdown_connections 2023-12-01T23:18:13.445 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.444+0000 7fe4f3890640 1 -- 172.21.15.96:0/2221669324 wait complete. 2023-12-01T23:18:13.446 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.446+0000 7fe4f3890640 1 Processor -- start 2023-12-01T23:18:13.446 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.446+0000 7fe4f3890640 1 -- start start 2023-12-01T23:18:13.447 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.446+0000 7fe4f3890640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:13.447 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f3890640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4ec151510 0x7fe4ec14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:13.447 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f3890640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4ec1518f0 0x7fe4ec14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f3890640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0a9130 con 0x7fe4ec151510 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f3890640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0a8560 con 0x7fe4ec1518f0 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f3890640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec06c6c0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f1e2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4ec1518f0 0x7fe4ec14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f162c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:13.448 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f162c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56748/0 (socket says 172.21.15.96:56748) 2023-12-01T23:18:13.449 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.447+0000 7fe4f162c640 1 -- 172.21.15.96:0/129242272 learned_addr learned my addr 172.21.15.96:0/129242272 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f0e2b640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4ec151510 0x7fe4ec14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f162c640 1 -- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4ec1518f0 msgr2=0x7fe4ec14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f162c640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4ec1518f0 0x7fe4ec14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f162c640 1 -- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4ec151510 msgr2=0x7fe4ec14d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f162c640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4ec151510 0x7fe4ec14d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.452 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.451+0000 7fe4f162c640 1 -- 172.21.15.96:0/129242272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009b30 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.454 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.453+0000 7fe4f162c640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c440 tx=0x7fe4e800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:13.458 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.458+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8005480 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.459 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.458+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e80035f0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.459 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.458+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0a8d70 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.459 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.458+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e80039c0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.459 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.458+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0a87b0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.460 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.459+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec067210 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.479 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.477+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe4e8003b20 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.479 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.477+0000 7fe4e1ffb640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 0x7fe4d006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:13.479 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.477+0000 7fe4f0e2b640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 0x7fe4d006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:13.479 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.478+0000 7fe4f0e2b640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 0x7fe4d006d270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec156c50 tx=0x7fe4dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:13.480 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.479+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe4e80010c0 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.715 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.715+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4e8057b50 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.883 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.882+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4ec074140 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.951 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.950+0000 7fe4e1ffb640 1 -- 172.21.15.96:0/129242272 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10988 (secure 0 0 0) 0x7fe4e8017090 con 0x7fe4ec0c2c30 2023-12-01T23:18:13.952 INFO:teuthology.misc.health.smithi096.stdout: 2023-12-01T23:18:13.952 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":15,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:13.080623+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 msgr2=0x7fe4d006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 0x7fe4d006d270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec156c50 tx=0x7fe4dc009040 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 msgr2=0x7fe4ec156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c440 tx=0x7fe4e800c900 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 shutdown_connections 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4d006adb0 0x7fe4d006d270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4ec1518f0 0x7fe4ec14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4ec151510 0x7fe4ec14d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 --2- 172.21.15.96:0/129242272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4ec0c2c30 0x7fe4ec156380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:13.954 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 >> 172.21.15.96:0/129242272 conn(0x7fe4ec0669f0 msgr2=0x7fe4ec0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:13.955 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 shutdown_connections 2023-12-01T23:18:13.955 INFO:teuthology.misc.health.smithi096.stderr:2023-12-01T23:18:13.952+0000 7fe4f3890640 1 -- 172.21.15.96:0/129242272 wait complete. 2023-12-01T23:18:13.963 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-01T23:18:13.963 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-01T23:18:13.963 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.963 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-01T23:18:13.963 DEBUG:teuthology.orchestra.run.smithi096:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2023-12-01T23:18:13.966 INFO:tasks.ceph.mds.a:Started 2023-12-01T23:18:13.966 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.966 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-01T23:18:13.966 DEBUG:teuthology.orchestra.run.smithi096:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2023-12-01T23:18:13.968 INFO:tasks.ceph.mds.c:Started 2023-12-01T23:18:13.968 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.968 INFO:tasks.ceph.mds.e:Restarting daemon 2023-12-01T23:18:13.969 DEBUG:teuthology.orchestra.run.smithi096:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2023-12-01T23:18:13.970 INFO:tasks.ceph.mds.e:Started 2023-12-01T23:18:13.970 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.971 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-01T23:18:13.971 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2023-12-01T23:18:13.973 INFO:tasks.ceph.mds.b:Started 2023-12-01T23:18:13.973 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.973 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-01T23:18:13.974 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2023-12-01T23:18:13.975 INFO:tasks.ceph.mds.d:Started 2023-12-01T23:18:13.976 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-12-01T23:18:13.976 INFO:tasks.ceph.mds.f:Restarting daemon 2023-12-01T23:18:13.976 DEBUG:teuthology.orchestra.run.smithi102:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2023-12-01T23:18:13.978 INFO:tasks.ceph.mds.f:Started 2023-12-01T23:18:13.978 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-01T23:18:13.978 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.086+0000 7faf30410640 1 Processor -- start 2023-12-01T23:18:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.086+0000 7faf30410640 1 -- start start 2023-12-01T23:18:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.087+0000 7faf30410640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf28153890 0x7faf2815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.087+0000 7faf30410640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2815a700 con 0x7faf280ceef0 2023-12-01T23:18:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.087+0000 7faf30410640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280ca870 con 0x7faf28153c70 2023-12-01T23:18:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.087+0000 7faf30410640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf28159af0 con 0x7faf28153890 2023-12-01T23:18:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.088+0000 7faf2e1ac640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faf28153890 0x7faf2815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.088+0000 7faf2d9ab640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faf28153c70 0x7faf280c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:49952/0 (socket says 172.21.15.96:49952) 2023-12-01T23:18:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.088+0000 7faf2d9ab640 1 -- 172.21.15.96:0/2954302078 learned_addr learned my addr 172.21.15.96:0/2954302078 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.091+0000 7faf2e1ac640 1 -- 172.21.15.96:0/2954302078 >> v1:172.21.15.102:6789/0 conn(0x7faf28153c70 legacy=0x7faf280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.091+0000 7faf2e1ac640 1 -- 172.21.15.96:0/2954302078 >> v1:172.21.15.96:6789/0 conn(0x7faf280ceef0 legacy=0x7faf2815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.091+0000 7faf2e1ac640 1 -- 172.21.15.96:0/2954302078 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28159dd0 con 0x7faf28153890 2023-12-01T23:18:14.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.096+0000 7faf2e1ac640 1 --2- 172.21.15.96:0/2954302078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf2815d950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf240097a0 tx=0x7faf2402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b906921658aa88fc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:14.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.098+0000 7faf2d1aa640 1 -- 172.21.15.96:0/2954302078 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2402f810 con 0x7faf28153890 2023-12-01T23:18:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.100+0000 7faf2d1aa640 1 -- 172.21.15.96:0/2954302078 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2402f970 con 0x7faf28153890 2023-12-01T23:18:14.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.100+0000 7faf2d1aa640 1 -- 172.21.15.96:0/2954302078 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2402fd00 con 0x7faf28153890 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 -- 172.21.15.96:0/2954302078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 msgr2=0x7faf2815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 --2- 172.21.15.96:0/2954302078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf2815d950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf240097a0 tx=0x7faf2402b9f0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 -- 172.21.15.96:0/2954302078 shutdown_connections 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 --2- 172.21.15.96:0/2954302078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf2815d950 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 -- 172.21.15.96:0/2954302078 >> 172.21.15.96:0/2954302078 conn(0x7faf2806ba00 msgr2=0x7faf2806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 -- 172.21.15.96:0/2954302078 shutdown_connections 2023-12-01T23:18:14.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.101+0000 7faf30410640 1 -- 172.21.15.96:0/2954302078 wait complete. 2023-12-01T23:18:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.102+0000 7faf30410640 1 Processor -- start 2023-12-01T23:18:14.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.102+0000 7faf30410640 1 -- start start 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf280ceef0 0x7faf2814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf28153c70 0x7faf28149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28153170 con 0x7faf28153890 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28155d00 con 0x7faf280ceef0 2023-12-01T23:18:14.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.103+0000 7faf30410640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28156fd0 con 0x7faf28153c70 2023-12-01T23:18:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.104+0000 7faf2d9ab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.104+0000 7faf2e9ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf28153c70 0x7faf28149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.104+0000 7faf2e1ac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf280ceef0 0x7faf2814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.104+0000 7faf2d9ab640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44012/0 (socket says 172.21.15.96:44012) 2023-12-01T23:18:14.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.104+0000 7faf2d9ab640 1 -- 172.21.15.96:0/3405822818 learned_addr learned my addr 172.21.15.96:0/3405822818 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.107+0000 7faf2d9ab640 1 -- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf28153c70 msgr2=0x7faf28149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.107+0000 7faf2d9ab640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf28153c70 0x7faf28149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.107+0000 7faf2d9ab640 1 -- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf280ceef0 msgr2=0x7faf2814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.107+0000 7faf2d9ab640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf280ceef0 0x7faf2814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.107+0000 7faf2d9ab640 1 -- 172.21.15.96:0/3405822818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24009400 con 0x7faf28153890 2023-12-01T23:18:14.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.110+0000 7faf2d9ab640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c480 tx=0x7faf1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.112+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18005ce0 con 0x7faf28153890 2023-12-01T23:18:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.112+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf281500c0 con 0x7faf28153890 2023-12-01T23:18:14.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.112+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf280b4620 con 0x7faf28153890 2023-12-01T23:18:14.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.114+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28150cc0 con 0x7faf28153890 2023-12-01T23:18:14.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.318+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18001140 con 0x7faf28153890 2023-12-01T23:18:14.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.411+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180072f0 con 0x7faf28153890 2023-12-01T23:18:14.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.412+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7faf18007510 con 0x7faf28153890 2023-12-01T23:18:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.412+0000 7faf1effd640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 0x7faf0c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.412+0000 7faf2e1ac640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 0x7faf0c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.413+0000 7faf2e1ac640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 0x7faf0c06d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf24036000 tx=0x7faf24008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.444+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7faf18058000 con 0x7faf28153890 2023-12-01T23:18:14.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.444+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf18054340 con 0x7faf28153890 2023-12-01T23:18:14.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.656+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf28150cc0 con 0x7faf28153890 2023-12-01T23:18:14.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.714+0000 7faf1effd640 1 -- 172.21.15.96:0/3405822818 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10988 (secure 0 0 0) 0x7faf28150cc0 con 0x7faf28153890 2023-12-01T23:18:14.715 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:14.715 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":15,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:13.080623+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 msgr2=0x7faf0c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 0x7faf0c06d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf24036000 tx=0x7faf24008030 comp rx=0 tx=0).stop 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 msgr2=0x7faf28154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf1800c480 tx=0x7faf1800c940 comp rx=0 tx=0).stop 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 shutdown_connections 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faf0c06adb0 0x7faf0c06d270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf28153c70 0x7faf28149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf28153890 0x7faf28154300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 --2- 172.21.15.96:0/3405822818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf280ceef0 0x7faf2814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 >> 172.21.15.96:0/3405822818 conn(0x7faf2806ba00 msgr2=0x7faf281580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:14.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 shutdown_connections 2023-12-01T23:18:14.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.717+0000 7faf30410640 1 -- 172.21.15.96:0/3405822818 wait complete. 2023-12-01T23:18:14.733 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-01T23:18:14.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:14.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.865+0000 7f0ac9fd0640 1 Processor -- start 2023-12-01T23:18:14.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 -- start start 2023-12-01T23:18:14.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ac41504e0 0x7f0ac406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0ac40c7190 0x7f0ac406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:14.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac40c5f60 con 0x7f0ac40c7700 2023-12-01T23:18:14.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40c2c60 con 0x7f0ac40c7190 2023-12-01T23:18:14.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.866+0000 7f0ac9fd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40c2f20 con 0x7f0ac41504e0 2023-12-01T23:18:14.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.882+0000 7f0ac37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ac41504e0 0x7f0ac406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.900+0000 7f0ac37fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ac41504e0 0x7f0ac406e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:41496/0 (socket says 172.21.15.96:41496) 2023-12-01T23:18:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.900+0000 7f0ac37fe640 1 -- 172.21.15.96:0/207650225 learned_addr learned my addr 172.21.15.96:0/207650225 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.928+0000 7f0ac2ffd640 1 --2- 172.21.15.96:0/207650225 >> v2:172.21.15.96:3300/0 conn(0x7f0ac40c7190 0x7f0ac406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:14.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.956+0000 7f0ac37fe640 1 -- 172.21.15.96:0/207650225 >> v2:172.21.15.96:3300/0 conn(0x7f0ac40c7190 msgr2=0x7f0ac406e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.956+0000 7f0ac37fe640 1 --2- 172.21.15.96:0/207650225 >> v2:172.21.15.96:3300/0 conn(0x7f0ac40c7190 0x7f0ac406e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.956+0000 7f0ac37fe640 1 -- 172.21.15.96:0/207650225 >> v1:172.21.15.102:6789/0 conn(0x7f0ac40c7700 legacy=0x7f0ac40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:14.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.956+0000 7f0ac37fe640 1 -- 172.21.15.96:0/207650225 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40c61b0 con 0x7f0ac41504e0 2023-12-01T23:18:14.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:14.960+0000 7f0ac37fe640 1 --2- 172.21.15.96:0/207650225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac41504e0 0x7f0ac406e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40ccf20 tx=0x7f0ab402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e368eb22ecaa5adf server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.022+0000 7f0ac27fc640 1 -- 172.21.15.96:0/207650225 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4031870 con 0x7f0ac41504e0 2023-12-01T23:18:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.022+0000 7f0ac27fc640 1 -- 172.21.15.96:0/207650225 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40319d0 con 0x7f0ac41504e0 2023-12-01T23:18:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.022+0000 7f0ac27fc640 1 -- 172.21.15.96:0/207650225 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4031d60 con 0x7f0ac41504e0 2023-12-01T23:18:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/207650225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac41504e0 msgr2=0x7f0ac406e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/207650225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac41504e0 0x7f0ac406e1a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40ccf20 tx=0x7f0ab402b910 comp rx=0 tx=0).stop 2023-12-01T23:18:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/207650225 shutdown_connections 2023-12-01T23:18:15.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/207650225 >> v2:172.21.15.96:3300/0 conn(0x7f0ac40c7190 0x7f0ac406e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/207650225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac41504e0 0x7f0ac406e1a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/207650225 >> 172.21.15.96:0/207650225 conn(0x7f0ac40cbef0 msgr2=0x7f0ac40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:15.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/207650225 shutdown_connections 2023-12-01T23:18:15.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.023+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/207650225 wait complete. 2023-12-01T23:18:15.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.025+0000 7f0ac9fd0640 1 Processor -- start 2023-12-01T23:18:15.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.025+0000 7f0ac9fd0640 1 -- start start 2023-12-01T23:18:15.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.026+0000 7f0ac9fd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac40c7190 0x7f0ac41f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:15.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.026+0000 7f0ac9fd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:15.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.026+0000 7f0ac9fd0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac41504e0 0x7f0ac4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.026+0000 7f0ac9fd0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41f3840 con 0x7f0ac41504e0 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.026+0000 7f0ac9fd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41ef490 con 0x7f0ac40c7700 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.027+0000 7f0ac9fd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41ef770 con 0x7f0ac40c7190 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.027+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.027+0000 7f0ac3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac41504e0 0x7f0ac4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.028+0000 7f0ac2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:41512/0 (socket says 172.21.15.96:41512) 2023-12-01T23:18:15.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.028+0000 7f0ac2ffd640 1 -- 172.21.15.96:0/734712051 learned_addr learned my addr 172.21.15.96:0/734712051 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.032+0000 7f0ac2ffd640 1 -- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac40c7190 msgr2=0x7f0ac41f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.032+0000 7f0ac2ffd640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac40c7190 0x7f0ac41f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.032+0000 7f0ac2ffd640 1 -- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac41504e0 msgr2=0x7f0ac4156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.032+0000 7f0ac2ffd640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac41504e0 0x7f0ac4156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.033+0000 7f0ac2ffd640 1 -- 172.21.15.96:0/734712051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40094d0 con 0x7f0ac40c7700 2023-12-01T23:18:15.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.036+0000 7f0ac2ffd640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c7f0 tx=0x7f0ab800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.041+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8004220 con 0x7f0ac40c7700 2023-12-01T23:18:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.041+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab80043a0 con 0x7f0ac40c7700 2023-12-01T23:18:15.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.041+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8007860 con 0x7f0ac40c7700 2023-12-01T23:18:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.041+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac41efa50 con 0x7f0ac40c7700 2023-12-01T23:18:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.041+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac41f0010 con 0x7f0ac40c7700 2023-12-01T23:18:15.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.043+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac41463c0 con 0x7f0ac40c7700 2023-12-01T23:18:15.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.067+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f0ab8007bd0 con 0x7f0ac40c7700 2023-12-01T23:18:15.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.067+0000 7f0aabfff640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 0x7f0ab006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:15.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.068+0000 7f0ac37fe640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 0x7f0ab006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:15.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.068+0000 7f0ac37fe640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 0x7f0ab006d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4036000 tx=0x7f0ab4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:15.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.070+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4846+0+0 (secure 0 0 0) 0x7f0ab8058750 con 0x7f0ac40c7700 2023-12-01T23:18:15.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.328+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ab8054a90 con 0x7f0ac40c7700 2023-12-01T23:18:15.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.587+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ac41f0200 con 0x7f0ac40c7700 2023-12-01T23:18:15.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.615+0000 7f0aabfff640 1 -- 172.21.15.96:0/734712051 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f0ab801e070 con 0x7f0ac40c7700 2023-12-01T23:18:15.616 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:15.616 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-01T23:18:15.617 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 1 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 msgr2=0x7f0ab006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 0x7f0ab006d2c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4036000 tx=0x7f0ab4030000 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 msgr2=0x7f0ac4144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800c7f0 tx=0x7f0ab800ccb0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 shutdown_connections 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0ab006ae00 0x7f0ab006d2c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.617+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac41504e0 0x7f0ac4156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.618+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac40c7700 0x7f0ac4144760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.618+0000 7f0ac9fd0640 1 --2- 172.21.15.96:0/734712051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac40c7190 0x7f0ac41f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:15.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.618+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 >> 172.21.15.96:0/734712051 conn(0x7f0ac40cbef0 msgr2=0x7f0ac406df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.618+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 shutdown_connections 2023-12-01T23:18:15.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:15.618+0000 7f0ac9fd0640 1 -- 172.21.15.96:0/734712051 wait complete. 2023-12-01T23:18:17.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.792+0000 7f3b25b4c640 1 Processor -- start 2023-12-01T23:18:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.792+0000 7f3b25b4c640 1 -- start start 2023-12-01T23:18:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.793+0000 7f3b25b4c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b20153890 0x7f3b2015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.793+0000 7f3b25b4c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.793+0000 7f3b25b4c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2015a700 con 0x7f3b200ceef0 2023-12-01T23:18:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.793+0000 7f3b25b4c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200ca870 con 0x7f3b20153890 2023-12-01T23:18:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.793+0000 7f3b25b4c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20159af0 con 0x7f3b20153c70 2023-12-01T23:18:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.794+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.794+0000 7f3b1f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b20153890 0x7f3b2015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.794+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:48736/0 (socket says 172.21.15.96:48736) 2023-12-01T23:18:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.794+0000 7f3b1effd640 1 -- 172.21.15.96:0/4268305414 learned_addr learned my addr 172.21.15.96:0/4268305414 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.797+0000 7f3b1effd640 1 -- 172.21.15.96:0/4268305414 >> v2:172.21.15.102:3300/0 conn(0x7f3b20153890 msgr2=0x7f3b2015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.797+0000 7f3b1effd640 1 --2- 172.21.15.96:0/4268305414 >> v2:172.21.15.102:3300/0 conn(0x7f3b20153890 0x7f3b2015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.797+0000 7f3b1effd640 1 -- 172.21.15.96:0/4268305414 >> v1:172.21.15.96:6789/0 conn(0x7f3b200ceef0 legacy=0x7f3b2015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.797+0000 7f3b1effd640 1 -- 172.21.15.96:0/4268305414 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20159dd0 con 0x7f3b20153c70 2023-12-01T23:18:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.799+0000 7f3b1effd640 1 --2- 172.21.15.96:0/4268305414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009870 tx=0x7f3b1402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1efef4166c9a7373 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:17.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.802+0000 7f3b1e7fc640 1 -- 172.21.15.96:0/4268305414 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1402f840 con 0x7f3b20153c70 2023-12-01T23:18:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.804+0000 7f3b1e7fc640 1 -- 172.21.15.96:0/4268305414 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1402f9a0 con 0x7f3b20153c70 2023-12-01T23:18:17.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.804+0000 7f3b1e7fc640 1 -- 172.21.15.96:0/4268305414 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1402fd30 con 0x7f3b20153c70 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 -- 172.21.15.96:0/4268305414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 msgr2=0x7f3b200c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/4268305414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009870 tx=0x7f3b1402ba20 comp rx=0 tx=0).stop 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 -- 172.21.15.96:0/4268305414 shutdown_connections 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/4268305414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b200c9fe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/4268305414 >> v2:172.21.15.102:3300/0 conn(0x7f3b20153890 0x7f3b2015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 -- 172.21.15.96:0/4268305414 >> 172.21.15.96:0/4268305414 conn(0x7f3b2006ba00 msgr2=0x7f3b2006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:17.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 -- 172.21.15.96:0/4268305414 shutdown_connections 2023-12-01T23:18:17.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.805+0000 7f3b25b4c640 1 -- 172.21.15.96:0/4268305414 wait complete. 2023-12-01T23:18:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.807+0000 7f3b25b4c640 1 Processor -- start 2023-12-01T23:18:17.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.807+0000 7f3b25b4c640 1 -- start start 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.808+0000 7f3b25b4c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b200ceef0 0x7f3b2014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.808+0000 7f3b25b4c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b20153890 0x7f3b20151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.808+0000 7f3b25b4c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.808+0000 7f3b25b4c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20153150 con 0x7f3b200ceef0 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.808+0000 7f3b25b4c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2014e5d0 con 0x7f3b20153890 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.809+0000 7f3b25b4c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200b4a30 con 0x7f3b20153c70 2023-12-01T23:18:17.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.809+0000 7f3b1ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.809+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b20153890 0x7f3b20151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.809+0000 7f3b1ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:48738/0 (socket says 172.21.15.96:48738) 2023-12-01T23:18:17.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.809+0000 7f3b1ffff640 1 -- 172.21.15.96:0/607818264 learned_addr learned my addr 172.21.15.96:0/607818264 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:17.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.810+0000 7f3b1f7fe640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b200ceef0 0x7f3b2014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.813+0000 7f3b1ffff640 1 -- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b20153890 msgr2=0x7f3b20151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.813+0000 7f3b1ffff640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b20153890 0x7f3b20151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.813+0000 7f3b1ffff640 1 -- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b200ceef0 msgr2=0x7f3b2014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.813+0000 7f3b1ffff640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b200ceef0 0x7f3b2014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:17.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.813+0000 7f3b1ffff640 1 -- 172.21.15.96:0/607818264 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140094d0 con 0x7f3b20153c70 2023-12-01T23:18:17.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.816+0000 7f3b1ffff640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7a0 tx=0x7f3b1800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.820+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18003b70 con 0x7f3b20153c70 2023-12-01T23:18:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.820+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b18003cf0 con 0x7f3b20153c70 2023-12-01T23:18:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.820+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b200b4d10 con 0x7f3b20153c70 2023-12-01T23:18:17.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.820+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b18003ea0 con 0x7f3b20153c70 2023-12-01T23:18:17.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.821+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b20152de0 con 0x7f3b20153c70 2023-12-01T23:18:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.823+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20067500 con 0x7f3b20153c70 2023-12-01T23:18:17.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.855+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f3b1800aa90 con 0x7f3b20153c70 2023-12-01T23:18:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.856+0000 7f3b07fff640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 0x7f3b0c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.856+0000 7f3b1f7fe640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 0x7f3b0c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:17.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:17.857+0000 7f3b1f7fe640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 0x7f3b0c06d2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009b40 tx=0x7f3b10009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:18.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.114+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3b18058b50 con 0x7f3b20153c70 2023-12-01T23:18:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.136+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b18054e90 con 0x7f3b20153c70 2023-12-01T23:18:18.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.369+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b201571c0 con 0x7f3b20153c70 2023-12-01T23:18:18.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.444+0000 7f3b07fff640 1 -- 172.21.15.96:0/607818264 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3b180584b0 con 0x7f3b20153c70 2023-12-01T23:18:18.446 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:18.446 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-01T23:18:18.446 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 1 2023-12-01T23:18:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.446+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 msgr2=0x7f3b0c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.446+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 0x7f3b0c06d2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009b40 tx=0x7f3b10009190 comp rx=0 tx=0).stop 2023-12-01T23:18:18.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.446+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 msgr2=0x7f3b201521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.446+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7a0 tx=0x7f3b1800cc60 comp rx=0 tx=0).stop 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 shutdown_connections 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3b0c06ae30 0x7f3b0c06d2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b20153c70 0x7f3b201521d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b20153890 0x7f3b20151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:18.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 --2- 172.21.15.96:0/607818264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b200ceef0 0x7f3b2014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:18.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 >> 172.21.15.96:0/607818264 conn(0x7f3b2006ba00 msgr2=0x7f3b2015aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:18.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 shutdown_connections 2023-12-01T23:18:18.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:18.447+0000 7f3b25b4c640 1 -- 172.21.15.96:0/607818264 wait complete. 2023-12-01T23:18:20.294 INFO:tasks.ceph.mds.f.smithi102.stdout:starting mds.f at 2023-12-01T23:18:20.379 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2023-12-01T23:18:20.427 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2023-12-01T23:18:20.463 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:20.464 INFO:tasks.ceph.mds.e.smithi096.stdout:starting mds.e at 2023-12-01T23:18:20.488 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2023-12-01T23:18:20.508 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2023-12-01T23:18:20.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.568+0000 7f77b5490640 1 Processor -- start 2023-12-01T23:18:20.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.568+0000 7f77b5490640 1 -- start start 2023-12-01T23:18:20.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.569+0000 7f77b5490640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77b01402b0 0x7f77b0157db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.569+0000 7f77b5490640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00c4cc0 0x7f77b00c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.569+0000 7f77b5490640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b01582f0 con 0x7f77b00727c0 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.569+0000 7f77b5490640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b0061640 con 0x7f77b01402b0 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.569+0000 7f77b5490640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0072580 con 0x7f77b00c4cc0 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.570+0000 7f77aeffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77b01402b0 0x7f77b0157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.570+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00c4cc0 0x7f77b00c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.570+0000 7f77a67fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f77b00727c0 0x7f77b006af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:53776/0 (socket says 172.21.15.96:53776) 2023-12-01T23:18:20.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.570+0000 7f77a67fc640 1 -- 172.21.15.96:0/3637751424 learned_addr learned my addr 172.21.15.96:0/3637751424 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.572+0000 7f77ae7fc640 1 -- 172.21.15.96:0/3637751424 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330216668 0 0) 0x7f77b01582f0 con 0x7f77b00727c0 2023-12-01T23:18:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.572+0000 7f77ae7fc640 1 -- 172.21.15.96:0/3637751424 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f779c003520 con 0x7f77b00727c0 2023-12-01T23:18:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.573+0000 7f77aeffd640 1 -- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00c4cc0 msgr2=0x7f77b00c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:20.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.573+0000 7f77aeffd640 1 --2- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00c4cc0 0x7f77b00c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.573+0000 7f77aeffd640 1 -- 172.21.15.96:0/3637751424 >> v1:172.21.15.96:6789/0 conn(0x7f77b00727c0 legacy=0x7f77b006af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:20.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.573+0000 7f77aeffd640 1 -- 172.21.15.96:0/3637751424 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0061360 con 0x7f77b01402b0 2023-12-01T23:18:20.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.578+0000 7f77aeffd640 1 --2- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0157db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77a00097d0 tx=0x7f77a002b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a293ecc2b102fb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:20.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.587+0000 7f77ae7fc640 1 -- 172.21.15.96:0/3637751424 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0031890 con 0x7f77b01402b0 2023-12-01T23:18:20.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77ae7fc640 1 -- 172.21.15.96:0/3637751424 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a00319f0 con 0x7f77b01402b0 2023-12-01T23:18:20.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77ae7fc640 1 -- 172.21.15.96:0/3637751424 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0031d80 con 0x7f77b01402b0 2023-12-01T23:18:20.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 -- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 msgr2=0x7f77b0157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:20.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 --2- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0157db0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77a00097d0 tx=0x7f77a002b930 comp rx=0 tx=0).stop 2023-12-01T23:18:20.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 -- 172.21.15.96:0/3637751424 shutdown_connections 2023-12-01T23:18:20.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 --2- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00c4cc0 0x7f77b00c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:20.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 --2- 172.21.15.96:0/3637751424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0157db0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:20.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 -- 172.21.15.96:0/3637751424 >> 172.21.15.96:0/3637751424 conn(0x7f77b00c80b0 msgr2=0x7f77b00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:20.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 -- 172.21.15.96:0/3637751424 shutdown_connections 2023-12-01T23:18:20.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.588+0000 7f77b5490640 1 -- 172.21.15.96:0/3637751424 wait complete. 2023-12-01T23:18:20.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.590+0000 7f77b5490640 1 Processor -- start 2023-12-01T23:18:20.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.590+0000 7f77b5490640 1 -- start start 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00727c0 0x7f77b0152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b8770 con 0x7f77b00c4cc0 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b9330 con 0x7f77b01402b0 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77b5490640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b79d0 con 0x7f77b00727c0 2023-12-01T23:18:20.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77a67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77a67fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46062/0 (socket says 172.21.15.96:46062) 2023-12-01T23:18:20.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.591+0000 7f77a67fc640 1 -- 172.21.15.96:0/3237811933 learned_addr learned my addr 172.21.15.96:0/3237811933 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:20.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.594+0000 7f77aeffd640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00727c0 0x7f77b0152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.595+0000 7f77a67fc640 1 -- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00727c0 msgr2=0x7f77b0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.595+0000 7f77a67fc640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00727c0 0x7f77b0152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.595+0000 7f77a67fc640 1 -- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 msgr2=0x7f77b0150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.595+0000 7f77a67fc640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:20.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.595+0000 7f77a67fc640 1 -- 172.21.15.96:0/3237811933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009400 con 0x7f77b00c4cc0 2023-12-01T23:18:20.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.598+0000 7f77a67fc640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f779800c430 tx=0x7f779800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:20.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.601+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798005ce0 con 0x7f77b00c4cc0 2023-12-01T23:18:20.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.601+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798005e40 con 0x7f77b00c4cc0 2023-12-01T23:18:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.601+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980072d0 con 0x7f77b00c4cc0 2023-12-01T23:18:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.601+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00b7f20 con 0x7f77b00c4cc0 2023-12-01T23:18:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.601+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b0153c80 con 0x7f77b00c4cc0 2023-12-01T23:18:20.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.603+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00b7ca0 con 0x7f77b00c4cc0 2023-12-01T23:18:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.629+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77980074f0 con 0x7f77b00c4cc0 2023-12-01T23:18:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.629+0000 7f77a7fff640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 0x7f779006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:20.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.630+0000 7f77aeffd640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 0x7f779006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:20.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.630+0000 7f77aeffd640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 0x7f779006d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77a0036000 tx=0x7f77a003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:20.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.632+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77980581b0 con 0x7f77b00c4cc0 2023-12-01T23:18:20.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:20.930+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77980544f0 con 0x7f77b00c4cc0 2023-12-01T23:18:21.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.175+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77b00740e0 con 0x7f77b00c4cc0 2023-12-01T23:18:21.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.188+0000 7f77a7fff640 1 -- 172.21.15.96:0/3237811933 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f7798021090 con 0x7f77b00c4cc0 2023-12-01T23:18:21.189 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:21.189 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-01T23:18:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2023-12-01T23:18:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 msgr2=0x7f779006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 0x7f779006d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77a0036000 tx=0x7f77a003c040 comp rx=0 tx=0).stop 2023-12-01T23:18:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 msgr2=0x7f77b00b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f779800c430 tx=0x7f779800c8f0 comp rx=0 tx=0).stop 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 shutdown_connections 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f779006ae40 0x7f779006d300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77b01402b0 0x7f77b0150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77b00c4cc0 0x7f77b00b7490 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 --2- 172.21.15.96:0/3237811933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77b00727c0 0x7f77b0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 >> 172.21.15.96:0/3237811933 conn(0x7f77b00c80b0 msgr2=0x7f77b00c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 shutdown_connections 2023-12-01T23:18:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:21.190+0000 7f77b5490640 1 -- 172.21.15.96:0/3237811933 wait complete. 2023-12-01T23:18:23.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:23.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 Processor -- start 2023-12-01T23:18:23.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 -- start start 2023-12-01T23:18:23.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f68700c61a0 0x7f6870162c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687015b6e0 con 0x7f68700728b0 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687015a880 con 0x7f6870151510 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.302+0000 7f6875b25640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687006f7e0 con 0x7f68700c61a0 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.303+0000 7f686ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f68700c61a0 0x7f6870162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.303+0000 7f686f7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6870151510 0x7f68700cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:57302/0 (socket says 172.21.15.96:57302) 2023-12-01T23:18:23.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.303+0000 7f686f7fe640 1 -- 172.21.15.96:0/2886887845 learned_addr learned my addr 172.21.15.96:0/2886887845 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.306+0000 7f686e7fc640 1 -- 172.21.15.96:0/2886887845 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778857889 0 0) 0x7f687015a880 con 0x7f6870151510 2023-12-01T23:18:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.306+0000 7f686e7fc640 1 -- 172.21.15.96:0/2886887845 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6858003520 con 0x7f6870151510 2023-12-01T23:18:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.306+0000 7f686ffff640 1 -- 172.21.15.96:0/2886887845 >> v1:172.21.15.102:6789/0 conn(0x7f6870151510 legacy=0x7f68700cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.306+0000 7f686ffff640 1 -- 172.21.15.96:0/2886887845 >> v1:172.21.15.96:6789/0 conn(0x7f68700728b0 legacy=0x7f68700c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.306+0000 7f686ffff640 1 -- 172.21.15.96:0/2886887845 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687015aad0 con 0x7f68700c61a0 2023-12-01T23:18:23.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.309+0000 7f686ffff640 1 --2- 172.21.15.96:0/2886887845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68700c61a0 0x7f6870162c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cbddd373731cc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.314+0000 7f686e7fc640 1 -- 172.21.15.96:0/2886887845 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686802cd00 con 0x7f68700c61a0 2023-12-01T23:18:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.314+0000 7f686e7fc640 1 -- 172.21.15.96:0/2886887845 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686802ce60 con 0x7f68700c61a0 2023-12-01T23:18:23.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.314+0000 7f686e7fc640 1 -- 172.21.15.96:0/2886887845 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868034660 con 0x7f68700c61a0 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 -- 172.21.15.96:0/2886887845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68700c61a0 msgr2=0x7f6870162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 --2- 172.21.15.96:0/2886887845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68700c61a0 0x7f6870162c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802bf50 comp rx=0 tx=0).stop 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 -- 172.21.15.96:0/2886887845 shutdown_connections 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 --2- 172.21.15.96:0/2886887845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68700c61a0 0x7f6870162c20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 -- 172.21.15.96:0/2886887845 >> 172.21.15.96:0/2886887845 conn(0x7f687006cd60 msgr2=0x7f687006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 -- 172.21.15.96:0/2886887845 shutdown_connections 2023-12-01T23:18:23.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.315+0000 7f6875b25640 1 -- 172.21.15.96:0/2886887845 wait complete. 2023-12-01T23:18:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.316+0000 7f6875b25640 1 Processor -- start 2023-12-01T23:18:23.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 -- start start 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68700728b0 0x7f6870156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68700c61a0 0x7f6870159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700c4fd0 con 0x7f6870151510 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68700c4d30 con 0x7f68700c61a0 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.317+0000 7f6875b25640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68700c0ec0 con 0x7f68700728b0 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.318+0000 7f686ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.318+0000 7f686ffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46098/0 (socket says 172.21.15.96:46098) 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.318+0000 7f686ffff640 1 -- 172.21.15.96:0/2089314527 learned_addr learned my addr 172.21.15.96:0/2089314527 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.318+0000 7f686f7fe640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68700728b0 0x7f6870156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.318+0000 7f686effd640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68700c61a0 0x7f6870159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.321+0000 7f686ffff640 1 -- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68700728b0 msgr2=0x7f6870156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.321+0000 7f686ffff640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68700728b0 0x7f6870156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.321+0000 7f686ffff640 1 -- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68700c61a0 msgr2=0x7f6870159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.321+0000 7f686ffff640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68700c61a0 0x7f6870159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.321+0000 7f686ffff640 1 -- 172.21.15.96:0/2089314527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009a70 con 0x7f6870151510 2023-12-01T23:18:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.323+0000 7f686ffff640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f6868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.327+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686803d600 con 0x7f6870151510 2023-12-01T23:18:23.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.327+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686803d780 con 0x7f6870151510 2023-12-01T23:18:23.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.327+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68700c11a0 con 0x7f6870151510 2023-12-01T23:18:23.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.327+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686803db30 con 0x7f6870151510 2023-12-01T23:18:23.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.327+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68700c1760 con 0x7f6870151510 2023-12-01T23:18:23.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.328+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870067500 con 0x7f6870151510 2023-12-01T23:18:23.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.346+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f686803b040 con 0x7f6870151510 2023-12-01T23:18:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.347+0000 7f6857fff640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 0x7f685c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.347+0000 7f686f7fe640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 0x7f685c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.347+0000 7f686f7fe640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 0x7f685c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68600011e0 tx=0x7f6860007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.584+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f686807aee0 con 0x7f6870151510 2023-12-01T23:18:23.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.584+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6868077220 con 0x7f6870151510 2023-12-01T23:18:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.787+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68700c9f40 con 0x7f6870151510 2023-12-01T23:18:23.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.807+0000 7f6857fff640 1 -- 172.21.15.96:0/2089314527 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5283 (secure 0 0 0) 0x7f686804e090 con 0x7f6870151510 2023-12-01T23:18:23.809 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:23.809 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4255,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-01T23:18:23.809 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 msgr2=0x7f685c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 0x7f685c06d350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68600011e0 tx=0x7f6860007d30 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 msgr2=0x7f68701eec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f6868004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 shutdown_connections 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f685c06ae90 0x7f685c06d350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6870151510 0x7f68701eec60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68700c61a0 0x7f6870159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 --2- 172.21.15.96:0/2089314527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68700728b0 0x7f6870156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 >> 172.21.15.96:0/2089314527 conn(0x7f687006cd60 msgr2=0x7f6870073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:23.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 shutdown_connections 2023-12-01T23:18:23.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.810+0000 7f6875b25640 1 -- 172.21.15.96:0/2089314527 wait complete. 2023-12-01T23:18:23.821 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.920+0000 7f1081d48640 1 Processor -- start 2023-12-01T23:18:23.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.920+0000 7f1081d48640 1 -- start start 2023-12-01T23:18:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0c9dd0 0x7f107c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f107c0ca1b0 0x7f107c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f107c06f590 0x7f107c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c1596a0 con 0x7f107c0ca1b0 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c15cc90 con 0x7f107c06f590 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.921+0000 7f1081d48640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0c7c40 con 0x7f107c0c9dd0 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.922+0000 7f107affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f107c0ca1b0 0x7f107c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.922+0000 7f107b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0c9dd0 0x7f107c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.922+0000 7f107bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f107c06f590 0x7f107c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.922+0000 7f107affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f107c0ca1b0 0x7f107c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46106/0 (socket says 172.21.15.96:46106) 2023-12-01T23:18:23.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.922+0000 7f107affd640 1 -- 172.21.15.96:0/2805319466 learned_addr learned my addr 172.21.15.96:0/2805319466 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:23.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.924+0000 7f107affd640 1 -- 172.21.15.96:0/2805319466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0c9dd0 msgr2=0x7f107c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:23.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.924+0000 7f107affd640 1 --2- 172.21.15.96:0/2805319466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0c9dd0 0x7f107c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.924+0000 7f107affd640 1 -- 172.21.15.96:0/2805319466 >> v2:172.21.15.102:3300/0 conn(0x7f107c06f590 msgr2=0x7f107c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:23.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.924+0000 7f107affd640 1 --2- 172.21.15.96:0/2805319466 >> v2:172.21.15.102:3300/0 conn(0x7f107c06f590 0x7f107c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.924+0000 7f107affd640 1 -- 172.21.15.96:0/2805319466 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c1598b0 con 0x7f107c0ca1b0 2023-12-01T23:18:23.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.926+0000 7f107affd640 1 --2- 172.21.15.96:0/2805319466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0ca1b0 0x7f107c15d120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f107c06d7c0 tx=0x7f107002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39996d01a92246f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.930+0000 7f107a7fc640 1 -- 172.21.15.96:0/2805319466 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070030860 con 0x7f107c0ca1b0 2023-12-01T23:18:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.930+0000 7f107a7fc640 1 -- 172.21.15.96:0/2805319466 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10700309c0 con 0x7f107c0ca1b0 2023-12-01T23:18:23.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.930+0000 7f107a7fc640 1 -- 172.21.15.96:0/2805319466 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070030d50 con 0x7f107c0ca1b0 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.930+0000 7f1081d48640 1 -- 172.21.15.96:0/2805319466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0ca1b0 msgr2=0x7f107c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.930+0000 7f1081d48640 1 --2- 172.21.15.96:0/2805319466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0ca1b0 0x7f107c15d120 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f107c06d7c0 tx=0x7f107002b9a0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 -- 172.21.15.96:0/2805319466 shutdown_connections 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 --2- 172.21.15.96:0/2805319466 >> v2:172.21.15.102:3300/0 conn(0x7f107c06f590 0x7f107c15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 --2- 172.21.15.96:0/2805319466 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0ca1b0 0x7f107c15d120 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 --2- 172.21.15.96:0/2805319466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0c9dd0 0x7f107c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 -- 172.21.15.96:0/2805319466 >> 172.21.15.96:0/2805319466 conn(0x7f107c061100 msgr2=0x7f107c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 -- 172.21.15.96:0/2805319466 shutdown_connections 2023-12-01T23:18:23.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.931+0000 7f1081d48640 1 -- 172.21.15.96:0/2805319466 wait complete. 2023-12-01T23:18:23.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.932+0000 7f1081d48640 1 Processor -- start 2023-12-01T23:18:23.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.932+0000 7f1081d48640 1 -- start start 2023-12-01T23:18:23.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f107c06f590 0x7f107c0ad500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0ca1b0 0x7f107c1f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0ae2c0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c1ef730 con 0x7f107c06f590 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f1081d48640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0c5660 con 0x7f107c0ca1b0 2023-12-01T23:18:23.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f107affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f107bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0ca1b0 0x7f107c1f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.933+0000 7f107b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f107c06f590 0x7f107c0ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.934+0000 7f107affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46120/0 (socket says 172.21.15.96:46120) 2023-12-01T23:18:23.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.934+0000 7f107affd640 1 -- 172.21.15.96:0/761775723 learned_addr learned my addr 172.21.15.96:0/761775723 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.937+0000 7f107affd640 1 -- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0ca1b0 msgr2=0x7f107c1f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.937+0000 7f107affd640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0ca1b0 0x7f107c1f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.937+0000 7f107affd640 1 -- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f107c06f590 msgr2=0x7f107c0ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.937+0000 7f107affd640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f107c06f590 0x7f107c0ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:23.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.937+0000 7f107affd640 1 -- 172.21.15.96:0/761775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700094d0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.939+0000 7f107affd640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1070009960 tx=0x7f10700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.944+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107003e070 con 0x7f107c0c9dd0 2023-12-01T23:18:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.944+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070039a10 con 0x7f107c0c9dd0 2023-12-01T23:18:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.944+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c1efbc0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.944+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070039da0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.944+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c1eee00 con 0x7f107c0c9dd0 2023-12-01T23:18:23.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.945+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c0740e0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.963+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10700423f0 con 0x7f107c0c9dd0 2023-12-01T23:18:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.964+0000 7f1063fff640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.964+0000 7f107b7fe640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:23.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.964+0000 7f107b7fe640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 0x7f106806d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f106c009b40 tx=0x7f106c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:23.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:23.970+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f107007a6c0 con 0x7f107c0c9dd0 2023-12-01T23:18:24.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.218+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1070076a00 con 0x7f107c0c9dd0 2023-12-01T23:18:24.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.392+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f107c158a20 con 0x7f107c0c9dd0 2023-12-01T23:18:24.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.471+0000 7f1063fff640 1 -- 172.21.15.96:0/761775723 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f1070048090 con 0x7f107c0c9dd0 2023-12-01T23:18:24.472 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:24.472 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:17.000254+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 msgr2=0x7f106806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 0x7f106806d350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f106c009b40 tx=0x7f106c009190 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 msgr2=0x7f107c1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1070009960 tx=0x7f10700046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 shutdown_connections 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f107c0ca1b0 0x7f107c1f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f107c0c9dd0 0x7f107c1558f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 --2- 172.21.15.96:0/761775723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f107c06f590 0x7f107c0ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 >> 172.21.15.96:0/761775723 conn(0x7f107c061100 msgr2=0x7f107c158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 shutdown_connections 2023-12-01T23:18:24.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.473+0000 7f1081d48640 1 -- 172.21.15.96:0/761775723 wait complete. 2023-12-01T23:18:24.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T23:18:24.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:18:24.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.586+0000 7f8e17f39640 1 Processor -- start 2023-12-01T23:18:24.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.587+0000 7f8e17f39640 1 -- start start 2023-12-01T23:18:24.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.587+0000 7f8e17f39640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e100cd6a0 0x7f8e100c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:24.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.587+0000 7f8e17f39640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1006f870 con 0x7f8e100ca0c0 2023-12-01T23:18:24.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.587+0000 7f8e17f39640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e100cdaf0 con 0x7f8e101537e0 2023-12-01T23:18:24.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.587+0000 7f8e17f39640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e10159600 con 0x7f8e100cd6a0 2023-12-01T23:18:24.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.588+0000 7f8e164d6640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8e100ca0c0 0x7f8e10159a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:53808/0 (socket says 172.21.15.96:53808) 2023-12-01T23:18:24.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.588+0000 7f8e164d6640 1 -- 172.21.15.96:0/282438208 learned_addr learned my addr 172.21.15.96:0/282438208 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:24.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.588+0000 7f8e154d4640 1 --2- 172.21.15.96:0/282438208 >> v2:172.21.15.102:3300/0 conn(0x7f8e100cd6a0 0x7f8e100c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:24.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.590+0000 7f8e14cd3640 1 -- 172.21.15.96:0/282438208 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028098888 0 0) 0x7f8e1006f870 con 0x7f8e100ca0c0 2023-12-01T23:18:24.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.590+0000 7f8e14cd3640 1 -- 172.21.15.96:0/282438208 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dfc003520 con 0x7f8e100ca0c0 2023-12-01T23:18:24.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.591+0000 7f8e154d4640 1 -- 172.21.15.96:0/282438208 >> v1:172.21.15.102:6789/0 conn(0x7f8e101537e0 legacy=0x7f8e100c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:24.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.591+0000 7f8e154d4640 1 -- 172.21.15.96:0/282438208 >> v1:172.21.15.96:6789/0 conn(0x7f8e100ca0c0 legacy=0x7f8e10159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.591+0000 7f8e154d4640 1 -- 172.21.15.96:0/282438208 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1015cd90 con 0x7f8e100cd6a0 2023-12-01T23:18:24.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.594+0000 7f8e154d4640 1 --2- 172.21.15.96:0/282438208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e100c9b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097a0 tx=0x7f8e0002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27124a67a75d23cb server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:24.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.596+0000 7f8e14cd3640 1 -- 172.21.15.96:0/282438208 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00030610 con 0x7f8e100cd6a0 2023-12-01T23:18:24.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e14cd3640 1 -- 172.21.15.96:0/282438208 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e00030770 con 0x7f8e100cd6a0 2023-12-01T23:18:24.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e14cd3640 1 -- 172.21.15.96:0/282438208 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e00030ae0 con 0x7f8e100cd6a0 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 -- 172.21.15.96:0/282438208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 msgr2=0x7f8e100c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 --2- 172.21.15.96:0/282438208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e100c9b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e000097a0 tx=0x7f8e0002b960 comp rx=0 tx=0).stop 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 -- 172.21.15.96:0/282438208 shutdown_connections 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 --2- 172.21.15.96:0/282438208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e100c9b80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 -- 172.21.15.96:0/282438208 >> 172.21.15.96:0/282438208 conn(0x7f8e10061100 msgr2=0x7f8e100614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 -- 172.21.15.96:0/282438208 shutdown_connections 2023-12-01T23:18:24.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.598+0000 7f8e17f39640 1 -- 172.21.15.96:0/282438208 wait complete. 2023-12-01T23:18:24.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.599+0000 7f8e17f39640 1 Processor -- start 2023-12-01T23:18:24.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.599+0000 7f8e17f39640 1 -- start start 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e100ca0c0 0x7f8e100c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e101ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100cc800 con 0x7f8e101537e0 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e101f31f0 con 0x7f8e100cd6a0 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e17f39640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100cbbf0 con 0x7f8e100ca0c0 2023-12-01T23:18:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.600+0000 7f8e164d6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.601+0000 7f8e154d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e101ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.601+0000 7f8e164d6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46132/0 (socket says 172.21.15.96:46132) 2023-12-01T23:18:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.601+0000 7f8e164d6640 1 -- 172.21.15.96:0/4058378061 learned_addr learned my addr 172.21.15.96:0/4058378061 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:24.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.601+0000 7f8e15cd5640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e100ca0c0 0x7f8e100c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e164d6640 1 -- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e100ca0c0 msgr2=0x7f8e100c25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e164d6640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e100ca0c0 0x7f8e100c25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e164d6640 1 -- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 msgr2=0x7f8e101ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e164d6640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e101ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e164d6640 1 -- 172.21.15.96:0/4058378061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00009400 con 0x7f8e101537e0 2023-12-01T23:18:24.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.604+0000 7f8e154d4640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e101ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:18:24.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.606+0000 7f8e164d6640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c390 tx=0x7f8e0800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:24.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.608+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08005ce0 con 0x7f8e101537e0 2023-12-01T23:18:24.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.608+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100cbed0 con 0x7f8e101537e0 2023-12-01T23:18:24.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.608+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e100cc490 con 0x7f8e101537e0 2023-12-01T23:18:24.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.610+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100740e0 con 0x7f8e101537e0 2023-12-01T23:18:24.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.610+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08005e40 con 0x7f8e101537e0 2023-12-01T23:18:24.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.610+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007ea0 con 0x7f8e101537e0 2023-12-01T23:18:24.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.863+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e08007330 con 0x7f8e101537e0 2023-12-01T23:18:24.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.863+0000 7f8e067fc640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 0x7f8df406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:24.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.863+0000 7f8e15cd5640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 0x7f8df406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:24.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.864+0000 7f8e15cd5640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 0x7f8df406d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005660 tx=0x7f8e0c003d90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.878+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e08058180 con 0x7f8e101537e0 2023-12-01T23:18:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:24.878+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e080544c0 con 0x7f8e101537e0 2023-12-01T23:18:25.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.054+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e101eee50 con 0x7f8e101537e0 2023-12-01T23:18:25.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.074+0000 7f8e067fc640 1 -- 172.21.15.96:0/4058378061 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e08021020 con 0x7f8e101537e0 2023-12-01T23:18:25.075 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:18:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 msgr2=0x7f8df406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 0x7f8df406d300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005660 tx=0x7f8e0c003d90 comp rx=0 tx=0).stop 2023-12-01T23:18:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 msgr2=0x7f8e101ef6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c390 tx=0x7f8e0800c850 comp rx=0 tx=0).stop 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 shutdown_connections 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8df406ae40 0x7f8df406d300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e101537e0 0x7f8e101ef6e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e100cd6a0 0x7f8e101ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 --2- 172.21.15.96:0/4058378061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e100ca0c0 0x7f8e100c25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 >> 172.21.15.96:0/4058378061 conn(0x7f8e10061100 msgr2=0x7f8e10151430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 shutdown_connections 2023-12-01T23:18:25.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.076+0000 7f8e17f39640 1 -- 172.21.15.96:0/4058378061 wait complete. 2023-12-01T23:18:25.088 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-01T23:18:25.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.186+0000 7f31e5b00640 1 Processor -- start 2023-12-01T23:18:25.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.186+0000 7f31e5b00640 1 -- start start 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.187+0000 7f31e5b00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f31e0153710 0x7f31e006d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.187+0000 7f31e5b00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31e00c44a0 0x7f31e00c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.187+0000 7f31e5b00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e006def0 con 0x7f31e015a000 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.187+0000 7f31e5b00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e006e1d0 con 0x7f31e00c44a0 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.187+0000 7f31e5b00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e006e4b0 con 0x7f31e0153710 2023-12-01T23:18:25.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.188+0000 7f31dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31e00c44a0 0x7f31e00c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.188+0000 7f31df7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f31e0153710 0x7f31e006d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.188+0000 7f31dffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f31e00c44a0 0x7f31e00c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46140/0 (socket says 172.21.15.96:46140) 2023-12-01T23:18:25.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.188+0000 7f31dffff640 1 -- 172.21.15.96:0/3969264823 learned_addr learned my addr 172.21.15.96:0/3969264823 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:25.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.190+0000 7f31dffff640 1 -- 172.21.15.96:0/3969264823 >> v2:172.21.15.102:3300/0 conn(0x7f31e0153710 msgr2=0x7f31e006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:25.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.190+0000 7f31dffff640 1 --2- 172.21.15.96:0/3969264823 >> v2:172.21.15.102:3300/0 conn(0x7f31e0153710 0x7f31e006d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.190+0000 7f31dffff640 1 -- 172.21.15.96:0/3969264823 >> v1:172.21.15.102:6789/0 conn(0x7f31e015a000 legacy=0x7f31e00cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.191+0000 7f31dffff640 1 -- 172.21.15.96:0/3969264823 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00c3ca0 con 0x7f31e00c44a0 2023-12-01T23:18:25.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.193+0000 7f31dffff640 1 --2- 172.21.15.96:0/3969264823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e00c44a0 0x7f31e00c48a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31e0067c10 tx=0x7f31d802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9a82067333efa server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.196+0000 7f31de7fc640 1 -- 172.21.15.96:0/3969264823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d802cb20 con 0x7f31e00c44a0 2023-12-01T23:18:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.196+0000 7f31de7fc640 1 -- 172.21.15.96:0/3969264823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d802cc80 con 0x7f31e00c44a0 2023-12-01T23:18:25.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.196+0000 7f31de7fc640 1 -- 172.21.15.96:0/3969264823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80343f0 con 0x7f31e00c44a0 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 -- 172.21.15.96:0/3969264823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e00c44a0 msgr2=0x7f31e00c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 --2- 172.21.15.96:0/3969264823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e00c44a0 0x7f31e00c48a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31e0067c10 tx=0x7f31d802bf80 comp rx=0 tx=0).stop 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 -- 172.21.15.96:0/3969264823 shutdown_connections 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 --2- 172.21.15.96:0/3969264823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e00c44a0 0x7f31e00c48a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 --2- 172.21.15.96:0/3969264823 >> v2:172.21.15.102:3300/0 conn(0x7f31e0153710 0x7f31e006d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 -- 172.21.15.96:0/3969264823 >> 172.21.15.96:0/3969264823 conn(0x7f31e0071410 msgr2=0x7f31e006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 -- 172.21.15.96:0/3969264823 shutdown_connections 2023-12-01T23:18:25.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.197+0000 7f31e5b00640 1 -- 172.21.15.96:0/3969264823 wait complete. 2023-12-01T23:18:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.198+0000 7f31e5b00640 1 Processor -- start 2023-12-01T23:18:25.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.198+0000 7f31e5b00640 1 -- start start 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 0x7f31e015d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 0x7f31e00c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31e015a000 0x7f31e00c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00c7280 con 0x7f31e0153710 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015c790 con 0x7f31e00c44a0 2023-12-01T23:18:25.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31e5b00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01f2680 con 0x7f31e015a000 2023-12-01T23:18:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.199+0000 7f31deffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 0x7f31e00c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.200+0000 7f31df7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 0x7f31e015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.200+0000 7f31dffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31e015a000 0x7f31e00c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.200+0000 7f31deffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 0x7f31e00c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46154/0 (socket says 172.21.15.96:46154) 2023-12-01T23:18:25.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.200+0000 7f31deffd640 1 -- 172.21.15.96:0/319262090 learned_addr learned my addr 172.21.15.96:0/319262090 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.203+0000 7f31df7fe640 1 -- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31e015a000 msgr2=0x7f31e00c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.203+0000 7f31df7fe640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31e015a000 0x7f31e00c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.203+0000 7f31df7fe640 1 -- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 msgr2=0x7f31e00c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.203+0000 7f31df7fe640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 0x7f31e00c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.203+0000 7f31df7fe640 1 -- 172.21.15.96:0/319262090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009b30 con 0x7f31e00c44a0 2023-12-01T23:18:25.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.205+0000 7f31df7fe640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 0x7f31e015d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e880 tx=0x7f31d000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.209+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000c940 con 0x7f31e00c44a0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.209+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000caa0 con 0x7f31e00c44a0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.209+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01f2960 con 0x7f31e00c44a0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.209+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d000ce50 con 0x7f31e00c44a0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.209+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01f2f20 con 0x7f31e00c44a0 2023-12-01T23:18:25.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.210+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0067500 con 0x7f31e00c44a0 2023-12-01T23:18:25.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.229+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f31d0013470 con 0x7f31e00c44a0 2023-12-01T23:18:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.229+0000 7f31c7fff640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 0x7f31cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.229+0000 7f31deffd640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 0x7f31cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.229+0000 7f31deffd640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 0x7f31cc06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31d40017a0 tx=0x7f31d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.231+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31d0058dc0 con 0x7f31e00c44a0 2023-12-01T23:18:25.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.466+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31d0055100 con 0x7f31e00c44a0 2023-12-01T23:18:25.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.643+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f31e00c64f0 con 0x7f31e00c44a0 2023-12-01T23:18:25.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.650+0000 7f31c7fff640 1 -- 172.21.15.96:0/319262090 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f31d0021020 con 0x7f31e00c44a0 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-12-01T23:18:25.651 INFO:teuthology.orchestra.run.smithi096.stdout:] 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.651+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 msgr2=0x7f31cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.651+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 0x7f31cc06d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31d40017a0 tx=0x7f31d4009040 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.651+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 msgr2=0x7f31e015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.651+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 0x7f31e015d150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31d000e880 tx=0x7f31d000ed40 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 shutdown_connections 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f31cc06ae40 0x7f31cc06d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31e015a000 0x7f31e00c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31e0153710 0x7f31e00c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 --2- 172.21.15.96:0/319262090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31e00c44a0 0x7f31e015d150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 >> 172.21.15.96:0/319262090 conn(0x7f31e0071410 msgr2=0x7f31e014f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 shutdown_connections 2023-12-01T23:18:25.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.652+0000 7f31e5b00640 1 -- 172.21.15.96:0/319262090 wait complete. 2023-12-01T23:18:25.663 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-01T23:18:25.663 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-01T23:18:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.766+0000 7f420d739640 1 Processor -- start 2023-12-01T23:18:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.766+0000 7f420d739640 1 -- start start 2023-12-01T23:18:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f420d739640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42080cafa0 0x7f420815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f420d739640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f420815aa50 0x7f42080cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f420d739640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420806b970 con 0x7f4208153900 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f420d739640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42080cb600 con 0x7f420815aa50 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f420d739640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4208153ce0 con 0x7f42080cafa0 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f41fffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42080cafa0 0x7f420815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.767+0000 7f42077fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f420815aa50 0x7f42080cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.768+0000 7f4206ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4208153900 0x7f420806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:53822/0 (socket says 172.21.15.96:53822) 2023-12-01T23:18:25.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.768+0000 7f4206ffd640 1 -- 172.21.15.96:0/4291429623 learned_addr learned my addr 172.21.15.96:0/4291429623 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.770+0000 7f42077fe640 1 -- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42080cafa0 msgr2=0x7f420815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.770+0000 7f42077fe640 1 --2- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42080cafa0 0x7f420815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.770+0000 7f42077fe640 1 -- 172.21.15.96:0/4291429623 >> v1:172.21.15.96:6789/0 conn(0x7f4208153900 legacy=0x7f420806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.770+0000 7f42077fe640 1 -- 172.21.15.96:0/4291429623 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080c9cc0 con 0x7f420815aa50 2023-12-01T23:18:25.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.772+0000 7f42077fe640 1 --2- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f420815aa50 0x7f42080cbc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d90 tx=0x7f420002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f818f35a7bccc0d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:25.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f42067fc640 1 -- 172.21.15.96:0/4291429623 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420002cc50 con 0x7f420815aa50 2023-12-01T23:18:25.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f42067fc640 1 -- 172.21.15.96:0/4291429623 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420002cdb0 con 0x7f420815aa50 2023-12-01T23:18:25.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f42067fc640 1 -- 172.21.15.96:0/4291429623 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200034660 con 0x7f420815aa50 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 -- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f420815aa50 msgr2=0x7f42080cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 --2- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f420815aa50 0x7f42080cbc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d90 tx=0x7f420002bea0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 -- 172.21.15.96:0/4291429623 shutdown_connections 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 --2- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f420815aa50 0x7f42080cbc00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 --2- 172.21.15.96:0/4291429623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42080cafa0 0x7f420815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 -- 172.21.15.96:0/4291429623 >> 172.21.15.96:0/4291429623 conn(0x7f4208061100 msgr2=0x7f4208061510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 -- 172.21.15.96:0/4291429623 shutdown_connections 2023-12-01T23:18:25.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.776+0000 7f420d739640 1 -- 172.21.15.96:0/4291429623 wait complete. 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.777+0000 7f420d739640 1 Processor -- start 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 -- start start 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 0x7f4208158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 0x7f4208159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f420815aa50 0x7f420815a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42080cf810 con 0x7f4208153900 2023-12-01T23:18:25.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4208157610 con 0x7f42080cafa0 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.778+0000 7f420d739640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080cf000 con 0x7f420815aa50 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.779+0000 7f41fffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 0x7f4208159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.779+0000 7f4206ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 0x7f4208158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.779+0000 7f42077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f420815aa50 0x7f420815a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.779+0000 7f41fffff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 0x7f4208159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46156/0 (socket says 172.21.15.96:46156) 2023-12-01T23:18:25.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.779+0000 7f41fffff640 1 -- 172.21.15.96:0/1878059964 learned_addr learned my addr 172.21.15.96:0/1878059964 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:25.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.783+0000 7f4206ffd640 1 -- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f420815aa50 msgr2=0x7f420815a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.783+0000 7f4206ffd640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f420815aa50 0x7f420815a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.783+0000 7f4206ffd640 1 -- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 msgr2=0x7f4208159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:25.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.783+0000 7f4206ffd640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 0x7f4208159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:25.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.783+0000 7f4206ffd640 1 -- 172.21.15.96:0/1878059964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200009a70 con 0x7f42080cafa0 2023-12-01T23:18:25.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.785+0000 7f4206ffd640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 0x7f4208158c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c3a0 tx=0x7f41f800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8005ce0 con 0x7f42080cafa0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8005e40 con 0x7f42080cafa0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42081f00e0 con 0x7f42080cafa0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8007310 con 0x7f42080cafa0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42080cf530 con 0x7f42080cafa0 2023-12-01T23:18:25.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:25.789+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208067570 con 0x7f42080cafa0 2023-12-01T23:18:26.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.033+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41f8007470 con 0x7f42080cafa0 2023-12-01T23:18:26.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.033+0000 7f41ff7fe640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 0x7f41e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.034+0000 7f41fffff640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 0x7f41e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.034+0000 7f41fffff640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 0x7f41e806d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f420815c0f0 tx=0x7f41f0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:26.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.036+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f41f8007720 con 0x7f42080cafa0 2023-12-01T23:18:26.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.046+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41f8054090 con 0x7f42080cafa0 2023-12-01T23:18:26.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.211+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4208074380 con 0x7f42080cafa0 2023-12-01T23:18:26.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.792+0000 7f41ff7fe640 1 -- 172.21.15.96:0/1878059964 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f41f8017030 con 0x7f42080cafa0 2023-12-01T23:18:26.794 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 msgr2=0x7f41e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 0x7f41e806d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f420815c0f0 tx=0x7f41f0009190 comp rx=0 tx=0).stop 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 msgr2=0x7f4208158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 0x7f4208158c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f41f800c3a0 tx=0x7f41f800c860 comp rx=0 tx=0).stop 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 shutdown_connections 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f41e806ae40 0x7f41e806d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f420815aa50 0x7f420815a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4208153900 0x7f4208159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 --2- 172.21.15.96:0/1878059964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42080cafa0 0x7f4208158c40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 >> 172.21.15.96:0/1878059964 conn(0x7f4208061100 msgr2=0x7f420815aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 shutdown_connections 2023-12-01T23:18:26.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.794+0000 7f420d739640 1 -- 172.21.15.96:0/1878059964 wait complete. 2023-12-01T23:18:26.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-01T23:18:26.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.911+0000 7f5190090640 1 Processor -- start 2023-12-01T23:18:26.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.911+0000 7f5190090640 1 -- start start 2023-12-01T23:18:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.912+0000 7f5190090640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 0x7f51881511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.912+0000 7f5190090640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f518806fc70 0x7f51881516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.912+0000 7f5190090640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5188157720 con 0x7f518806ecc0 2023-12-01T23:18:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.912+0000 7f5190090640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5188157a00 con 0x7f518806fc70 2023-12-01T23:18:26.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.912+0000 7f5190090640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5188157ce0 con 0x7f518806f890 2023-12-01T23:18:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.913+0000 7f518d62b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f518806ecc0 0x7f518815af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39910/0 (socket says 172.21.15.96:39910) 2023-12-01T23:18:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.913+0000 7f518d62b640 1 -- 172.21.15.96:0/2939995142 learned_addr learned my addr 172.21.15.96:0/2939995142 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.913+0000 7f518e62d640 1 --2- 172.21.15.96:0/2939995142 >> v2:172.21.15.102:3300/0 conn(0x7f518806fc70 0x7f51881516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.913+0000 7f518de2c640 1 --2- 172.21.15.96:0/2939995142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 0x7f51881511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.915+0000 7f518ce2a640 1 -- 172.21.15.96:0/2939995142 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618995146 0 0) 0x7f5188157720 con 0x7f518806ecc0 2023-12-01T23:18:26.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.915+0000 7f518ce2a640 1 -- 172.21.15.96:0/2939995142 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5174003520 con 0x7f518806ecc0 2023-12-01T23:18:26.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.916+0000 7f518de2c640 1 -- 172.21.15.96:0/2939995142 >> v2:172.21.15.102:3300/0 conn(0x7f518806fc70 msgr2=0x7f51881516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:26.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.916+0000 7f518de2c640 1 --2- 172.21.15.96:0/2939995142 >> v2:172.21.15.102:3300/0 conn(0x7f518806fc70 0x7f51881516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.916+0000 7f518de2c640 1 -- 172.21.15.96:0/2939995142 >> v1:172.21.15.96:6789/0 conn(0x7f518806ecc0 legacy=0x7f518815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.916+0000 7f518de2c640 1 -- 172.21.15.96:0/2939995142 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5188157fc0 con 0x7f518806f890 2023-12-01T23:18:26.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.918+0000 7f518de2c640 1 --2- 172.21.15.96:0/2939995142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 0x7f51881511a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5184009d90 tx=0x7f518402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41c11b38d2e4b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.921+0000 7f518ce2a640 1 -- 172.21.15.96:0/2939995142 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518402cc50 con 0x7f518806f890 2023-12-01T23:18:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.921+0000 7f518ce2a640 1 -- 172.21.15.96:0/2939995142 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518402cdb0 con 0x7f518806f890 2023-12-01T23:18:26.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.921+0000 7f518ce2a640 1 -- 172.21.15.96:0/2939995142 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184034660 con 0x7f518806f890 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 -- 172.21.15.96:0/2939995142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 msgr2=0x7f51881511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 --2- 172.21.15.96:0/2939995142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 0x7f51881511a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5184009d90 tx=0x7f518402bea0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 -- 172.21.15.96:0/2939995142 shutdown_connections 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 --2- 172.21.15.96:0/2939995142 >> v2:172.21.15.102:3300/0 conn(0x7f518806fc70 0x7f51881516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 --2- 172.21.15.96:0/2939995142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806f890 0x7f51881511a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 -- 172.21.15.96:0/2939995142 >> 172.21.15.96:0/2939995142 conn(0x7f51880723d0 msgr2=0x7f51880cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 -- 172.21.15.96:0/2939995142 shutdown_connections 2023-12-01T23:18:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.922+0000 7f5190090640 1 -- 172.21.15.96:0/2939995142 wait complete. 2023-12-01T23:18:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.923+0000 7f5190090640 1 Processor -- start 2023-12-01T23:18:26.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.923+0000 7f5190090640 1 -- start start 2023-12-01T23:18:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 0x7f51880c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 0x7f51881ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806fc70 0x7f51880c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518814fb50 con 0x7f518806f890 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518815a200 con 0x7f518806ecc0 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.924+0000 7f5190090640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51881efb10 con 0x7f518806fc70 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.925+0000 7f518d62b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 0x7f51881ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.925+0000 7f518e62d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806fc70 0x7f51880c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.925+0000 7f518de2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 0x7f51880c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.925+0000 7f518d62b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 0x7f51881ef240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53558/0 (socket says 172.21.15.96:53558) 2023-12-01T23:18:26.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.925+0000 7f518d62b640 1 -- 172.21.15.96:0/170010910 learned_addr learned my addr 172.21.15.96:0/170010910 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:26.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.929+0000 7f518de2c640 1 -- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806fc70 msgr2=0x7f51880c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.929+0000 7f518de2c640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806fc70 0x7f51880c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.929+0000 7f518de2c640 1 -- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 msgr2=0x7f51881ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:26.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.929+0000 7f518de2c640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 0x7f51881ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:26.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.929+0000 7f518de2c640 1 -- 172.21.15.96:0/170010910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184009a70 con 0x7f518806ecc0 2023-12-01T23:18:26.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.931+0000 7f518de2c640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 0x7f51880c4b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51880c8740 tx=0x7f5184004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:26.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.934+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518403e610 con 0x7f518806ecc0 2023-12-01T23:18:26.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.934+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518403e7b0 con 0x7f518806ecc0 2023-12-01T23:18:26.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.934+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518403eb60 con 0x7f518806ecc0 2023-12-01T23:18:26.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.934+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51881efdd0 con 0x7f518806ecc0 2023-12-01T23:18:26.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.935+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51881598d0 con 0x7f518806ecc0 2023-12-01T23:18:26.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.935+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51880740e0 con 0x7f518806ecc0 2023-12-01T23:18:26.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.955+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f518403b050 con 0x7f518806ecc0 2023-12-01T23:18:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.955+0000 7f517e7fc640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 0x7f516c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.955+0000 7f518d62b640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 0x7f516c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:26.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:26.955+0000 7f518d62b640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 0x7f516c06d350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51880c5980 tx=0x7f5178009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:27.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.181+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f518407ad00 con 0x7f518806ecc0 2023-12-01T23:18:27.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.195+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5184077040 con 0x7f518806ecc0 2023-12-01T23:18:27.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.364+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5188070260 con 0x7f518806ecc0 2023-12-01T23:18:27.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.878+0000 7f517e7fc640 1 -- 172.21.15.96:0/170010910 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f518404d0d0 con 0x7f518806ecc0 2023-12-01T23:18:27.879 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 msgr2=0x7f516c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 0x7f516c06d350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51880c5980 tx=0x7f5178009040 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 msgr2=0x7f51880c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 0x7f51880c4b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51880c8740 tx=0x7f5184004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 shutdown_connections 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f516c06ae90 0x7f516c06d350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f518806fc70 0x7f51880c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f518806f890 0x7f51881ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.879+0000 7f5190090640 1 --2- 172.21.15.96:0/170010910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f518806ecc0 0x7f51880c4b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.880+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 >> 172.21.15.96:0/170010910 conn(0x7f51880723d0 msgr2=0x7f51880c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.880+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 shutdown_connections 2023-12-01T23:18:27.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:27.880+0000 7f5190090640 1 -- 172.21.15.96:0/170010910 wait complete. 2023-12-01T23:18:27.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-01T23:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.001+0000 7f4e46ac2640 1 Processor -- start 2023-12-01T23:18:28.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.001+0000 7f4e46ac2640 1 -- start start 2023-12-01T23:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.002+0000 7f4e46ac2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e400cd2b0 0x7f4e40070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.002+0000 7f4e46ac2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e400cc650 0x7f4e401510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.002+0000 7f4e46ac2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e40070540 con 0x7f4e400cced0 2023-12-01T23:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.002+0000 7f4e46ac2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e40158400 con 0x7f4e400cd2b0 2023-12-01T23:18:28.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.002+0000 7f4e46ac2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4015ad60 con 0x7f4e400cc650 2023-12-01T23:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.007+0000 7f4e3ffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4e400cd2b0 0x7f4e40070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.007+0000 7f4e4485e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4e400cced0 0x7f4e400cbf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:52924/0 (socket says 172.21.15.96:52924) 2023-12-01T23:18:28.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.007+0000 7f4e4485e640 1 -- 172.21.15.96:0/4255605644 learned_addr learned my addr 172.21.15.96:0/4255605644 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.011+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111448946 0 0) 0x7f4e38001490 con 0x7f4e400cced0 2023-12-01T23:18:28.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.012+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e28003520 con 0x7f4e400cced0 2023-12-01T23:18:28.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.013+0000 7f4e4505f640 1 --2- 172.21.15.96:0/4255605644 >> v2:172.21.15.102:3300/0 conn(0x7f4e400cc650 0x7f4e401510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837687634 0 0) 0x7f4e28003520 con 0x7f4e400cced0 2023-12-01T23:18:28.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 >> v2:172.21.15.102:3300/0 conn(0x7f4e400cc650 msgr2=0x7f4e401510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:28.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 --2- 172.21.15.96:0/4255605644 >> v2:172.21.15.102:3300/0 conn(0x7f4e400cc650 0x7f4e401510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 >> v2:172.21.15.96:3300/0 conn(0x7f4e400cd2b0 msgr2=0x7f4e40070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 --2- 172.21.15.96:0/4255605644 >> v2:172.21.15.96:3300/0 conn(0x7f4e400cd2b0 0x7f4e40070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4015b040 con 0x7f4e400cced0 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f4e38001b80 con 0x7f4e400cced0 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 >> v1:172.21.15.102:6789/0 conn(0x7f4e400cced0 legacy=0x7f4e400cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280039c0 0x7f4e28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e280047c0 0x7f4e28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 0x7f4e2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40158400 con 0x7f4e280047c0 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4015ad60 con 0x7f4e280051d0 2023-12-01T23:18:28.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.019+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2800c190 con 0x7f4e280039c0 2023-12-01T23:18:28.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.023+0000 7f4e4485e640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280039c0 0x7f4e28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.025+0000 7f4e4505f640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 0x7f4e2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.027+0000 7f4e4505f640 1 -- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280039c0 msgr2=0x7f4e28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.027+0000 7f4e4505f640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280039c0 0x7f4e28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.027+0000 7f4e4505f640 1 -- 172.21.15.96:0/4255605644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e280047c0 msgr2=0x7f4e28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.027+0000 7f4e4505f640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e280047c0 0x7f4e28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.027+0000 7f4e4505f640 1 -- 172.21.15.96:0/4255605644 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28003520 con 0x7f4e280051d0 2023-12-01T23:18:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.028+0000 7f4e4505f640 1 -- 172.21.15.96:0/4255605644 reap_dead start 2023-12-01T23:18:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.029+0000 7f4e4505f640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 0x7f4e2800b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000a9a0 tx=0x7f4e280057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8753e5f08cecdf60 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:28.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.032+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30030660 con 0x7f4e280051d0 2023-12-01T23:18:28.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300307c0 con 0x7f4e280051d0 2023-12-01T23:18:28.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e3f7fe640 1 -- 172.21.15.96:0/4255605644 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30030b30 con 0x7f4e280051d0 2023-12-01T23:18:28.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e46ac2640 1 -- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 msgr2=0x7f4e2800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:28.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 0x7f4e2800b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000a9a0 tx=0x7f4e280057f0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e46ac2640 1 -- 172.21.15.96:0/4255605644 shutdown_connections 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/4255605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e280051d0 0x7f4e2800b980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.033+0000 7f4e46ac2640 1 -- 172.21.15.96:0/4255605644 >> 172.21.15.96:0/4255605644 conn(0x7f4e40061660 msgr2=0x7f4e40070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.034+0000 7f4e46ac2640 1 -- 172.21.15.96:0/4255605644 shutdown_connections 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.034+0000 7f4e46ac2640 1 -- 172.21.15.96:0/4255605644 wait complete. 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.035+0000 7f4e46ac2640 1 Processor -- start 2023-12-01T23:18:28.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.035+0000 7f4e46ac2640 1 -- start start 2023-12-01T23:18:28.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 0x7f4e4015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e400c4550 0x7f4e400c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c6970 con 0x7f4e400c4550 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c6f20 con 0x7f4e400c40f0 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e46ac2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e401f13a0 con 0x7f4e280051d0 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e4485e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 0x7f4e4015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.036+0000 7f4e3ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.037+0000 7f4e4485e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 0x7f4e4015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:40914/0 (socket says 172.21.15.96:40914) 2023-12-01T23:18:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.037+0000 7f4e3ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:46972/0 (socket says 172.21.15.96:46972) 2023-12-01T23:18:28.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.037+0000 7f4e4485e640 1 -- 172.21.15.96:0/3655785990 learned_addr learned my addr 172.21.15.96:0/3655785990 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.040+0000 7f4e3ffff640 1 -- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 msgr2=0x7f4e4015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.040+0000 7f4e3ffff640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 0x7f4e4015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.040+0000 7f4e3ffff640 1 -- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e400c4550 msgr2=0x7f4e400c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.040+0000 7f4e3ffff640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e400c4550 0x7f4e400c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:28.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.040+0000 7f4e3ffff640 1 -- 172.21.15.96:0/3655785990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e401f04d0 con 0x7f4e400c40f0 2023-12-01T23:18:28.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.042+0000 7f4e3ffff640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400d4b0 tx=0x7f4e3400d970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.044+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34018070 con 0x7f4e400c40f0 2023-12-01T23:18:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.044+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e401f0790 con 0x7f4e400c40f0 2023-12-01T23:18:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.044+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e401f0d50 con 0x7f4e400c40f0 2023-12-01T23:18:28.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.045+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e400c4b20 con 0x7f4e400c40f0 2023-12-01T23:18:28.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.256+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34004020 con 0x7f4e400c40f0 2023-12-01T23:18:28.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.291+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34004190 con 0x7f4e400c40f0 2023-12-01T23:18:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.291+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e34004330 con 0x7f4e400c40f0 2023-12-01T23:18:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.291+0000 7f4e3d7fa640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.292+0000 7f4e4485e640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:28.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.292+0000 7f4e4485e640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 0x7f4e2c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001330 tx=0x7f4e38006040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:28.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.294+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4e34059050 con 0x7f4e400c40f0 2023-12-01T23:18:28.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.304+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e34054c90 con 0x7f4e400c40f0 2023-12-01T23:18:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:28.509+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4e400c4b20 con 0x7f4e400c40f0 2023-12-01T23:18:29.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.394+0000 7f4e3d7fa640 1 -- 172.21.15.96:0/3655785990 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4e400c4b20 con 0x7f4e400c40f0 2023-12-01T23:18:29.396 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2023-12-01T23:18:29.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.395+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 msgr2=0x7f4e2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.395+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 0x7f4e2c06d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4e38001330 tx=0x7f4e38006040 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.395+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 msgr2=0x7f4e400c4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.395+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400d4b0 tx=0x7f4e3400d970 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 shutdown_connections 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4e2c06ae70 0x7f4e2c06d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e400c4550 0x7f4e400c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e400c40f0 0x7f4e400c4e00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 --2- 172.21.15.96:0/3655785990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e280051d0 0x7f4e4015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 >> 172.21.15.96:0/3655785990 conn(0x7f4e40061660 msgr2=0x7f4e400c1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 shutdown_connections 2023-12-01T23:18:29.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.396+0000 7f4e46ac2640 1 -- 172.21.15.96:0/3655785990 wait complete. 2023-12-01T23:18:29.408 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-01T23:18:29.408 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-01T23:18:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.513+0000 7fa759968640 1 Processor -- start 2023-12-01T23:18:29.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.513+0000 7fa759968640 1 -- start start 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa759968640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa7541539a0 0x7fa754159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa759968640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7540c7d10 0x7fa7540c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa759968640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75415a4f0 con 0x7fa75406f330 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa759968640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540c9740 con 0x7fa7541539a0 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa759968640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7540c78c0 con 0x7fa7540c7d10 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.514+0000 7fa752ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa7541539a0 0x7fa754159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.515+0000 7fa7537fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7540c7d10 0x7fa7540c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.515+0000 7fa752ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa7541539a0 0x7fa754159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53588/0 (socket says 172.21.15.96:53588) 2023-12-01T23:18:29.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.515+0000 7fa752ffd640 1 -- 172.21.15.96:0/2978335499 learned_addr learned my addr 172.21.15.96:0/2978335499 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.518+0000 7fa752ffd640 1 -- 172.21.15.96:0/2978335499 >> v2:172.21.15.102:3300/0 conn(0x7fa7540c7d10 msgr2=0x7fa7540c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.518+0000 7fa752ffd640 1 --2- 172.21.15.96:0/2978335499 >> v2:172.21.15.102:3300/0 conn(0x7fa7540c7d10 0x7fa7540c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.518+0000 7fa752ffd640 1 -- 172.21.15.96:0/2978335499 >> v1:172.21.15.102:6789/0 conn(0x7fa75406f330 legacy=0x7fa75406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.518+0000 7fa752ffd640 1 -- 172.21.15.96:0/2978335499 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540c86a0 con 0x7fa7541539a0 2023-12-01T23:18:29.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.519+0000 7fa752ffd640 1 --2- 172.21.15.96:0/2978335499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7541539a0 0x7fa754159fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa75406b590 tx=0x7fa74402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb45f63ccf578b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:29.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa751ffb640 1 -- 172.21.15.96:0/2978335499 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74402cbb0 con 0x7fa7541539a0 2023-12-01T23:18:29.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa751ffb640 1 -- 172.21.15.96:0/2978335499 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74402cd10 con 0x7fa7541539a0 2023-12-01T23:18:29.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa751ffb640 1 -- 172.21.15.96:0/2978335499 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744034610 con 0x7fa7541539a0 2023-12-01T23:18:29.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 -- 172.21.15.96:0/2978335499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7541539a0 msgr2=0x7fa754159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 --2- 172.21.15.96:0/2978335499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7541539a0 0x7fa754159fb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa75406b590 tx=0x7fa74402c010 comp rx=0 tx=0).stop 2023-12-01T23:18:29.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 -- 172.21.15.96:0/2978335499 shutdown_connections 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 --2- 172.21.15.96:0/2978335499 >> v2:172.21.15.102:3300/0 conn(0x7fa7540c7d10 0x7fa7540c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 --2- 172.21.15.96:0/2978335499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa7541539a0 0x7fa754159fb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 -- 172.21.15.96:0/2978335499 >> 172.21.15.96:0/2978335499 conn(0x7fa7540ccd90 msgr2=0x7fa7540cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 -- 172.21.15.96:0/2978335499 shutdown_connections 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.523+0000 7fa759968640 1 -- 172.21.15.96:0/2978335499 wait complete. 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.524+0000 7fa759968640 1 Processor -- start 2023-12-01T23:18:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 -- start start 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7540c7d10 0x7fa7541e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7541539a0 0x7fa7541f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa754158410 con 0x7fa75406f330 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541ef760 con 0x7fa7540c7d10 2023-12-01T23:18:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.525+0000 7fa759968640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541f3470 con 0x7fa7541539a0 2023-12-01T23:18:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.526+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.526+0000 7fa7527fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7540c7d10 0x7fa7541e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.526+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7541539a0 0x7fa7541f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.526+0000 7fa752ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53596/0 (socket says 172.21.15.96:53596) 2023-12-01T23:18:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.526+0000 7fa752ffd640 1 -- 172.21.15.96:0/623892911 learned_addr learned my addr 172.21.15.96:0/623892911 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.530+0000 7fa752ffd640 1 -- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7541539a0 msgr2=0x7fa7541f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.530+0000 7fa752ffd640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7541539a0 0x7fa7541f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.530+0000 7fa752ffd640 1 -- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7540c7d10 msgr2=0x7fa7541e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.530+0000 7fa752ffd640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7540c7d10 0x7fa7541e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.530+0000 7fa752ffd640 1 -- 172.21.15.96:0/623892911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009b30 con 0x7fa75406f330 2023-12-01T23:18:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.532+0000 7fa752ffd640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f80 tx=0x7fa744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74403e450 con 0x7fa75406f330 2023-12-01T23:18:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74403e5d0 con 0x7fa75406f330 2023-12-01T23:18:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754157410 con 0x7fa75406f330 2023-12-01T23:18:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74403e980 con 0x7fa75406f330 2023-12-01T23:18:29.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7541ef110 con 0x7fa75406f330 2023-12-01T23:18:29.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.536+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540740e0 con 0x7fa75406f330 2023-12-01T23:18:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.787+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa74403eae0 con 0x7fa75406f330 2023-12-01T23:18:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.787+0000 7fa73bfff640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 0x7fa74006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:29.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.787+0000 7fa7527fc640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 0x7fa74006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:29.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.788+0000 7fa7527fc640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 0x7fa74006d350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c82c0 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:29.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.802+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa74407b720 con 0x7fa75406f330 2023-12-01T23:18:29.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.802+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa744077a60 con 0x7fa75406f330 2023-12-01T23:18:29.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:29.992+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa7540c9070 con 0x7fa75406f330 2023-12-01T23:18:30.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.866+0000 7fa73bfff640 1 -- 172.21.15.96:0/623892911 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa74407b080 con 0x7fa75406f330 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 msgr2=0x7fa74006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 0x7fa74006d350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c82c0 tx=0x7fa748009040 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 msgr2=0x7fa7541efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa744000f80 tx=0x7fa744004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 shutdown_connections 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa74006ae90 0x7fa74006d350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7541539a0 0x7fa7541f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7540c7d10 0x7fa7541e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 --2- 172.21.15.96:0/623892911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75406f330 0x7fa7541efbf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:30.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 >> 172.21.15.96:0/623892911 conn(0x7fa7540ccd90 msgr2=0x7fa7540cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 shutdown_connections 2023-12-01T23:18:30.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.868+0000 7fa759968640 1 -- 172.21.15.96:0/623892911 wait complete. 2023-12-01T23:18:30.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-01T23:18:30.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.991+0000 7f1482505640 1 Processor -- start 2023-12-01T23:18:30.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.991+0000 7f1482505640 1 -- start start 2023-12-01T23:18:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f1482505640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f147c151630 0x7f147c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f1482505640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c15a800 con 0x7f147c15b4b0 2023-12-01T23:18:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f1482505640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c15aae0 con 0x7f147c157210 2023-12-01T23:18:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f1482505640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c151a10 con 0x7f147c151630 2023-12-01T23:18:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f147bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f147c151630 0x7f147c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f147b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f147c15b4b0 0x7f147c0c8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:39918/0 (socket says 172.21.15.96:39918) 2023-12-01T23:18:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.992+0000 7f147b7fe640 1 -- 172.21.15.96:0/4108128062 learned_addr learned my addr 172.21.15.96:0/4108128062 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.995+0000 7f147affd640 1 -- 172.21.15.96:0/4108128062 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731473390 0 0) 0x7f147c15a800 con 0x7f147c15b4b0 2023-12-01T23:18:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.995+0000 7f147affd640 1 -- 172.21.15.96:0/4108128062 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003520 con 0x7f147c15b4b0 2023-12-01T23:18:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.995+0000 7f147bfff640 1 -- 172.21.15.96:0/4108128062 >> v1:172.21.15.102:6789/0 conn(0x7f147c157210 legacy=0x7f147c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.995+0000 7f147bfff640 1 -- 172.21.15.96:0/4108128062 >> v1:172.21.15.96:6789/0 conn(0x7f147c15b4b0 legacy=0x7f147c0c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:30.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:30.995+0000 7f147bfff640 1 -- 172.21.15.96:0/4108128062 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0c1fb0 con 0x7f147c151630 2023-12-01T23:18:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.000+0000 7f147bfff640 1 --2- 172.21.15.96:0/4108128062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c151630 0x7f147c15af70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f146c0097d0 tx=0x7f146c02b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51a40f490d402071 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:31.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.003+0000 7f147affd640 1 -- 172.21.15.96:0/4108128062 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c030890 con 0x7f147c151630 2023-12-01T23:18:31.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.003+0000 7f147affd640 1 -- 172.21.15.96:0/4108128062 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c0309f0 con 0x7f147c151630 2023-12-01T23:18:31.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.003+0000 7f147affd640 1 -- 172.21.15.96:0/4108128062 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c030d80 con 0x7f147c151630 2023-12-01T23:18:31.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 -- 172.21.15.96:0/4108128062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c151630 msgr2=0x7f147c15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:31.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 --2- 172.21.15.96:0/4108128062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c151630 0x7f147c15af70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f146c0097d0 tx=0x7f146c02b9d0 comp rx=0 tx=0).stop 2023-12-01T23:18:31.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 -- 172.21.15.96:0/4108128062 shutdown_connections 2023-12-01T23:18:31.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 --2- 172.21.15.96:0/4108128062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c151630 0x7f147c15af70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:31.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 -- 172.21.15.96:0/4108128062 >> 172.21.15.96:0/4108128062 conn(0x7f147c060f20 msgr2=0x7f147c061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:31.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 -- 172.21.15.96:0/4108128062 shutdown_connections 2023-12-01T23:18:31.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.004+0000 7f1482505640 1 -- 172.21.15.96:0/4108128062 wait complete. 2023-12-01T23:18:31.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.005+0000 7f1482505640 1 Processor -- start 2023-12-01T23:18:31.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.005+0000 7f1482505640 1 -- start start 2023-12-01T23:18:31.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 0x7f147c150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:31.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f147c157210 0x7f147c1ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:31.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 0x7f147c147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:31.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c1ef260 con 0x7f147c151630 2023-12-01T23:18:31.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0cb230 con 0x7f147c15b4b0 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.006+0000 7f1482505640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0ae310 con 0x7f147c157210 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.007+0000 7f147bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 0x7f147c150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.007+0000 7f1480aa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 0x7f147c147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.007+0000 7f147bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 0x7f147c150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53602/0 (socket says 172.21.15.96:53602) 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.007+0000 7f147bfff640 1 -- 172.21.15.96:0/3948585867 learned_addr learned my addr 172.21.15.96:0/3948585867 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:31.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.007+0000 7f147b7fe640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f147c157210 0x7f147c1ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.010+0000 7f1480aa2640 1 -- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f147c157210 msgr2=0x7f147c1ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.010+0000 7f1480aa2640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f147c157210 0x7f147c1ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.010+0000 7f1480aa2640 1 -- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 msgr2=0x7f147c150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:31.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.010+0000 7f1480aa2640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 0x7f147c150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:31.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.010+0000 7f1480aa2640 1 -- 172.21.15.96:0/3948585867 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009400 con 0x7f147c15b4b0 2023-12-01T23:18:31.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.012+0000 7f1480aa2640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 0x7f147c147460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f147c1576a0 tx=0x7f147400cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.016+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474003b70 con 0x7f147c15b4b0 2023-12-01T23:18:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.016+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474003cd0 con 0x7f147c15b4b0 2023-12-01T23:18:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.016+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474005310 con 0x7f147c15b4b0 2023-12-01T23:18:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.016+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c1f3230 con 0x7f147c15b4b0 2023-12-01T23:18:31.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.016+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c0caf50 con 0x7f147c15b4b0 2023-12-01T23:18:31.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.017+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c1ef3a0 con 0x7f147c15b4b0 2023-12-01T23:18:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.035+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1474005470 con 0x7f147c15b4b0 2023-12-01T23:18:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.035+0000 7f1478ff9640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 0x7f146806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.035+0000 7f147bfff640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 0x7f146806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:31.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.035+0000 7f147bfff640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 0x7f146806d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f146c02ba10 tx=0x7f146c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:31.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.037+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f1474058950 con 0x7f147c15b4b0 2023-12-01T23:18:31.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.280+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1474054c90 con 0x7f147c15b4b0 2023-12-01T23:18:31.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:31.451+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f147c1ef3a0 con 0x7f147c15b4b0 2023-12-01T23:18:33.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.790+0000 7f1478ff9640 1 -- 172.21.15.96:0/3948585867 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f147c1ef3a0 con 0x7f147c15b4b0 2023-12-01T23:18:33.792 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' created 2023-12-01T23:18:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.794+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 msgr2=0x7f146806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.794+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 0x7f146806d350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f146c02ba10 tx=0x7f146c008030 comp rx=0 tx=0).stop 2023-12-01T23:18:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.794+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 msgr2=0x7f147c147460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:33.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.794+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 0x7f147c147460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f147c1576a0 tx=0x7f147400cb20 comp rx=0 tx=0).stop 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 shutdown_connections 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f146806ae90 0x7f146806d350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c15b4b0 0x7f147c147460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f147c157210 0x7f147c1ef680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 --2- 172.21.15.96:0/3948585867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f147c151630 0x7f147c150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 >> 172.21.15.96:0/3948585867 conn(0x7f147c060f20 msgr2=0x7f147c0c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 shutdown_connections 2023-12-01T23:18:33.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.795+0000 7f1482505640 1 -- 172.21.15.96:0/3948585867 wait complete. 2023-12-01T23:18:33.808 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-01T23:18:33.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 Processor -- start 2023-12-01T23:18:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 -- start start 2023-12-01T23:18:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff6840c7370 0x7ff68406a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff68415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68406e820 con 0x7ff684151960 2023-12-01T23:18:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff684151d40 con 0x7ff6840c7370 2023-12-01T23:18:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.910+0000 7ff689d8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68406efc0 con 0x7ff68406aa40 2023-12-01T23:18:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.911+0000 7ff682ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff6840c7370 0x7ff68406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.911+0000 7ff6837fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.911+0000 7ff683fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff68415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.911+0000 7ff6837fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53612/0 (socket says 172.21.15.96:53612) 2023-12-01T23:18:33.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.911+0000 7ff6837fe640 1 -- 172.21.15.96:0/3545896585 learned_addr learned my addr 172.21.15.96:0/3545896585 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:33.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff682ffd640 1 -- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 msgr2=0x7ff68415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:33.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff682ffd640 1 --2- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff68415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff682ffd640 1 -- 172.21.15.96:0/3545896585 >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 msgr2=0x7ff6840c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:33.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff682ffd640 1 --2- 172.21.15.96:0/3545896585 >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff682ffd640 1 -- 172.21.15.96:0/3545896585 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6840c79b0 con 0x7ff6840c7370 2023-12-01T23:18:33.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.914+0000 7ff6837fe640 1 --2- 172.21.15.96:0/3545896585 >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:18:33.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.916+0000 7ff682ffd640 1 --2- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6840c7370 0x7ff68406a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6840c3330 tx=0x7ff67802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=364375bb34bfb5a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:33.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.919+0000 7ff6827fc640 1 -- 172.21.15.96:0/3545896585 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67802f050 con 0x7ff6840c7370 2023-12-01T23:18:33.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.919+0000 7ff6827fc640 1 -- 172.21.15.96:0/3545896585 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678031700 con 0x7ff6840c7370 2023-12-01T23:18:33.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.919+0000 7ff6827fc640 1 -- 172.21.15.96:0/3545896585 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678031a90 con 0x7ff6840c7370 2023-12-01T23:18:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 -- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6840c7370 msgr2=0x7ff68406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 --2- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6840c7370 0x7ff68406a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6840c3330 tx=0x7ff67802b7a0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 -- 172.21.15.96:0/3545896585 shutdown_connections 2023-12-01T23:18:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 --2- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff68415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 --2- 172.21.15.96:0/3545896585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6840c7370 0x7ff68406a500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 --2- 172.21.15.96:0/3545896585 >> v2:172.21.15.96:3300/0 conn(0x7ff684151960 0x7ff6840c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 -- 172.21.15.96:0/3545896585 >> 172.21.15.96:0/3545896585 conn(0x7ff6840cbf60 msgr2=0x7ff6840cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 -- 172.21.15.96:0/3545896585 shutdown_connections 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.920+0000 7ff689d8a640 1 -- 172.21.15.96:0/3545896585 wait complete. 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.921+0000 7ff689d8a640 1 Processor -- start 2023-12-01T23:18:33.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.921+0000 7ff689d8a640 1 -- start start 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff684151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 0x7ff68414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6841e4410 con 0x7ff6840c7370 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff684154260 con 0x7ff684151960 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.922+0000 7ff689d8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff684154540 con 0x7ff68406aa40 2023-12-01T23:18:33.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff6837fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff684151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff683fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 0x7ff68414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff682ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff682ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53624/0 (socket says 172.21.15.96:53624) 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff682ffd640 1 -- 172.21.15.96:0/1606718317 learned_addr learned my addr 172.21.15.96:0/1606718317 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff683fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 0x7ff68414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:47026/0 (socket says 172.21.15.96:47026) 2023-12-01T23:18:33.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.923+0000 7ff6837fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff684151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:40940/0 (socket says 172.21.15.96:40940) 2023-12-01T23:18:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.926+0000 7ff682ffd640 1 -- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 msgr2=0x7ff684151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.926+0000 7ff682ffd640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff684151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.926+0000 7ff682ffd640 1 -- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 msgr2=0x7ff68414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.926+0000 7ff682ffd640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 0x7ff68414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:33.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.926+0000 7ff682ffd640 1 -- 172.21.15.96:0/1606718317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740094d0 con 0x7ff6840c7370 2023-12-01T23:18:33.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.928+0000 7ff682ffd640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff678009890 tx=0x7ff6780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.932+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678033930 con 0x7ff6840c7370 2023-12-01T23:18:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.932+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff678033a90 con 0x7ff6840c7370 2023-12-01T23:18:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.932+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff678009400 con 0x7ff6840c7370 2023-12-01T23:18:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.932+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678033e40 con 0x7ff6840c7370 2023-12-01T23:18:33.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.932+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6841ed710 con 0x7ff6840c7370 2023-12-01T23:18:33.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.933+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68406c5a0 con 0x7ff6840c7370 2023-12-01T23:18:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.952+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff67803a050 con 0x7ff6840c7370 2023-12-01T23:18:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.952+0000 7ff66bfff640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 0x7ff67006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:33.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.953+0000 7ff6837fe640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 0x7ff67006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:33.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.953+0000 7ff6837fe640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 0x7ff67006d350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff674006ca0 tx=0x7ff674009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:33.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:33.955+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7ff678079de0 con 0x7ff6840c7370 2023-12-01T23:18:34.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.189+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff678076120 con 0x7ff6840c7370 2023-12-01T23:18:34.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.361+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff684067570 con 0x7ff6840c7370 2023-12-01T23:18:34.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.747+0000 7ff66bfff640 1 -- 172.21.15.96:0/1606718317 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff678079740 con 0x7ff6840c7370 2023-12-01T23:18:34.748 INFO:teuthology.orchestra.run.smithi096.stderr:set pool 4 allow_ec_overwrites to true 2023-12-01T23:18:34.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 msgr2=0x7ff67006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 0x7ff67006d350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff674006ca0 tx=0x7ff674009240 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 msgr2=0x7ff6841edc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff678009890 tx=0x7ff6780046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 shutdown_connections 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff67006ae90 0x7ff67006d350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff684151960 0x7ff68414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6840c7370 0x7ff6841edc30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 --2- 172.21.15.96:0/1606718317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff68406aa40 0x7ff684151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 >> 172.21.15.96:0/1606718317 conn(0x7ff6840cbf60 msgr2=0x7ff684156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.749+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 shutdown_connections 2023-12-01T23:18:34.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.750+0000 7ff689d8a640 1 -- 172.21.15.96:0/1606718317 wait complete. 2023-12-01T23:18:34.763 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-01T23:18:34.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.877+0000 7fbfeb243640 1 Processor -- start 2023-12-01T23:18:34.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.877+0000 7fbfeb243640 1 -- start start 2023-12-01T23:18:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.878+0000 7fbfeb243640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbfe40c2d60 0x7fbfe415d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.878+0000 7fbfeb243640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbfe406a500 0x7fbfe415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.878+0000 7fbfeb243640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe415ccd0 con 0x7fbfe4153b20 2023-12-01T23:18:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.878+0000 7fbfeb243640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe40c8680 con 0x7fbfe40c2d60 2023-12-01T23:18:34.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.878+0000 7fbfeb243640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe406f810 con 0x7fbfe406a500 2023-12-01T23:18:34.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.895+0000 7fbfe97e0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbfe406a500 0x7fbfe415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:34.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.895+0000 7fbfe8fdf640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbfe4153b20 0x7fbfe40c7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:52952/0 (socket says 172.21.15.96:52952) 2023-12-01T23:18:34.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.895+0000 7fbfe8fdf640 1 -- 172.21.15.96:0/3614180614 learned_addr learned my addr 172.21.15.96:0/3614180614 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:34.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.898+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3614180614 >> v2:172.21.15.96:3300/0 conn(0x7fbfe40c2d60 msgr2=0x7fbfe415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:34.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.898+0000 7fbfe97e0640 1 --2- 172.21.15.96:0/3614180614 >> v2:172.21.15.96:3300/0 conn(0x7fbfe40c2d60 0x7fbfe415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.898+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3614180614 >> v1:172.21.15.102:6789/0 conn(0x7fbfe4153b20 legacy=0x7fbfe40c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.898+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3614180614 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe406faf0 con 0x7fbfe406a500 2023-12-01T23:18:34.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.902+0000 7fbfe97e0640 1 --2- 172.21.15.96:0/3614180614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe415d6a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfe406f190 tx=0x7fbfdc02bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68cee3182a0772e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:34.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.937+0000 7fbfe37fe640 1 -- 172.21.15.96:0/3614180614 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc02cb60 con 0x7fbfe406a500 2023-12-01T23:18:34.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfe37fe640 1 -- 172.21.15.96:0/3614180614 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc02ccc0 con 0x7fbfe406a500 2023-12-01T23:18:34.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfe37fe640 1 -- 172.21.15.96:0/3614180614 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc034660 con 0x7fbfe406a500 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 -- 172.21.15.96:0/3614180614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 msgr2=0x7fbfe415d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3614180614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe415d6a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfe406f190 tx=0x7fbfdc02bdb0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 -- 172.21.15.96:0/3614180614 shutdown_connections 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3614180614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe415d6a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3614180614 >> v2:172.21.15.96:3300/0 conn(0x7fbfe40c2d60 0x7fbfe415d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 -- 172.21.15.96:0/3614180614 >> 172.21.15.96:0/3614180614 conn(0x7fbfe4072930 msgr2=0x7fbfe40cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 -- 172.21.15.96:0/3614180614 shutdown_connections 2023-12-01T23:18:34.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.938+0000 7fbfeb243640 1 -- 172.21.15.96:0/3614180614 wait complete. 2023-12-01T23:18:34.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.939+0000 7fbfeb243640 1 Processor -- start 2023-12-01T23:18:34.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 -- start start 2023-12-01T23:18:34.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:34.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfe40c2d60 0x7fbfe41f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:34.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:34.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41f3760 con 0x7fbfe40c2d60 2023-12-01T23:18:34.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe415a5a0 con 0x7fbfe406a500 2023-12-01T23:18:34.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.940+0000 7fbfeb243640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4159b20 con 0x7fbfe4153b20 2023-12-01T23:18:34.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.941+0000 7fbfe8fdf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:34.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.941+0000 7fbfe97e0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:34.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.942+0000 7fbfe8fdf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe41593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:47046/0 (socket says 172.21.15.96:47046) 2023-12-01T23:18:34.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.942+0000 7fbfe8fdf640 1 -- 172.21.15.96:0/3771968697 learned_addr learned my addr 172.21.15.96:0/3771968697 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:34.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.942+0000 7fbfe97e0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:40950/0 (socket says 172.21.15.96:40950) 2023-12-01T23:18:34.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.947+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 msgr2=0x7fbfe41593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.947+0000 7fbfe97e0640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe41593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.947+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfe40c2d60 msgr2=0x7fbfe41f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:34.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.947+0000 7fbfe97e0640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfe40c2d60 0x7fbfe41f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:34.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.947+0000 7fbfe97e0640 1 -- 172.21.15.96:0/3771968697 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009a70 con 0x7fbfe4153b20 2023-12-01T23:18:34.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.949+0000 7fbfe97e0640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc033000 tx=0x7fbfdc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.953+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc03e610 con 0x7fbfe4153b20 2023-12-01T23:18:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.953+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc03e770 con 0x7fbfe4153b20 2023-12-01T23:18:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.953+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe40c6cb0 con 0x7fbfe4153b20 2023-12-01T23:18:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.953+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc03eb20 con 0x7fbfe4153b20 2023-12-01T23:18:34.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.953+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe4159fe0 con 0x7fbfe4153b20 2023-12-01T23:18:34.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:34.954+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe4150a60 con 0x7fbfe4153b20 2023-12-01T23:18:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.204+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfdc03b050 con 0x7fbfe4153b20 2023-12-01T23:18:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.204+0000 7fbfe17fa640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 0x7fbfc806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.204+0000 7fbfe8fdf640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 0x7fbfc806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:35.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.204+0000 7fbfe8fdf640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 0x7fbfc806d350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004e40 tx=0x7fbfd8007f10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:35.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.206+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fbfdc07b480 con 0x7fbfe4153b20 2023-12-01T23:18:35.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.216+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfdc0777c0 con 0x7fbfe4153b20 2023-12-01T23:18:35.241 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:18:35.244 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:18:35.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:35.429+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fbfe40c6e40 con 0x7fbfe4153b20 2023-12-01T23:18:36.475 INFO:tasks.ceph.mds.f.smithi102.stderr:2023-12-01T23:18:36.469+0000 f5b2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-01T23:18:36.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.613+0000 7fbfe17fa640 1 -- 172.21.15.96:0/3771968697 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fbfdc04e020 con 0x7fbfe4153b20 2023-12-01T23:18:36.614 INFO:teuthology.orchestra.run.smithi096.stderr:added data pool 4 to fsmap 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 msgr2=0x7fbfc806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 0x7fbfc806d350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8004e40 tx=0x7fbfd8007f10 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 msgr2=0x7fbfe414fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc033000 tx=0x7fbfdc004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 shutdown_connections 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbfc806ae90 0x7fbfc806d350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbfe4153b20 0x7fbfe414fc00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbfe40c2d60 0x7fbfe41f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 --2- 172.21.15.96:0/3771968697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfe406a500 0x7fbfe41593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.615+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 >> 172.21.15.96:0/3771968697 conn(0x7fbfe4072930 msgr2=0x7fbfe40c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.616+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 shutdown_connections 2023-12-01T23:18:36.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.616+0000 7fbfeb243640 1 -- 172.21.15.96:0/3771968697 wait complete. 2023-12-01T23:18:36.627 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:36.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.727+0000 7fe4f7190640 1 Processor -- start 2023-12-01T23:18:36.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.727+0000 7fe4f7190640 1 -- start start 2023-12-01T23:18:36.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.728+0000 7fe4f7190640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 0x7fe4f0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.728+0000 7fe4f7190640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 0x7fe4f00c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.728+0000 7fe4f7190640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f0071420 con 0x7fe4f00c7eb0 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.728+0000 7fe4f7190640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f0155b20 con 0x7fe4f014fd70 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.728+0000 7fe4f7190640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01592d0 con 0x7fe4f0071c40 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.729+0000 7fe4f4f2c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 0x7fe4f0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.729+0000 7fe4effff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 0x7fe4f00c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.729+0000 7fe4f4f2c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 0x7fe4f0070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47530/0 (socket says 172.21.15.96:47530) 2023-12-01T23:18:36.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.729+0000 7fe4f4f2c640 1 -- 172.21.15.96:0/3238418743 learned_addr learned my addr 172.21.15.96:0/3238418743 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.732+0000 7fe4effff640 1 -- 172.21.15.96:0/3238418743 >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 msgr2=0x7fe4f0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.732+0000 7fe4effff640 1 --2- 172.21.15.96:0/3238418743 >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 0x7fe4f0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.732+0000 7fe4effff640 1 -- 172.21.15.96:0/3238418743 >> v1:172.21.15.96:6789/0 conn(0x7fe4f00c7eb0 legacy=0x7fe4f0159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.732+0000 7fe4effff640 1 -- 172.21.15.96:0/3238418743 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00c65f0 con 0x7fe4f0071c40 2023-12-01T23:18:36.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.734+0000 7fe4effff640 1 --2- 172.21.15.96:0/3238418743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 0x7fe4f00c7970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40097a0 tx=0x7fe4e402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6372550f4094f196 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.737+0000 7fe4ef7fe640 1 -- 172.21.15.96:0/3238418743 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e402f050 con 0x7fe4f0071c40 2023-12-01T23:18:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.737+0000 7fe4ef7fe640 1 -- 172.21.15.96:0/3238418743 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4031700 con 0x7fe4f0071c40 2023-12-01T23:18:36.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.737+0000 7fe4ef7fe640 1 -- 172.21.15.96:0/3238418743 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4031a90 con 0x7fe4f0071c40 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 -- 172.21.15.96:0/3238418743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 msgr2=0x7fe4f00c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 --2- 172.21.15.96:0/3238418743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 0x7fe4f00c7970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe4e40097a0 tx=0x7fe4e402b7a0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 -- 172.21.15.96:0/3238418743 shutdown_connections 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 --2- 172.21.15.96:0/3238418743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f0071c40 0x7fe4f00c7970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 --2- 172.21.15.96:0/3238418743 >> v2:172.21.15.96:3300/0 conn(0x7fe4f014fd70 0x7fe4f0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 -- 172.21.15.96:0/3238418743 >> 172.21.15.96:0/3238418743 conn(0x7fe4f006cd60 msgr2=0x7fe4f006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 -- 172.21.15.96:0/3238418743 shutdown_connections 2023-12-01T23:18:36.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.738+0000 7fe4f7190640 1 -- 172.21.15.96:0/3238418743 wait complete. 2023-12-01T23:18:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.739+0000 7fe4f7190640 1 Processor -- start 2023-12-01T23:18:36.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.739+0000 7fe4f7190640 1 -- start start 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4f00c7eb0 0x7fe4f0144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f014fd70 0x7fe4f01ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01ebb80 con 0x7fe4f0071c40 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0158460 con 0x7fe4f00c7eb0 2023-12-01T23:18:36.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.740+0000 7fe4f7190640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0145d10 con 0x7fe4f014fd70 2023-12-01T23:18:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.741+0000 7fe4f4f2c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.741+0000 7fe4f572d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f014fd70 0x7fe4f01ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.741+0000 7fe4effff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4f00c7eb0 0x7fe4f0144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.741+0000 7fe4f4f2c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47544/0 (socket says 172.21.15.96:47544) 2023-12-01T23:18:36.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.741+0000 7fe4f4f2c640 1 -- 172.21.15.96:0/2792568545 learned_addr learned my addr 172.21.15.96:0/2792568545 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.744+0000 7fe4f4f2c640 1 -- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f014fd70 msgr2=0x7fe4f01ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.744+0000 7fe4f4f2c640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f014fd70 0x7fe4f01ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.744+0000 7fe4f4f2c640 1 -- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4f00c7eb0 msgr2=0x7fe4f0144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.744+0000 7fe4f4f2c640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4f00c7eb0 0x7fe4f0144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:36.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.744+0000 7fe4f4f2c640 1 -- 172.21.15.96:0/2792568545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009400 con 0x7fe4f0071c40 2023-12-01T23:18:36.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.747+0000 7fe4f4f2c640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000dd90 tx=0x7fe4e0010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.750+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0012040 con 0x7fe4f0071c40 2023-12-01T23:18:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.750+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000de80 con 0x7fe4f0071c40 2023-12-01T23:18:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.750+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f01eb5d0 con 0x7fe4f0071c40 2023-12-01T23:18:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.750+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000b830 con 0x7fe4f0071c40 2023-12-01T23:18:36.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.750+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f0157e10 con 0x7fe4f0071c40 2023-12-01T23:18:36.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.751+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0157c50 con 0x7fe4f0071c40 2023-12-01T23:18:36.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.770+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4e0018650 con 0x7fe4f0071c40 2023-12-01T23:18:36.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.771+0000 7fe4ed7fa640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 0x7fe4dc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:36.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.771+0000 7fe4effff640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 0x7fe4dc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:36.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:36.771+0000 7fe4effff640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 0x7fe4dc06d350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4035000 tx=0x7fe4e4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.007+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe4e005b490 con 0x7fe4f0071c40 2023-12-01T23:18:37.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.007+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4e00577d0 con 0x7fe4f0071c40 2023-12-01T23:18:37.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.221+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4f0067500 con 0x7fe4f0071c40 2023-12-01T23:18:37.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.243+0000 7fe4ed7fa640 1 -- 172.21.15.96:0/2792568545 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6498 (secure 0 0 0) 0x7fe4e005adf0 con 0x7fe4f0071c40 2023-12-01T23:18:37.244 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:37.244 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:35.493289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-01T23:18:37.244 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 msgr2=0x7fe4dc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 0x7fe4dc06d350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4035000 tx=0x7fe4e4008030 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 msgr2=0x7fe4f01588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000dd90 tx=0x7fe4e0010490 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 shutdown_connections 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4dc06ae90 0x7fe4dc06d350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4f014fd70 0x7fe4f01ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4f00c7eb0 0x7fe4f0144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 --2- 172.21.15.96:0/2792568545 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4f0071c40 0x7fe4f01588f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 >> 172.21.15.96:0/2792568545 conn(0x7fe4f006cd60 msgr2=0x7fe4f006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:37.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 shutdown_connections 2023-12-01T23:18:37.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.245+0000 7fe4f7190640 1 -- 172.21.15.96:0/2792568545 wait complete. 2023-12-01T23:18:37.257 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:37.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.355+0000 7f2bf2c23640 1 Processor -- start 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.355+0000 7f2bf2c23640 1 -- start start 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.356+0000 7f2bf2c23640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2bec06f590 0x7f2bec157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.356+0000 7f2bf2c23640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec06fa00 con 0x7f2bec0c2000 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.356+0000 7f2bf2c23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec15b9c0 con 0x7f2bec151630 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.356+0000 7f2bf2c23640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec158490 con 0x7f2bec06f590 2023-12-01T23:18:37.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.357+0000 7f2bebfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f2bec06f590 0x7f2bec157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.357+0000 7f2bf09bf640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2bec151630 0x7f2bec0c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:34204/0 (socket says 172.21.15.96:34204) 2023-12-01T23:18:37.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.357+0000 7f2bf09bf640 1 -- 172.21.15.96:0/3049688707 learned_addr learned my addr 172.21.15.96:0/3049688707 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:37.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.360+0000 7f2bebfff640 1 -- 172.21.15.96:0/3049688707 >> v1:172.21.15.102:6789/0 conn(0x7f2bec151630 legacy=0x7f2bec0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.360+0000 7f2beb7fe640 1 -- 172.21.15.96:0/3049688707 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480502578 0 0) 0x7f2bec15b9c0 con 0x7f2bec151630 2023-12-01T23:18:37.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.360+0000 7f2bebfff640 1 -- 172.21.15.96:0/3049688707 >> v1:172.21.15.96:6789/0 conn(0x7f2bec0c2000 legacy=0x7f2bec0c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.360+0000 7f2bebfff640 1 -- 172.21.15.96:0/3049688707 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec15ab60 con 0x7f2bec06f590 2023-12-01T23:18:37.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.363+0000 7f2bebfff640 1 --2- 172.21.15.96:0/3049688707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec06f590 0x7f2bec157f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2be00097a0 tx=0x7f2be002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c3e8dceaccbba3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.367+0000 7f2beb7fe640 1 -- 172.21.15.96:0/3049688707 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be002f810 con 0x7f2bec06f590 2023-12-01T23:18:37.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.367+0000 7f2beb7fe640 1 -- 172.21.15.96:0/3049688707 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be002f970 con 0x7f2bec06f590 2023-12-01T23:18:37.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.367+0000 7f2beb7fe640 1 -- 172.21.15.96:0/3049688707 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be002fd00 con 0x7f2bec06f590 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 -- 172.21.15.96:0/3049688707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec06f590 msgr2=0x7f2bec157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/3049688707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec06f590 0x7f2bec157f50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2be00097a0 tx=0x7f2be002b9f0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 -- 172.21.15.96:0/3049688707 shutdown_connections 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/3049688707 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec06f590 0x7f2bec157f50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 -- 172.21.15.96:0/3049688707 >> 172.21.15.96:0/3049688707 conn(0x7f2bec061100 msgr2=0x7f2bec0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 -- 172.21.15.96:0/3049688707 shutdown_connections 2023-12-01T23:18:37.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.368+0000 7f2bf2c23640 1 -- 172.21.15.96:0/3049688707 wait complete. 2023-12-01T23:18:37.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.369+0000 7f2bf2c23640 1 Processor -- start 2023-12-01T23:18:37.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.369+0000 7f2bf2c23640 1 -- start start 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2bec06f590 0x7f2bec14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bec151630 0x7f2bec1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec1eded0 con 0x7f2bec0c2000 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec1ed350 con 0x7f2bec151630 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bf2c23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec1ed630 con 0x7f2bec06f590 2023-12-01T23:18:37.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.370+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.371+0000 7f2bf09bf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2bec06f590 0x7f2bec14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.371+0000 7f2bf11c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bec151630 0x7f2bec1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.371+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47556/0 (socket says 172.21.15.96:47556) 2023-12-01T23:18:37.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.371+0000 7f2bebfff640 1 -- 172.21.15.96:0/2338176308 learned_addr learned my addr 172.21.15.96:0/2338176308 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:37.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.374+0000 7f2bebfff640 1 -- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2bec06f590 msgr2=0x7f2bec14b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.374+0000 7f2bebfff640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2bec06f590 0x7f2bec14b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.374+0000 7f2bebfff640 1 -- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bec151630 msgr2=0x7f2bec1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.374+0000 7f2bebfff640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bec151630 0x7f2bec1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.374+0000 7f2bebfff640 1 -- 172.21.15.96:0/2338176308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009400 con 0x7f2bec0c2000 2023-12-01T23:18:37.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.376+0000 7f2bebfff640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2be00098c0 tx=0x7f2be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.380+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be003b040 con 0x7f2bec0c2000 2023-12-01T23:18:37.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.380+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0037a90 con 0x7f2bec0c2000 2023-12-01T23:18:37.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.380+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec1ed910 con 0x7f2bec0c2000 2023-12-01T23:18:37.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.380+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0037e40 con 0x7f2bec0c2000 2023-12-01T23:18:37.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.380+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec1587c0 con 0x7f2bec0c2000 2023-12-01T23:18:37.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.381+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec1589b0 con 0x7f2bec0c2000 2023-12-01T23:18:37.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.624+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2be0042480 con 0x7f2bec0c2000 2023-12-01T23:18:37.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.625+0000 7f2be97fa640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 0x7f2bd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.625+0000 7f2bf09bf640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 0x7f2bd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.625+0000 7f2bf09bf640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 0x7f2bd806d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc007f70 tx=0x7f2bdc007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.636+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2be007bcb0 con 0x7f2bec0c2000 2023-12-01T23:18:37.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.636+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2be0077ff0 con 0x7f2bec0c2000 2023-12-01T23:18:37.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.806+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bec0740e0 con 0x7f2bec0c2000 2023-12-01T23:18:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.851+0000 7f2be97fa640 1 -- 172.21.15.96:0/2338176308 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f2be007b610 con 0x7f2bec0c2000 2023-12-01T23:18:37.853 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:37.853 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 msgr2=0x7f2bd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 0x7f2bd806d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc007f70 tx=0x7f2bdc007f00 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 msgr2=0x7f2bec1493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2be00098c0 tx=0x7f2be00046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 shutdown_connections 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2bd806ae40 0x7f2bd806d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2bec151630 0x7f2bec1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2bec0c2000 0x7f2bec1493b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.853+0000 7f2bf2c23640 1 --2- 172.21.15.96:0/2338176308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2bec06f590 0x7f2bec14b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.854+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 >> 172.21.15.96:0/2338176308 conn(0x7f2bec061100 msgr2=0x7f2bec0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:37.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.854+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 shutdown_connections 2023-12-01T23:18:37.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.854+0000 7f2bf2c23640 1 -- 172.21.15.96:0/2338176308 wait complete. 2023-12-01T23:18:37.865 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.963+0000 7fcdece36640 1 Processor -- start 2023-12-01T23:18:37.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.963+0000 7fcdece36640 1 -- start start 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde8153be0 0x7fcde8159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcde806fa00 0x7fcde80c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcde80c5e60 0x7fcde80c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80c3340 con 0x7fcde806fa00 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde8153fc0 con 0x7fcde80c5e60 2023-12-01T23:18:37.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.964+0000 7fcdece36640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde806b7b0 con 0x7fcde8153be0 2023-12-01T23:18:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.965+0000 7fcde5d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcde806fa00 0x7fcde80c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.965+0000 7fcde6d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcde80c5e60 0x7fcde80c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.965+0000 7fcde5d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcde806fa00 0x7fcde80c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47568/0 (socket says 172.21.15.96:47568) 2023-12-01T23:18:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.965+0000 7fcde5d9b640 1 -- 172.21.15.96:0/1327648640 learned_addr learned my addr 172.21.15.96:0/1327648640 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.965+0000 7fcde659c640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde8153be0 0x7fcde8159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.967+0000 7fcde5d9b640 1 -- 172.21.15.96:0/1327648640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde8153be0 msgr2=0x7fcde8159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.967+0000 7fcde5d9b640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde8153be0 0x7fcde8159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.967+0000 7fcde5d9b640 1 -- 172.21.15.96:0/1327648640 >> v2:172.21.15.102:3300/0 conn(0x7fcde80c5e60 msgr2=0x7fcde80c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.967+0000 7fcde5d9b640 1 --2- 172.21.15.96:0/1327648640 >> v2:172.21.15.102:3300/0 conn(0x7fcde80c5e60 0x7fcde80c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.967+0000 7fcde5d9b640 1 -- 172.21.15.96:0/1327648640 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde806ba90 con 0x7fcde806fa00 2023-12-01T23:18:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.969+0000 7fcde5d9b640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde80c41b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcde815a990 tx=0x7fcddc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e986f1070e5c02b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcde559a640 1 -- 172.21.15.96:0/1327648640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc031870 con 0x7fcde806fa00 2023-12-01T23:18:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcde559a640 1 -- 172.21.15.96:0/1327648640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc0319d0 con 0x7fcde806fa00 2023-12-01T23:18:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcde559a640 1 -- 172.21.15.96:0/1327648640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc031d60 con 0x7fcde806fa00 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 -- 172.21.15.96:0/1327648640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 msgr2=0x7fcde80c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde80c41b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcde815a990 tx=0x7fcddc02b910 comp rx=0 tx=0).stop 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 -- 172.21.15.96:0/1327648640 shutdown_connections 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 --2- 172.21.15.96:0/1327648640 >> v2:172.21.15.102:3300/0 conn(0x7fcde80c5e60 0x7fcde80c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde80c41b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 --2- 172.21.15.96:0/1327648640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde8153be0 0x7fcde8159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.973+0000 7fcdece36640 1 -- 172.21.15.96:0/1327648640 >> 172.21.15.96:0/1327648640 conn(0x7fcde80c7f60 msgr2=0x7fcde80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.974+0000 7fcdece36640 1 -- 172.21.15.96:0/1327648640 shutdown_connections 2023-12-01T23:18:37.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.974+0000 7fcdece36640 1 -- 172.21.15.96:0/1327648640 wait complete. 2023-12-01T23:18:37.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.975+0000 7fcdece36640 1 Processor -- start 2023-12-01T23:18:37.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.975+0000 7fcdece36640 1 -- start start 2023-12-01T23:18:37.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde80c5e60 0x7fcde81ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde8153be0 0x7fcde81efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde81595a0 con 0x7fcde806fa00 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde815a6f0 con 0x7fcde8153be0 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcdece36640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8158990 con 0x7fcde80c5e60 2023-12-01T23:18:37.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcde659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcde5d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde80c5e60 0x7fcde81ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcde659c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47578/0 (socket says 172.21.15.96:47578) 2023-12-01T23:18:37.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.976+0000 7fcde659c640 1 -- 172.21.15.96:0/167202709 learned_addr learned my addr 172.21.15.96:0/167202709 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:37.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.977+0000 7fcde6d9d640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde8153be0 0x7fcde81efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:37.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.980+0000 7fcde659c640 1 -- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde80c5e60 msgr2=0x7fcde81ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.980+0000 7fcde659c640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde80c5e60 0x7fcde81ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.980+0000 7fcde659c640 1 -- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde8153be0 msgr2=0x7fcde81efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:37.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.980+0000 7fcde659c640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde8153be0 0x7fcde81efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:37.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.980+0000 7fcde659c640 1 -- 172.21.15.96:0/167202709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0094d0 con 0x7fcde806fa00 2023-12-01T23:18:37.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.982+0000 7fcde659c640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800efc0 tx=0x7fcdd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.988+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8009b80 con 0x7fcde806fa00 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.988+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd800f040 con 0x7fcde806fa00 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.988+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde8158c70 con 0x7fcde806fa00 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.988+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80146a0 con 0x7fcde806fa00 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.988+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde8159230 con 0x7fcde806fa00 2023-12-01T23:18:37.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:37.989+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde8067500 con 0x7fcde806fa00 2023-12-01T23:18:38.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.232+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdd8014800 con 0x7fcde806fa00 2023-12-01T23:18:38.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.233+0000 7fcdd6ffd640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 0x7fcdc806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.233+0000 7fcde5d9b640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 0x7fcdc806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.233+0000 7fcde5d9b640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 0x7fcdc806d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcddc036000 tx=0x7fcddc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.258+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcdd8059690 con 0x7fcde806fa00 2023-12-01T23:18:38.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.258+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcdd80559d0 con 0x7fcde806fa00 2023-12-01T23:18:38.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.447+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde8071720 con 0x7fcde806fa00 2023-12-01T23:18:38.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.490+0000 7fcdd6ffd640 1 -- 172.21.15.96:0/167202709 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fcdd8058ff0 con 0x7fcde806fa00 2023-12-01T23:18:38.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:38.492 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 msgr2=0x7fcdc806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 0x7fcdc806d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcddc036000 tx=0x7fcddc03c040 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 msgr2=0x7fcde8071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800efc0 tx=0x7fcdd800c490 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 shutdown_connections 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcdc806ae90 0x7fcdc806d350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde8153be0 0x7fcde81efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcde80c5e60 0x7fcde81ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 --2- 172.21.15.96:0/167202709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcde806fa00 0x7fcde8071bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 >> 172.21.15.96:0/167202709 conn(0x7fcde80c7f60 msgr2=0x7fcde8152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 shutdown_connections 2023-12-01T23:18:38.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.493+0000 7fcdece36640 1 -- 172.21.15.96:0/167202709 wait complete. 2023-12-01T23:18:38.519 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:38.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.618+0000 7fd28c4d7640 1 Processor -- start 2023-12-01T23:18:38.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.618+0000 7fd28c4d7640 1 -- start start 2023-12-01T23:18:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.619+0000 7fd28c4d7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd284151720 0x7fd28406b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.619+0000 7fd28c4d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2840c68f0 0x7fd28406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.619+0000 7fd28c4d7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd284151b00 con 0x7fd28406fc60 2023-12-01T23:18:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.619+0000 7fd28c4d7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2841582b0 con 0x7fd284151720 2023-12-01T23:18:38.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.619+0000 7fd28c4d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd284157730 con 0x7fd2840c68f0 2023-12-01T23:18:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.620+0000 7fd28a273640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd284151720 0x7fd28406b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.620+0000 7fd289a72640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2840c68f0 0x7fd28406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.620+0000 7fd289a72640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2840c68f0 0x7fd28406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44226/0 (socket says 172.21.15.96:44226) 2023-12-01T23:18:38.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.620+0000 7fd289a72640 1 -- 172.21.15.96:0/3913331341 learned_addr learned my addr 172.21.15.96:0/3913331341 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.622+0000 7fd289a72640 1 -- 172.21.15.96:0/3913331341 >> v2:172.21.15.96:3300/0 conn(0x7fd284151720 msgr2=0x7fd28406b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.622+0000 7fd289a72640 1 --2- 172.21.15.96:0/3913331341 >> v2:172.21.15.96:3300/0 conn(0x7fd284151720 0x7fd28406b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.622+0000 7fd289a72640 1 -- 172.21.15.96:0/3913331341 >> v1:172.21.15.96:6789/0 conn(0x7fd28406fc60 legacy=0x7fd28415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.622+0000 7fd289a72640 1 -- 172.21.15.96:0/3913331341 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284157a10 con 0x7fd2840c68f0 2023-12-01T23:18:38.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.624+0000 7fd289a72640 1 --2- 172.21.15.96:0/3913331341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c68f0 0x7fd28406f720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd274009870 tx=0x7fd27402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b11893ccc4c400d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.628+0000 7fd289271640 1 -- 172.21.15.96:0/3913331341 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274031870 con 0x7fd2840c68f0 2023-12-01T23:18:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.628+0000 7fd289271640 1 -- 172.21.15.96:0/3913331341 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2740319d0 con 0x7fd2840c68f0 2023-12-01T23:18:38.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.628+0000 7fd289271640 1 -- 172.21.15.96:0/3913331341 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274031d60 con 0x7fd2840c68f0 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.628+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3913331341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c68f0 msgr2=0x7fd28406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.628+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3913331341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c68f0 0x7fd28406f720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd274009870 tx=0x7fd27402b910 comp rx=0 tx=0).stop 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3913331341 shutdown_connections 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3913331341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c68f0 0x7fd28406f720 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3913331341 >> v2:172.21.15.96:3300/0 conn(0x7fd284151720 0x7fd28406b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3913331341 >> 172.21.15.96:0/3913331341 conn(0x7fd2840cbef0 msgr2=0x7fd2840cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3913331341 shutdown_connections 2023-12-01T23:18:38.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.629+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3913331341 wait complete. 2023-12-01T23:18:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 Processor -- start 2023-12-01T23:18:38.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 -- start start 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd28406fc60 0x7fd2840c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd284151720 0x7fd284159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841486d0 con 0x7fd2840c68f0 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2840c1700 con 0x7fd28406fc60 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.630+0000 7fd28c4d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841f3650 con 0x7fd284151720 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.631+0000 7fd289a72640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.631+0000 7fd28a273640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd28406fc60 0x7fd2840c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.631+0000 7fd289a72640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47600/0 (socket says 172.21.15.96:47600) 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.631+0000 7fd289a72640 1 -- 172.21.15.96:0/3613229915 learned_addr learned my addr 172.21.15.96:0/3613229915 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:38.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.631+0000 7fd28aa74640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd284151720 0x7fd284159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.634+0000 7fd289a72640 1 -- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd284151720 msgr2=0x7fd284159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.634+0000 7fd289a72640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd284151720 0x7fd284159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.634+0000 7fd289a72640 1 -- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd28406fc60 msgr2=0x7fd2840c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.634+0000 7fd289a72640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd28406fc60 0x7fd2840c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:38.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.634+0000 7fd289a72640 1 -- 172.21.15.96:0/3613229915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740094d0 con 0x7fd2840c68f0 2023-12-01T23:18:38.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.637+0000 7fd289a72640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd274000c00 tx=0x7fd2740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.640+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27403abe0 con 0x7fd2840c68f0 2023-12-01T23:18:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.640+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27403ad40 con 0x7fd2840c68f0 2023-12-01T23:18:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.640+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274044630 con 0x7fd2840c68f0 2023-12-01T23:18:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.640+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2840c1970 con 0x7fd2840c68f0 2023-12-01T23:18:38.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.640+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841f2b70 con 0x7fd2840c68f0 2023-12-01T23:18:38.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.641+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2840cce50 con 0x7fd2840c68f0 2023-12-01T23:18:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.883+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2740303c0 con 0x7fd2840c68f0 2023-12-01T23:18:38.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.884+0000 7fd27affd640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 0x7fd26806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.884+0000 7fd28a273640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 0x7fd26806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:38.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.884+0000 7fd28a273640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 0x7fd26806d380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd280011340 tx=0x7fd28000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:38.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.897+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd27402d040 con 0x7fd2840c68f0 2023-12-01T23:18:38.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:38.897+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd27407aa50 con 0x7fd2840c68f0 2023-12-01T23:18:39.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.097+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd28414f580 con 0x7fd2840c68f0 2023-12-01T23:18:39.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.110+0000 7fd27affd640 1 -- 172.21.15.96:0/3613229915 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6498 (secure 0 0 0) 0x7fd274035090 con 0x7fd2840c68f0 2023-12-01T23:18:39.111 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:39.112 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:35.493289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-01T23:18:39.112 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 msgr2=0x7fd26806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 0x7fd26806d380 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd280011340 tx=0x7fd28000b040 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 msgr2=0x7fd2840c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd274000c00 tx=0x7fd2740046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 shutdown_connections 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd26806aec0 0x7fd26806d380 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd284151720 0x7fd284159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840c68f0 0x7fd2840c11c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 --2- 172.21.15.96:0/3613229915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd28406fc60 0x7fd2840c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 >> 172.21.15.96:0/3613229915 conn(0x7fd2840cbef0 msgr2=0x7fd284156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 shutdown_connections 2023-12-01T23:18:39.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.113+0000 7fd28c4d7640 1 -- 172.21.15.96:0/3613229915 wait complete. 2023-12-01T23:18:39.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.222+0000 7faff7f73640 1 Processor -- start 2023-12-01T23:18:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.223+0000 7faff7f73640 1 -- start start 2023-12-01T23:18:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.223+0000 7faff7f73640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faff01504e0 0x7faff006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:39.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.223+0000 7faff7f73640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00c5f60 con 0x7faff00c7190 2023-12-01T23:18:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.223+0000 7faff7f73640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00c2c60 con 0x7faff00c83f0 2023-12-01T23:18:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.223+0000 7faff7f73640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00c2f20 con 0x7faff01504e0 2023-12-01T23:18:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.224+0000 7faff5d0f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7faff01504e0 0x7faff006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.224+0000 7faff6510640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7faff00c83f0 0x7faff0160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:34218/0 (socket says 172.21.15.96:34218) 2023-12-01T23:18:39.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.224+0000 7faff6510640 1 -- 172.21.15.96:0/2401394875 learned_addr learned my addr 172.21.15.96:0/2401394875 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.227+0000 7faff4d0d640 1 -- 172.21.15.96:0/2401394875 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103494322 0 0) 0x7faff00c2c60 con 0x7faff00c83f0 2023-12-01T23:18:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.227+0000 7faff4d0d640 1 -- 172.21.15.96:0/2401394875 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafdc003520 con 0x7faff00c83f0 2023-12-01T23:18:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.227+0000 7faff5d0f640 1 -- 172.21.15.96:0/2401394875 >> v1:172.21.15.102:6789/0 conn(0x7faff00c83f0 legacy=0x7faff0160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.227+0000 7faff5d0f640 1 -- 172.21.15.96:0/2401394875 >> v1:172.21.15.96:6789/0 conn(0x7faff00c7190 legacy=0x7faff00c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.227+0000 7faff5d0f640 1 -- 172.21.15.96:0/2401394875 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00c61b0 con 0x7faff01504e0 2023-12-01T23:18:39.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.231+0000 7faff5d0f640 1 --2- 172.21.15.96:0/2401394875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff006e1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097a0 tx=0x7fafe002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3664e471da111a0c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:39.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.236+0000 7faff4d0d640 1 -- 172.21.15.96:0/2401394875 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0031830 con 0x7faff01504e0 2023-12-01T23:18:39.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.236+0000 7faff4d0d640 1 -- 172.21.15.96:0/2401394875 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0031990 con 0x7faff01504e0 2023-12-01T23:18:39.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.236+0000 7faff4d0d640 1 -- 172.21.15.96:0/2401394875 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0031d20 con 0x7faff01504e0 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 -- 172.21.15.96:0/2401394875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 msgr2=0x7faff006e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 --2- 172.21.15.96:0/2401394875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff006e1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafe00097a0 tx=0x7fafe002b8d0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 -- 172.21.15.96:0/2401394875 shutdown_connections 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 --2- 172.21.15.96:0/2401394875 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff006e1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 -- 172.21.15.96:0/2401394875 >> 172.21.15.96:0/2401394875 conn(0x7faff00cbef0 msgr2=0x7faff00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 -- 172.21.15.96:0/2401394875 shutdown_connections 2023-12-01T23:18:39.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.237+0000 7faff7f73640 1 -- 172.21.15.96:0/2401394875 wait complete. 2023-12-01T23:18:39.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.238+0000 7faff7f73640 1 Processor -- start 2023-12-01T23:18:39.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.238+0000 7faff7f73640 1 -- start start 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 0x7faff01dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faff00c83f0 0x7faff01dca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff01ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01ed370 con 0x7faff01504e0 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff01ed560 con 0x7faff00c7190 2023-12-01T23:18:39.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff7f73640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01dd1e0 con 0x7faff00c83f0 2023-12-01T23:18:39.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.239+0000 7faff6510640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff01ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:39.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.240+0000 7faff5d0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 0x7faff01dc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:39.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.240+0000 7faff550e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faff00c83f0 0x7faff01dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:39.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.240+0000 7faff6510640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff01ee7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47626/0 (socket says 172.21.15.96:47626) 2023-12-01T23:18:39.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.240+0000 7faff6510640 1 -- 172.21.15.96:0/1350878501 learned_addr learned my addr 172.21.15.96:0/1350878501 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.243+0000 7faff5d0f640 1 -- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faff00c83f0 msgr2=0x7faff01dca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.243+0000 7faff5d0f640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faff00c83f0 0x7faff01dca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.243+0000 7faff5d0f640 1 -- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 msgr2=0x7faff01ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.243+0000 7faff5d0f640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff01ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.243+0000 7faff5d0f640 1 -- 172.21.15.96:0/1350878501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009400 con 0x7faff00c7190 2023-12-01T23:18:39.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.246+0000 7faff5d0f640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 0x7faff01dc4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafe0033000 tx=0x7fafe00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:39.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.250+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe003a9e0 con 0x7faff00c7190 2023-12-01T23:18:39.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.250+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe003ab60 con 0x7faff00c7190 2023-12-01T23:18:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.250+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0044400 con 0x7faff00c7190 2023-12-01T23:18:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.250+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff01dd4a0 con 0x7faff00c7190 2023-12-01T23:18:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.250+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff01dda60 con 0x7faff00c7190 2023-12-01T23:18:39.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.251+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff00740e0 con 0x7faff00c7190 2023-12-01T23:18:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.496+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafe004d440 con 0x7faff00c7190 2023-12-01T23:18:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.496+0000 7fafe67fc640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 0x7fafd406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.496+0000 7faff550e640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 0x7fafd406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:39.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.497+0000 7faff550e640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 0x7fafd406d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faff01f19a0 tx=0x7fafec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:39.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.499+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fafe007ab20 con 0x7faff00c7190 2023-12-01T23:18:39.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.510+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafe0076e60 con 0x7faff00c7190 2023-12-01T23:18:39.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.684+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faff014d510 con 0x7faff00c7190 2023-12-01T23:18:39.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.818+0000 7fafe67fc640 1 -- 172.21.15.96:0/1350878501 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fafe0035070 con 0x7faff00c7190 2023-12-01T23:18:39.820 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:39.820 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 msgr2=0x7fafd406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 0x7fafd406d350 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faff01f19a0 tx=0x7fafec009040 comp rx=0 tx=0).stop 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 msgr2=0x7faff01dc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 0x7faff01dc4e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fafe0033000 tx=0x7fafe00046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 shutdown_connections 2023-12-01T23:18:39.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafd406ae90 0x7fafd406d350 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faff01504e0 0x7faff01ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faff00c83f0 0x7faff01dca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 --2- 172.21.15.96:0/1350878501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faff00c7190 0x7faff01dc4e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 >> 172.21.15.96:0/1350878501 conn(0x7faff00cbef0 msgr2=0x7faff006df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 shutdown_connections 2023-12-01T23:18:39.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:39.821+0000 7faff7f73640 1 -- 172.21.15.96:0/1350878501 wait complete. 2023-12-01T23:18:40.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-01T23:18:28.557088+0000', 'modified': '2023-12-01T23:18:35.493289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.102:6833/2956212258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 2956212258}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 2956212258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-01T23:18:40.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-01T23:18:40.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-01T23:18:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.538+0000 7fe8c39f5640 1 Processor -- start 2023-12-01T23:18:40.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.538+0000 7fe8c39f5640 1 -- start start 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.539+0000 7fe8c39f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8bc153c70 0x7fe8bc15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.539+0000 7fe8c39f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe8bc0ceef0 0x7fe8bc0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.539+0000 7fe8c39f5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc15a700 con 0x7fe8bc153890 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.539+0000 7fe8c39f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cf840 con 0x7fe8bc0ceef0 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.539+0000 7fe8c39f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0ca870 con 0x7fe8bc153c70 2023-12-01T23:18:40.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.540+0000 7fe8c0f90640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8bc153c70 0x7fe8bc15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.540+0000 7fe8c0f90640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8bc153c70 0x7fe8bc15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44254/0 (socket says 172.21.15.96:44254) 2023-12-01T23:18:40.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.540+0000 7fe8c0f90640 1 -- 172.21.15.96:0/441442682 learned_addr learned my addr 172.21.15.96:0/441442682 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.543+0000 7fe8c0f90640 1 -- 172.21.15.96:0/441442682 >> v2:172.21.15.96:3300/0 conn(0x7fe8bc0ceef0 msgr2=0x7fe8bc0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.543+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/441442682 >> v2:172.21.15.96:3300/0 conn(0x7fe8bc0ceef0 0x7fe8bc0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.543+0000 7fe8c0f90640 1 -- 172.21.15.96:0/441442682 >> v1:172.21.15.96:6789/0 conn(0x7fe8bc153890 legacy=0x7fe8bc0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.543+0000 7fe8c0f90640 1 -- 172.21.15.96:0/441442682 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc159af0 con 0x7fe8bc153c70 2023-12-01T23:18:40.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.545+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/441442682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153c70 0x7fe8bc15d950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0c6290 tx=0x7fe8b802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e326eb2b939af836 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.548+0000 7fe8b3fff640 1 -- 172.21.15.96:0/441442682 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8030860 con 0x7fe8bc153c70 2023-12-01T23:18:40.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.548+0000 7fe8b3fff640 1 -- 172.21.15.96:0/441442682 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b80309c0 con 0x7fe8bc153c70 2023-12-01T23:18:40.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.548+0000 7fe8b3fff640 1 -- 172.21.15.96:0/441442682 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8030d50 con 0x7fe8bc153c70 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 -- 172.21.15.96:0/441442682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153c70 msgr2=0x7fe8bc15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/441442682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153c70 0x7fe8bc15d950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0c6290 tx=0x7fe8b802b9a0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 -- 172.21.15.96:0/441442682 shutdown_connections 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/441442682 >> v2:172.21.15.96:3300/0 conn(0x7fe8bc0ceef0 0x7fe8bc0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/441442682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153c70 0x7fe8bc15d950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 -- 172.21.15.96:0/441442682 >> 172.21.15.96:0/441442682 conn(0x7fe8bc06ba00 msgr2=0x7fe8bc06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 -- 172.21.15.96:0/441442682 shutdown_connections 2023-12-01T23:18:40.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.549+0000 7fe8c39f5640 1 -- 172.21.15.96:0/441442682 wait complete. 2023-12-01T23:18:40.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.550+0000 7fe8c39f5640 1 Processor -- start 2023-12-01T23:18:40.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.550+0000 7fe8c39f5640 1 -- start start 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8bc0ceef0 0x7fe8bc155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 0x7fe8bc0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 0x7fe8bc155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14ef20 con 0x7fe8bc0ceef0 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14ec20 con 0x7fe8bc153890 2023-12-01T23:18:40.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.551+0000 7fe8c39f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14f3b0 con 0x7fe8bc153c70 2023-12-01T23:18:40.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.552+0000 7fe8c1f92640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 0x7fe8bc155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.552+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 0x7fe8bc0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.552+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 0x7fe8bc0b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44262/0 (socket says 172.21.15.96:44262) 2023-12-01T23:18:40.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.552+0000 7fe8c0f90640 1 -- 172.21.15.96:0/2545246991 learned_addr learned my addr 172.21.15.96:0/2545246991 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.555+0000 7fe8c1f92640 1 -- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 msgr2=0x7fe8bc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.555+0000 7fe8c1f92640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 0x7fe8bc0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.555+0000 7fe8c1f92640 1 -- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8bc0ceef0 msgr2=0x7fe8bc155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.555+0000 7fe8c1f92640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8bc0ceef0 0x7fe8bc155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.555+0000 7fe8c1f92640 1 -- 172.21.15.96:0/2545246991 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80094d0 con 0x7fe8bc153c70 2023-12-01T23:18:40.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.558+0000 7fe8c1f92640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 0x7fe8bc155da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400be50 tx=0x7fe8b400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.561+0000 7fe8b1ffb640 1 -- 172.21.15.96:0/2545246991 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400ce90 con 0x7fe8bc153c70 2023-12-01T23:18:40.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.561+0000 7fe8b1ffb640 1 -- 172.21.15.96:0/2545246991 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4014440 con 0x7fe8bc153c70 2023-12-01T23:18:40.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.561+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc153050 con 0x7fe8bc153c70 2023-12-01T23:18:40.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.561+0000 7fe8b1ffb640 1 -- 172.21.15.96:0/2545246991 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40147d0 con 0x7fe8bc153c70 2023-12-01T23:18:40.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.561+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc154410 con 0x7fe8bc153c70 2023-12-01T23:18:40.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.564+0000 7fe8c6587740 1 Processor -- start 2023-12-01T23:18:40.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.564+0000 7fe8c6587740 1 -- start start 2023-12-01T23:18:40.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000bf0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bef0b0 0x556000c2feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000bab980 con 0x556000bef0b0 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000b5db90 con 0x556000bf0650 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556000b5b280 con 0x556000c3a4d0 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.565+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.566+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44272/0 (socket says 172.21.15.96:44272) 2023-12-01T23:18:40.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.566+0000 7fe8c0f90640 1 -- 172.21.15.96:0/1882954870 learned_addr learned my addr 172.21.15.96:0/1882954870 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.568+0000 7fe8c0f90640 1 -- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 msgr2=0x556000bf0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.568+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000bf0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.568+0000 7fe8c0f90640 1 -- 172.21.15.96:0/1882954870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bef0b0 msgr2=0x556000c2feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.568+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bef0b0 0x556000c2feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.568+0000 7fe8c0f90640 1 -- 172.21.15.96:0/1882954870 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556000b1c500 con 0x556000bf0650 2023-12-01T23:18:40.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.570+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8b802bfb0 tx=0x7fe8b802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e82e4293c974796e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.573+0000 7fe8a6ffd640 1 -- 172.21.15.96:0/1882954870 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8030d30 con 0x556000bf0650 2023-12-01T23:18:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.573+0000 7fe8a6ffd640 1 -- 172.21.15.96:0/1882954870 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b8030e90 con 0x556000bf0650 2023-12-01T23:18:40.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.573+0000 7fe8a6ffd640 1 -- 172.21.15.96:0/1882954870 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80456b0 con 0x556000bf0650 2023-12-01T23:18:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 msgr2=0x556000bf0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe8b802bfb0 tx=0x7fe8b802e000 comp rx=0 tx=0).stop 2023-12-01T23:18:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- 172.21.15.96:0/1882954870 shutdown_connections 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bef0b0 0x556000c2feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000bf0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1882954870 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000bf0650 0x556000bf0a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- 172.21.15.96:0/1882954870 >> 172.21.15.96:0/1882954870 conn(0x556000becdc0 msgr2=0x556000bef700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- 172.21.15.96:0/1882954870 shutdown_connections 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- 172.21.15.96:0/1882954870 wait complete. 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 -- start start 2023-12-01T23:18:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.574+0000 7fe8c6587740 1 Processor -- start 2023-12-01T23:18:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c2c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c44b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000b56b70 con 0x556000bf0650 2023-12-01T23:18:40.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000b10e00 con 0x556000c35700 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556000b10aa0 con 0x556000c3a4d0 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.575+0000 7fe8c6587740 10 client.0 _ll_register_callbacks cb 0x556000868ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.576+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.576+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44280/0 (socket says 172.21.15.96:44280) 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.576+0000 7fe8c0f90640 1 -- 172.21.15.96:0/2057806755 learned_addr learned my addr 172.21.15.96:0/2057806755 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.579+0000 7fe8c0f90640 1 -- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 msgr2=0x556000c44b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.579+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c44b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.579+0000 7fe8c0f90640 1 -- 172.21.15.96:0/2057806755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 msgr2=0x556000c2c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.579+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c2c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.579+0000 7fe8c0f90640 1 -- 172.21.15.96:0/2057806755 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc159af0 con 0x556000c35700 2023-12-01T23:18:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.581+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x556000beee70 tx=0x7fe8b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4746df1c5ea921cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.581+0000 7fe89bfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2023-12-01T23:18:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.582+0000 7fe8b1ffb640 1 -- 172.21.15.96:0/2545246991 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8b401c360 con 0x7fe8bc153c70 2023-12-01T23:18:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.582+0000 7fe8b1ffb640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 0x7fe8a006d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.582+0000 7fe8c1791640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 0x7fe8a006d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.583+0000 7fe8c1791640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 0x7fe8a006d2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x556000c3a8d0 tx=0x7fe8ac007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.585+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8003a20 con 0x556000c35700 2023-12-01T23:18:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.585+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8b803e050 con 0x556000c35700 2023-12-01T23:18:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.585+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556000b4fb50 con 0x556000c35700 2023-12-01T23:18:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.586+0000 7fe8b1ffb640 1 -- 172.21.15.96:0/2545246991 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8b40585a0 con 0x7fe8bc153c70 2023-12-01T23:18:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.639+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8b8003b80 con 0x556000c35700 2023-12-01T23:18:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.639+0000 7fe8c6587740 10 client.4387 fetch_fsmap learned FSMap version 7 2023-12-01T23:18:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.639+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556000b551f0 con 0x556000c35700 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556000b4fb50 con 0x556000c35700 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fe8b8003ce0 con 0x556000c35700 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 10 client.4387 fetch_fsmap finished waiting for FSMap version 7 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 10 client.4387 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 20 client.4387 populate_metadata read hostname 'smithi096' 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 4 client.4387 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-01T23:18:40.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.653+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 --> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556000b4f870 con 0x556000c414e0 2023-12-01T23:18:40.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.663+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.754+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c418c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d48b7546cd704ae server_cookie=ab025a7e22ff5f06 in_seq=0 out_seq=0 2023-12-01T23:18:40.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.754+0000 7fe89bfff640 10 client.4387 ms_handle_connect on v2:172.21.15.102:6832/2956212258 2023-12-01T23:18:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.870+0000 7fe89bfff640 1 -- 172.21.15.96:0/2057806755 <== mds.0 v2:172.21.15.102:6832/2956212258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556000b4f870 con 0x556000c414e0 2023-12-01T23:18:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.870+0000 7fe89bfff640 10 client.4387 handle_command_reply: tid=0 2023-12-01T23:18:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.870+0000 7fe8c6587740 1 client.4387 shutdown 2023-12-01T23:18:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.870+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 msgr2=0x556000c45050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.870+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x556000beee70 tx=0x7fe8b80046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 shutdown_connections 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c418c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c45050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe89bfff640 0 client.4387 ms_handle_reset on v2:172.21.15.102:6832/2956212258 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c44b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2057806755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c2c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 >> 172.21.15.96:0/2057806755 conn(0x556000bef0b0 msgr2=0x556000be9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 shutdown_connections 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 1 -- 172.21.15.96:0/2057806755 wait complete. 2023-12-01T23:18:40.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.871+0000 7fe8c6587740 20 client.4387 trim_cache size 0 max 16384 2023-12-01T23:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.886+0000 7fe8c6587740 1 Processor -- start 2023-12-01T23:18:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.886+0000 7fe8c6587740 1 -- start start 2023-12-01T23:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c44920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000c3a4d0 0x556000c44e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000ad6270 con 0x556000c3a4d0 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000c29a80 con 0x556000c35700 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.887+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556000be66d0 con 0x556000bf0650 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.888+0000 7fe8c1791640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.888+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c44920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.888+0000 7fe8c1791640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:54948/0 (socket says 172.21.15.96:54948) 2023-12-01T23:18:40.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.888+0000 7fe8c1791640 1 -- 172.21.15.96:0/1421157803 learned_addr learned my addr 172.21.15.96:0/1421157803 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.889+0000 7fe8c1f92640 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000c3a4d0 0x556000c44e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.891+0000 7fe8c1791640 1 -- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 msgr2=0x556000c44920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.891+0000 7fe8c1791640 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c44920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.891+0000 7fe8c1791640 1 -- 172.21.15.96:0/1421157803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000c3a4d0 msgr2=0x556000c44e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.891+0000 7fe8c1791640 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000c3a4d0 0x556000c44e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.891+0000 7fe8c1791640 1 -- 172.21.15.96:0/1421157803 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556000af2d00 con 0x556000bf0650 2023-12-01T23:18:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.895+0000 7fe8c1791640 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005500 tx=0x7fe8ac00f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947d243375b5353e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.899+0000 7fe8a77fe640 1 -- 172.21.15.96:0/1421157803 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac01b070 con 0x556000bf0650 2023-12-01T23:18:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.899+0000 7fe8a77fe640 1 -- 172.21.15.96:0/1421157803 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac012650 con 0x556000bf0650 2023-12-01T23:18:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.899+0000 7fe8a77fe640 1 -- 172.21.15.96:0/1421157803 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac012a20 con 0x556000bf0650 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 -- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 msgr2=0x556000c2e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005500 tx=0x7fe8ac00f000 comp rx=0 tx=0).stop 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 -- 172.21.15.96:0/1421157803 shutdown_connections 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000c3a4d0 0x556000c44e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c44920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 --2- 172.21.15.96:0/1421157803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000bf0650 0x556000c2e6d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 -- 172.21.15.96:0/1421157803 >> 172.21.15.96:0/1421157803 conn(0x556000bef0b0 msgr2=0x556000c37d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 -- 172.21.15.96:0/1421157803 shutdown_connections 2023-12-01T23:18:40.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.900+0000 7fe8c6587740 1 -- 172.21.15.96:0/1421157803 wait complete. 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.901+0000 7fe8c6587740 1 -- start start 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.901+0000 7fe8c6587740 1 Processor -- start 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c45b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c9f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000c47c60 con 0x556000bf0650 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556000c3a080 con 0x556000c35700 2023-12-01T23:18:40.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556000c38130 con 0x556000c3a4d0 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c6587740 10 client.0 _ll_register_callbacks cb 0x556000bf1fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c1f92640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c1791640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c45b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c0f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c9f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c1f92640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:54958/0 (socket says 172.21.15.96:54958) 2023-12-01T23:18:40.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.902+0000 7fe8c1f92640 1 -- 172.21.15.96:0/2822098497 learned_addr learned my addr 172.21.15.96:0/2822098497 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.905+0000 7fe8c1791640 1 -- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 msgr2=0x556000c959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.905+0000 7fe8c1791640 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.905+0000 7fe8c1791640 1 -- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 msgr2=0x556000c9f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.905+0000 7fe8c1791640 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c9f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.905+0000 7fe8c1791640 1 -- 172.21.15.96:0/2822098497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac0051b0 con 0x556000bf0650 2023-12-01T23:18:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.907+0000 7fe8c1791640 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c45b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac01e000 tx=0x7fe8ac001100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3b5d87740717f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:40.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.907+0000 7fe89bfff640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-12-01T23:18:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.911+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac006ba0 con 0x556000bf0650 2023-12-01T23:18:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.911+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8ac006d00 con 0x556000bf0650 2023-12-01T23:18:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.911+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8b8030e90 con 0x556000bf0650 2023-12-01T23:18:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.913+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8ac0011a0 con 0x556000bf0650 2023-12-01T23:18:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.913+0000 7fe8c6587740 10 client.4347 fetch_fsmap learned FSMap version 7 2023-12-01T23:18:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.913+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x556000b184f0 con 0x556000bf0650 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b8030e90 con 0x556000bf0650 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fe8ac007030 con 0x556000bf0650 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 10 client.4347 fetch_fsmap finished waiting for FSMap version 7 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 10 client.4347 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 20 client.4347 populate_metadata read hostname 'smithi096' 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 4 client.4347 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-01T23:18:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.917+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 --> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5560008576c0 con 0x556000c414e0 2023-12-01T23:18:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.918+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.921+0000 7fe8c0f90640 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c9bd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa60d63aeda1f104 server_cookie=bdf338595e26e667 in_seq=0 out_seq=0 2023-12-01T23:18:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.921+0000 7fe89bfff640 10 client.4347 ms_handle_connect on v2:172.21.15.102:6832/2956212258 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.938+0000 7fe89bfff640 1 -- 172.21.15.96:0/2822098497 <== mds.0 v2:172.21.15.102:6832/2956212258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5560008576c0 con 0x556000c414e0 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.938+0000 7fe89bfff640 10 client.4347 handle_command_reply: tid=0 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.938+0000 7fe8c6587740 1 client.4347 shutdown 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 msgr2=0x556000c45b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c45b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac01e000 tx=0x7fe8ac001100 comp rx=0 tx=0).stop 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 shutdown_connections 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556000c414e0 0x556000c9bd00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556000c3a4d0 0x556000c959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556000c35700 0x556000c9f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 --2- 172.21.15.96:0/2822098497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556000bf0650 0x556000c45b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe89bfff640 0 client.4347 ms_handle_reset on v2:172.21.15.102:6832/2956212258 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 >> 172.21.15.96:0/2822098497 conn(0x556000bef0b0 msgr2=0x556000c34320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 shutdown_connections 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 1 -- 172.21.15.96:0/2822098497 wait complete. 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c6587740 20 client.4347 trim_cache size 0 max 16384 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "427efaec-98ee-4c98-922b-5db70b583575", 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-12-01T23:18:40.941 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4255, 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 11.463083759, 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 7, 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 27, 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 27, 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 20.560009362999999 2023-12-01T23:18:40.942 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 msgr2=0x7fe8a006d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 0x7fe8a006d2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x556000c3a8d0 tx=0x7fe8ac007990 comp rx=0 tx=0).stop 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 msgr2=0x7fe8bc155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 0x7fe8bc155da0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400be50 tx=0x7fe8b400bf40 comp rx=0 tx=0).stop 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 shutdown_connections 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe8a006ae30 0x7fe8a006d2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8bc153c70 0x7fe8bc155da0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8bc153890 0x7fe8bc0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 --2- 172.21.15.96:0/2545246991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe8bc0ceef0 0x7fe8bc155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.939+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 >> 172.21.15.96:0/2545246991 conn(0x7fe8bc06ba00 msgr2=0x7fe8bc15d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.940+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 shutdown_connections 2023-12-01T23:18:40.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:40.940+0000 7fe8c39f5640 1 -- 172.21.15.96:0/2545246991 wait complete. 2023-12-01T23:18:40.951 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-01T23:18:40.951 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:40.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-01T23:18:41.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.050+0000 7f2865cd3640 1 Processor -- start 2023-12-01T23:18:41.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.050+0000 7f2865cd3640 1 -- start start 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.051+0000 7f2865cd3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f28601501c0 0x7f2860159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.051+0000 7f2865cd3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2860072b60 con 0x7f28600bff00 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.051+0000 7f2865cd3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600c1a90 con 0x7f2860156e60 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.051+0000 7f2865cd3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28601572d0 con 0x7f28601501c0 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.051+0000 7f285f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f28601501c0 0x7f2860159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.052+0000 7f285ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2860156e60 0x7f2860071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:34226/0 (socket says 172.21.15.96:34226) 2023-12-01T23:18:41.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.052+0000 7f285ffff640 1 -- 172.21.15.96:0/4158720228 learned_addr learned my addr 172.21.15.96:0/4158720228 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:41.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.054+0000 7f285e7fc640 1 -- 172.21.15.96:0/4158720228 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647288509 0 0) 0x7f28600c1a90 con 0x7f2860156e60 2023-12-01T23:18:41.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.054+0000 7f285e7fc640 1 -- 172.21.15.96:0/4158720228 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2848003520 con 0x7f2860156e60 2023-12-01T23:18:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.057+0000 7f285f7fe640 1 -- 172.21.15.96:0/4158720228 >> v1:172.21.15.102:6789/0 conn(0x7f2860156e60 legacy=0x7f2860071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.057+0000 7f285f7fe640 1 -- 172.21.15.96:0/4158720228 >> v1:172.21.15.96:6789/0 conn(0x7f28600bff00 legacy=0x7f2860072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.057+0000 7f285f7fe640 1 -- 172.21.15.96:0/4158720228 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600c1d30 con 0x7f28601501c0 2023-12-01T23:18:41.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.060+0000 7f285f7fe640 1 --2- 172.21.15.96:0/4158720228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28601501c0 0x7f2860159860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28500097a0 tx=0x7f285002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcefe159ddac079a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.063+0000 7f285e7fc640 1 -- 172.21.15.96:0/4158720228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285002f810 con 0x7f28601501c0 2023-12-01T23:18:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f285e7fc640 1 -- 172.21.15.96:0/4158720228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285002f970 con 0x7f28601501c0 2023-12-01T23:18:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f285e7fc640 1 -- 172.21.15.96:0/4158720228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285002fd00 con 0x7f28601501c0 2023-12-01T23:18:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 -- 172.21.15.96:0/4158720228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28601501c0 msgr2=0x7f2860159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 --2- 172.21.15.96:0/4158720228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28601501c0 0x7f2860159860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f28500097a0 tx=0x7f285002b9f0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 -- 172.21.15.96:0/4158720228 shutdown_connections 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 --2- 172.21.15.96:0/4158720228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28601501c0 0x7f2860159860 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 -- 172.21.15.96:0/4158720228 >> 172.21.15.96:0/4158720228 conn(0x7f286006cd60 msgr2=0x7f286006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 -- 172.21.15.96:0/4158720228 shutdown_connections 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.064+0000 7f2865cd3640 1 -- 172.21.15.96:0/4158720228 wait complete. 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.065+0000 7f2865cd3640 1 Processor -- start 2023-12-01T23:18:41.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 -- start start 2023-12-01T23:18:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28601501c0 0x7f2860140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2860156e60 0x7f2860140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2860145ee0 con 0x7f28600bff00 2023-12-01T23:18:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286014dfb0 con 0x7f28601501c0 2023-12-01T23:18:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.066+0000 7f2865cd3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2860145360 con 0x7f2860156e60 2023-12-01T23:18:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.067+0000 7f285f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.067+0000 7f285effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28601501c0 0x7f2860140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.067+0000 7f285ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2860156e60 0x7f2860140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.067+0000 7f285f7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47666/0 (socket says 172.21.15.96:47666) 2023-12-01T23:18:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.067+0000 7f285f7fe640 1 -- 172.21.15.96:0/3762604966 learned_addr learned my addr 172.21.15.96:0/3762604966 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.070+0000 7f285f7fe640 1 -- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2860156e60 msgr2=0x7f2860140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.070+0000 7f285f7fe640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2860156e60 0x7f2860140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.070+0000 7f285f7fe640 1 -- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28601501c0 msgr2=0x7f2860140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.070+0000 7f285f7fe640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28601501c0 0x7f2860140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.070+0000 7f285f7fe640 1 -- 172.21.15.96:0/3762604966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009400 con 0x7f28600bff00 2023-12-01T23:18:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.072+0000 7f285f7fe640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28500098c0 tx=0x7f28500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.076+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850046070 con 0x7f28600bff00 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.076+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28500376d0 con 0x7f28600bff00 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.076+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2860145640 con 0x7f28600bff00 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.076+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285003b040 con 0x7f28600bff00 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.076+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860145c00 con 0x7f28600bff00 2023-12-01T23:18:41.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.077+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28600c77e0 con 0x7f28600bff00 2023-12-01T23:18:41.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.095+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2850037a80 con 0x7f28600bff00 2023-12-01T23:18:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.096+0000 7f2847fff640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 0x7f284c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.096+0000 7f285effd640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 0x7f284c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.096+0000 7f285effd640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 0x7f284c06d350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28600c0be0 tx=0x7f2854009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:41.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.098+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2850043e20 con 0x7f28600bff00 2023-12-01T23:18:41.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.334+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2850077940 con 0x7f28600bff00 2023-12-01T23:18:41.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.536+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2860147ff0 con 0x7f28600bff00 2023-12-01T23:18:41.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.542+0000 7f2847fff640 1 -- 172.21.15.96:0/3762604966 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2860147ff0 con 0x7f28600bff00 2023-12-01T23:18:41.543 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.544+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 msgr2=0x7f284c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.544+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 0x7f284c06d350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28600c0be0 tx=0x7f2854009040 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.544+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 msgr2=0x7f2860146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.544+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28500098c0 tx=0x7f28500046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 shutdown_connections 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f284c06ae90 0x7f284c06d350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2860156e60 0x7f2860140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28601501c0 0x7f2860140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 --2- 172.21.15.96:0/3762604966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28600bff00 0x7f2860146350 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 >> 172.21.15.96:0/3762604966 conn(0x7f286006cd60 msgr2=0x7f286014cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:41.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 shutdown_connections 2023-12-01T23:18:41.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:41.545+0000 7f2865cd3640 1 -- 172.21.15.96:0/3762604966 wait complete. 2023-12-01T23:18:41.556 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-01T23:18:41.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-01T23:18:41.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-12-01T23:18:41.556 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-01T23:18:41.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:41.557 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-01T23:18:41.557 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-01T23:18:41.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-01T23:18:41.557 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-01T23:18:41.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:41.557 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-12-01T23:18:41.572 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-01T23:18:41.572 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-01T23:18:41.573 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-12-01T23:18:41.574 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-01T23:18:41.574 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42294sec preferred_lft 42294sec 2023-12-01T23:18:41.574 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2023-12-01T23:18:41.574 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:18:41.574 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-01T23:18:41.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:41.574 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-01T23:18:41.575 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:18:41.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:41.894 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-01T23:18:41.920 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-12-01T23:18:41.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:41.921 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-12-01T23:18:41.989 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-12-01T23:18:41.989 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-01T23:18:41.989 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-01T23:18:41.990 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-01T23:18:41.990 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-01T23:18:41.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:41.990 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:18:41.990 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:18:41.990 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-01T23:18:41.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-01T23:18:41.991 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-01T23:18:41.991 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:18:42.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.283 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-12-01T23:18:42.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.299 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-12-01T23:18:42.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.354 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:18:42.354 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:18:42.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:42.354 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-01T23:18:42.354 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:18:42.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-01T23:18:42.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.437 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:18:42.437 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-01T23:18:42.438 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:18:42.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.574 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:18:42.574 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:18:42.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-12-01T23:18:42.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2023-12-01T23:18:42.574 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:18:42.616 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-01T23:18:42.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T23:18:42.616 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:42.669 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-01T23:18:42.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T23:18:42.670 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:42.724 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:18:42.793 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:18:42.850 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:18:42.851 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:18:42.852 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:18:42.853 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:18:42.853 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:18:42.853 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:42.853 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:42.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:42.853 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:18:42.906 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-01T23:18:42.906 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-01T23:18:42.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:18:42.974 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:18:43.029 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:18:43.030 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:43.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:43.031 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:18:43.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:2023-12-01T23:18:43.063+0000 7f6d71436480 -1 init, newargv = 0x556d400cb5e0 newargc=15 2023-12-01T23:18:43.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[94246]: starting ceph client 2023-12-01T23:18:43.309 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[94246]: starting fuse 2023-12-01T23:18:44.180 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:18:44.210 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:18:44.266 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:18:44.266 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:18:44.266 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:18:44.266 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:18:44.266 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:18:44.267 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:18:44.268 INFO:teuthology.orchestra.run.smithi096.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:44.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:44.269 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:18:44.322 INFO:teuthology.orchestra.run.smithi096.stdout:41 2023-12-01T23:18:44.322 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-01T23:18:44.322 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-12-01T23:18:44.322 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-12-01T23:18:44.323 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.admin")) 2023-12-01T23:18:44.324 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-12-01T23:18:44.443 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.admin.94246.asok 2023-12-01T23:18:44.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-01T23:18:44.453 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94246.asok 2023-12-01T23:18:44.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:44.453 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94246.asok status 2023-12-01T23:18:44.589 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "admin", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "94246", 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-12-01T23:18:44.590 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4362, 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4362 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3963532616 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-12-01T23:18:44.591 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3963532616 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4362 192.168.0.1:0/3963532616", 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/3963532616", 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 7, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 27, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-12-01T23:18:44.592 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:18:44.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:44.598 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-12-01T23:18:44.598 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:44.623 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-12-01T23:18:44.624 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:44.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:44.624 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:44.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:44.768 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-01T23:18:44.977 INFO:teuthology.orchestra.run.smithi096.stdout:# file: . 2023-12-01T23:18:44.977 INFO:teuthology.orchestra.run.smithi096.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-01T23:18:44.978 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:44.978 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:44.978 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T23:18:44.993 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:45.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.132+0000 7f4f86097640 1 Processor -- start 2023-12-01T23:18:45.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.132+0000 7f4f86097640 1 -- start start 2023-12-01T23:18:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f86097640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f80153890 0x7f4f8015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f86097640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4f80153c70 0x7f4f800c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f86097640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8015a700 con 0x7f4f800ceef0 2023-12-01T23:18:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f86097640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f800ca870 con 0x7f4f80153c70 2023-12-01T23:18:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f86097640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f80159af0 con 0x7f4f80153890 2023-12-01T23:18:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.133+0000 7f4f7effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4f80153c70 0x7f4f800c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.134+0000 7f4f7f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f80153890 0x7f4f8015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.134+0000 7f4f7ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4f800ceef0 0x7f4f8015aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48668/0 (socket says 172.21.15.96:48668) 2023-12-01T23:18:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.134+0000 7f4f7ffff640 1 -- 172.21.15.96:0/2992000712 learned_addr learned my addr 172.21.15.96:0/2992000712 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.136+0000 7f4f7f7fe640 1 -- 172.21.15.96:0/2992000712 >> v2:172.21.15.96:3300/0 conn(0x7f4f80153c70 msgr2=0x7f4f800c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.136+0000 7f4f7f7fe640 1 --2- 172.21.15.96:0/2992000712 >> v2:172.21.15.96:3300/0 conn(0x7f4f80153c70 0x7f4f800c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.136+0000 7f4f7f7fe640 1 -- 172.21.15.96:0/2992000712 >> v1:172.21.15.96:6789/0 conn(0x7f4f800ceef0 legacy=0x7f4f8015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.136+0000 7f4f7f7fe640 1 -- 172.21.15.96:0/2992000712 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80159dd0 con 0x7f4f80153890 2023-12-01T23:18:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.138+0000 7f4f7f7fe640 1 --2- 172.21.15.96:0/2992000712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80153890 0x7f4f8015d950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f800ccaa0 tx=0x7f4f7002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae20574162027d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:45.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.141+0000 7f4f7e7fc640 1 -- 172.21.15.96:0/2992000712 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70030610 con 0x7f4f80153890 2023-12-01T23:18:45.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.141+0000 7f4f7e7fc640 1 -- 172.21.15.96:0/2992000712 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70030770 con 0x7f4f80153890 2023-12-01T23:18:45.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.141+0000 7f4f7e7fc640 1 -- 172.21.15.96:0/2992000712 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70030b00 con 0x7f4f80153890 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 -- 172.21.15.96:0/2992000712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80153890 msgr2=0x7f4f8015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 --2- 172.21.15.96:0/2992000712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80153890 0x7f4f8015d950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4f800ccaa0 tx=0x7f4f7002b960 comp rx=0 tx=0).stop 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 -- 172.21.15.96:0/2992000712 shutdown_connections 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 --2- 172.21.15.96:0/2992000712 >> v2:172.21.15.96:3300/0 conn(0x7f4f80153c70 0x7f4f800c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 --2- 172.21.15.96:0/2992000712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f80153890 0x7f4f8015d950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 -- 172.21.15.96:0/2992000712 >> 172.21.15.96:0/2992000712 conn(0x7f4f8006ba00 msgr2=0x7f4f8006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:45.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 -- 172.21.15.96:0/2992000712 shutdown_connections 2023-12-01T23:18:45.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.142+0000 7f4f86097640 1 -- 172.21.15.96:0/2992000712 wait complete. 2023-12-01T23:18:45.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.143+0000 7f4f86097640 1 Processor -- start 2023-12-01T23:18:45.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 -- start start 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800ceef0 0x7f4f801552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f80153c70 0x7f4f80152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80155a40 con 0x7f4f80153890 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80151a50 con 0x7f4f800ceef0 2023-12-01T23:18:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.144+0000 7f4f86097640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80152260 con 0x7f4f80153c70 2023-12-01T23:18:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.145+0000 7f4f7effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.145+0000 7f4f7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800ceef0 0x7f4f801552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.145+0000 7f4f7ffff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f80153c70 0x7f4f80152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.145+0000 7f4f7effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47672/0 (socket says 172.21.15.96:47672) 2023-12-01T23:18:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.145+0000 7f4f7effd640 1 -- 172.21.15.96:0/3097692763 learned_addr learned my addr 172.21.15.96:0/3097692763 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.148+0000 7f4f7effd640 1 -- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f80153c70 msgr2=0x7f4f80152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.148+0000 7f4f7effd640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f80153c70 0x7f4f80152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.148+0000 7f4f7effd640 1 -- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800ceef0 msgr2=0x7f4f801552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.148+0000 7f4f7effd640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800ceef0 0x7f4f801552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.148+0000 7f4f7effd640 1 -- 172.21.15.96:0/3097692763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70009400 con 0x7f4f80153890 2023-12-01T23:18:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.150+0000 7f4f7effd640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400e9b0 tx=0x7f4f7400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.154+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74009670 con 0x7f4f80153890 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.154+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7400c9a0 con 0x7f4f80153890 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.154+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f801545d0 con 0x7f4f80153890 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.154+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400cd50 con 0x7f4f80153890 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.154+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f80151f80 con 0x7f4f80153890 2023-12-01T23:18:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.155+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80067500 con 0x7f4f80153890 2023-12-01T23:18:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.172+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f74013470 con 0x7f4f80153890 2023-12-01T23:18:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.173+0000 7f4f67fff640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 0x7f4f6c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.173+0000 7f4f7f7fe640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 0x7f4f6c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.173+0000 7f4f7f7fe640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 0x7f4f6c06d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f70036000 tx=0x7f4f70008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.177+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f74058d60 con 0x7f4f80153890 2023-12-01T23:18:45.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.411+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f740550a0 con 0x7f4f80153890 2023-12-01T23:18:45.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.582+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f801571c0 con 0x7f4f80153890 2023-12-01T23:18:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.621+0000 7f4f67fff640 1 -- 172.21.15.96:0/3097692763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f4f74017090 con 0x7f4f80153890 2023-12-01T23:18:45.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:45.622 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 msgr2=0x7f4f6c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 0x7f4f6c06d380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f70036000 tx=0x7f4f70008030 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 msgr2=0x7f4f80154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4f7400e9b0 tx=0x7f4f7400ee70 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 shutdown_connections 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4f6c06aec0 0x7f4f6c06d380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f80153c70 0x7f4f80152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f80153890 0x7f4f80154090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 --2- 172.21.15.96:0/3097692763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f800ceef0 0x7f4f801552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 >> 172.21.15.96:0/3097692763 conn(0x7f4f8006ba00 msgr2=0x7f4f80158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 shutdown_connections 2023-12-01T23:18:45.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.623+0000 7f4f86097640 1 -- 172.21.15.96:0/3097692763 wait complete. 2023-12-01T23:18:45.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:18:45.635 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:18:45.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.736+0000 7fea40f8a640 1 Processor -- start 2023-12-01T23:18:45.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.736+0000 7fea40f8a640 1 -- start start 2023-12-01T23:18:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.737+0000 7fea40f8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 0x7fea3c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.737+0000 7fea40f8a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c06ff90 con 0x7fea3c06dde0 2023-12-01T23:18:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.737+0000 7fea40f8a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3c06f980 con 0x7fea3c1515f0 2023-12-01T23:18:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.737+0000 7fea40f8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c0c40b0 con 0x7fea3c1519d0 2023-12-01T23:18:45.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.738+0000 7fea3ad9d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fea3c06dde0 0x7fea3c161e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:48670/0 (socket says 172.21.15.96:48670) 2023-12-01T23:18:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.738+0000 7fea39d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 0x7fea3c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.738+0000 7fea3ad9d640 1 -- 172.21.15.96:0/2672161845 learned_addr learned my addr 172.21.15.96:0/2672161845 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:45.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.740+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160818708 0 0) 0x7fea3c06ff90 con 0x7fea3c06dde0 2023-12-01T23:18:45.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.740+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003520 con 0x7fea3c06dde0 2023-12-01T23:18:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.741+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543635656 0 0) 0x7fea3c06f980 con 0x7fea3c1515f0 2023-12-01T23:18:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.741+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea3c06ff90 con 0x7fea3c1515f0 2023-12-01T23:18:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.741+0000 7fea39d9b640 1 -- 172.21.15.96:0/2672161845 >> v1:172.21.15.102:6789/0 conn(0x7fea3c1515f0 legacy=0x7fea3c06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.741+0000 7fea39d9b640 1 -- 172.21.15.96:0/2672161845 >> v1:172.21.15.96:6789/0 conn(0x7fea3c06dde0 legacy=0x7fea3c161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.741+0000 7fea39d9b640 1 -- 172.21.15.96:0/2672161845 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c06e810 con 0x7fea3c1519d0 2023-12-01T23:18:45.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.743+0000 7fea39d9b640 1 --2- 172.21.15.96:0/2672161845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 0x7fea3c06b0b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea300097d0 tx=0x7fea3002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df64926189fdebf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.747+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30031890 con 0x7fea3c1519d0 2023-12-01T23:18:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.747+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300319f0 con 0x7fea3c1519d0 2023-12-01T23:18:45.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.747+0000 7fea3959a640 1 -- 172.21.15.96:0/2672161845 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30031d80 con 0x7fea3c1519d0 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 -- 172.21.15.96:0/2672161845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 msgr2=0x7fea3c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2672161845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 0x7fea3c06b0b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea300097d0 tx=0x7fea3002b930 comp rx=0 tx=0).stop 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 -- 172.21.15.96:0/2672161845 shutdown_connections 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2672161845 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1519d0 0x7fea3c06b0b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 -- 172.21.15.96:0/2672161845 >> 172.21.15.96:0/2672161845 conn(0x7fea3c0cbf60 msgr2=0x7fea3c0cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 -- 172.21.15.96:0/2672161845 shutdown_connections 2023-12-01T23:18:45.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.748+0000 7fea40f8a640 1 -- 172.21.15.96:0/2672161845 wait complete. 2023-12-01T23:18:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.749+0000 7fea40f8a640 1 Processor -- start 2023-12-01T23:18:45.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.749+0000 7fea40f8a640 1 -- start start 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3c06dde0 0x7fea3c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1515f0 0x7fea3c14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c1de3c0 con 0x7fea3c1519d0 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c14c850 con 0x7fea3c06dde0 2023-12-01T23:18:45.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea40f8a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3c14caa0 con 0x7fea3c1515f0 2023-12-01T23:18:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.750+0000 7fea3ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.751+0000 7fea3a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3c06dde0 0x7fea3c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.751+0000 7fea39d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1515f0 0x7fea3c14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.751+0000 7fea3ad9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47678/0 (socket says 172.21.15.96:47678) 2023-12-01T23:18:45.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.751+0000 7fea3ad9d640 1 -- 172.21.15.96:0/2727357775 learned_addr learned my addr 172.21.15.96:0/2727357775 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.754+0000 7fea3ad9d640 1 -- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1515f0 msgr2=0x7fea3c14aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.754+0000 7fea3ad9d640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1515f0 0x7fea3c14aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.754+0000 7fea3ad9d640 1 -- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3c06dde0 msgr2=0x7fea3c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.754+0000 7fea3ad9d640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3c06dde0 0x7fea3c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:45.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.754+0000 7fea3ad9d640 1 -- 172.21.15.96:0/2727357775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30009400 con 0x7fea3c1519d0 2023-12-01T23:18:45.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.756+0000 7fea3ad9d640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c3c0 tx=0x7fea3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.760+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34005ce0 con 0x7fea3c1519d0 2023-12-01T23:18:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.760+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34005e40 con 0x7fea3c1519d0 2023-12-01T23:18:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.760+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3c14cd80 con 0x7fea3c1519d0 2023-12-01T23:18:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.760+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34007310 con 0x7fea3c1519d0 2023-12-01T23:18:45.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.760+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c14d340 con 0x7fea3c1519d0 2023-12-01T23:18:45.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:45.761+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3c067500 con 0x7fea3c1519d0 2023-12-01T23:18:46.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.004+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea34007470 con 0x7fea3c1519d0 2023-12-01T23:18:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.005+0000 7fea2affd640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 0x7fea1c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.005+0000 7fea3a59c640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 0x7fea1c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.005+0000 7fea3a59c640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 0x7fea1c06d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001ea0 tx=0x7fea2c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.017+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea34007720 con 0x7fea3c1519d0 2023-12-01T23:18:46.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.017+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea34054080 con 0x7fea3c1519d0 2023-12-01T23:18:46.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.188+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea3c06e4c0 con 0x7fea3c1519d0 2023-12-01T23:18:46.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.192+0000 7fea2affd640 1 -- 172.21.15.96:0/2727357775 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea340576a0 con 0x7fea3c1519d0 2023-12-01T23:18:46.193 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:18:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 msgr2=0x7fea1c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 0x7fea1c06d350 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fea2c001ea0 tx=0x7fea2c009040 comp rx=0 tx=0).stop 2023-12-01T23:18:46.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 msgr2=0x7fea3c14d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea3400c3c0 tx=0x7fea3400c880 comp rx=0 tx=0).stop 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 shutdown_connections 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea1c06ae90 0x7fea1c06d350 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea3c1519d0 0x7fea3c14d880 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea3c1515f0 0x7fea3c14aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 --2- 172.21.15.96:0/2727357775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3c06dde0 0x7fea3c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 >> 172.21.15.96:0/2727357775 conn(0x7fea3c0cbf60 msgr2=0x7fea3c0c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 shutdown_connections 2023-12-01T23:18:46.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.194+0000 7fea40f8a640 1 -- 172.21.15.96:0/2727357775 wait complete. 2023-12-01T23:18:46.206 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:18:46.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.308+0000 7fe38b36e640 1 Processor -- start 2023-12-01T23:18:46.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.308+0000 7fe38b36e640 1 -- start start 2023-12-01T23:18:46.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.309+0000 7fe38b36e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe38406f160 0x7fe384159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.309+0000 7fe38b36e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 0x7fe38415a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.309+0000 7fe38b36e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38406e0f0 con 0x7fe3841537d0 2023-12-01T23:18:46.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.309+0000 7fe38b36e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe384159710 con 0x7fe38406f160 2023-12-01T23:18:46.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.309+0000 7fe38b36e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3840c72d0 con 0x7fe3840c2e40 2023-12-01T23:18:46.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.310+0000 7fe388909640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe38406f160 0x7fe384159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.310+0000 7fe38990b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 0x7fe38415a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.310+0000 7fe38990b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 0x7fe38415a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:44334/0 (socket says 172.21.15.96:44334) 2023-12-01T23:18:46.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.310+0000 7fe38990b640 1 -- 172.21.15.96:0/1163935984 learned_addr learned my addr 172.21.15.96:0/1163935984 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:46.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.312+0000 7fe388909640 1 -- 172.21.15.96:0/1163935984 >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 msgr2=0x7fe38415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:46.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.312+0000 7fe388909640 1 --2- 172.21.15.96:0/1163935984 >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 0x7fe38415a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.312+0000 7fe388909640 1 -- 172.21.15.96:0/1163935984 >> v1:172.21.15.102:6789/0 conn(0x7fe3841537d0 legacy=0x7fe38406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.312+0000 7fe388909640 1 -- 172.21.15.96:0/1163935984 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840c7590 con 0x7fe38406f160 2023-12-01T23:18:46.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.314+0000 7fe388909640 1 --2- 172.21.15.96:0/1163935984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe38406f160 0x7fe384159bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe38406ee70 tx=0x7fe37402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ba2e9723aa09be server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe37bfff640 1 -- 172.21.15.96:0/1163935984 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374030610 con 0x7fe38406f160 2023-12-01T23:18:46.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe37bfff640 1 -- 172.21.15.96:0/1163935984 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374030770 con 0x7fe38406f160 2023-12-01T23:18:46.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe37bfff640 1 -- 172.21.15.96:0/1163935984 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe374030b00 con 0x7fe38406f160 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 -- 172.21.15.96:0/1163935984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe38406f160 msgr2=0x7fe384159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 --2- 172.21.15.96:0/1163935984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe38406f160 0x7fe384159bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe38406ee70 tx=0x7fe37402b960 comp rx=0 tx=0).stop 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 -- 172.21.15.96:0/1163935984 shutdown_connections 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 --2- 172.21.15.96:0/1163935984 >> v2:172.21.15.102:3300/0 conn(0x7fe3840c2e40 0x7fe38415a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 --2- 172.21.15.96:0/1163935984 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe38406f160 0x7fe384159bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 -- 172.21.15.96:0/1163935984 >> 172.21.15.96:0/1163935984 conn(0x7fe3840cbf60 msgr2=0x7fe3840cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 -- 172.21.15.96:0/1163935984 shutdown_connections 2023-12-01T23:18:46.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.318+0000 7fe38b36e640 1 -- 172.21.15.96:0/1163935984 wait complete. 2023-12-01T23:18:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 Processor -- start 2023-12-01T23:18:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 -- start start 2023-12-01T23:18:46.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38406f160 0x7fe384145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3840c2e40 0x7fe3841f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe384150880 con 0x7fe3841537d0 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38414cf70 con 0x7fe38406f160 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.320+0000 7fe38b36e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38414bd80 con 0x7fe3840c2e40 2023-12-01T23:18:46.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.321+0000 7fe38990b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.321+0000 7fe388909640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3840c2e40 0x7fe3841f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.321+0000 7fe38910a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38406f160 0x7fe384145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.321+0000 7fe38990b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47690/0 (socket says 172.21.15.96:47690) 2023-12-01T23:18:46.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.321+0000 7fe38990b640 1 -- 172.21.15.96:0/2990633878 learned_addr learned my addr 172.21.15.96:0/2990633878 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.324+0000 7fe38990b640 1 -- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3840c2e40 msgr2=0x7fe3841f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.324+0000 7fe38990b640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3840c2e40 0x7fe3841f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.324+0000 7fe38990b640 1 -- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38406f160 msgr2=0x7fe384145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.324+0000 7fe38990b640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38406f160 0x7fe384145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.324+0000 7fe38990b640 1 -- 172.21.15.96:0/2990633878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374009400 con 0x7fe3841537d0 2023-12-01T23:18:46.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.326+0000 7fe38990b640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe38000e870 tx=0x7fe38000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.330+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380009660 con 0x7fe3841537d0 2023-12-01T23:18:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.330+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000c940 con 0x7fe3841537d0 2023-12-01T23:18:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.330+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000ccf0 con 0x7fe3841537d0 2023-12-01T23:18:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.330+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38414a9e0 con 0x7fe3841537d0 2023-12-01T23:18:46.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.330+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38414d4a0 con 0x7fe3841537d0 2023-12-01T23:18:46.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.331+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe384067500 con 0x7fe3841537d0 2023-12-01T23:18:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.350+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe380013470 con 0x7fe3841537d0 2023-12-01T23:18:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.350+0000 7fe379ffb640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 0x7fe36806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.350+0000 7fe38910a640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 0x7fe36806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.351+0000 7fe38910a640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 0x7fe36806d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe37c001e70 tx=0x7fe37c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.352+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe380058d80 con 0x7fe3841537d0 2023-12-01T23:18:46.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.586+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3800550c0 con 0x7fe3841537d0 2023-12-01T23:18:46.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.758+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3840c7c30 con 0x7fe3841537d0 2023-12-01T23:18:46.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.763+0000 7fe379ffb640 1 -- 172.21.15.96:0/2990633878 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3800586e0 con 0x7fe3841537d0 2023-12-01T23:18:46.764 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 msgr2=0x7fe36806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 0x7fe36806d350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe37c001e70 tx=0x7fe37c009040 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 msgr2=0x7fe38414c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe38000e870 tx=0x7fe38000ed30 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 shutdown_connections 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe36806ae90 0x7fe36806d350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3841537d0 0x7fe38414c1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3840c2e40 0x7fe3841f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 --2- 172.21.15.96:0/2990633878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38406f160 0x7fe384145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 >> 172.21.15.96:0/2990633878 conn(0x7fe3840cbf60 msgr2=0x7fe384151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:46.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 shutdown_connections 2023-12-01T23:18:46.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.765+0000 7fe38b36e640 1 -- 172.21.15.96:0/2990633878 wait complete. 2023-12-01T23:18:46.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:18:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.878+0000 7fc45febb640 1 Processor -- start 2023-12-01T23:18:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 -- start start 2023-12-01T23:18:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4580c7b90 0x7fc45806b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4581596e0 con 0x7fc45806bb50 2023-12-01T23:18:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4580ca630 con 0x7fc4580c7b90 2023-12-01T23:18:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.879+0000 7fc45febb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c2f40 con 0x7fc4581538f0 2023-12-01T23:18:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.880+0000 7fc45d456640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4580c7b90 0x7fc45806b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.880+0000 7fc45dc57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.881+0000 7fc45dc57640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56468/0 (socket says 172.21.15.96:56468) 2023-12-01T23:18:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.881+0000 7fc45dc57640 1 -- 172.21.15.96:0/3296676763 learned_addr learned my addr 172.21.15.96:0/3296676763 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.883+0000 7fc45dc57640 1 -- 172.21.15.96:0/3296676763 >> v2:172.21.15.102:3300/0 conn(0x7fc4580c7b90 msgr2=0x7fc45806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.883+0000 7fc45dc57640 1 --2- 172.21.15.96:0/3296676763 >> v2:172.21.15.102:3300/0 conn(0x7fc4580c7b90 0x7fc45806b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.883+0000 7fc45dc57640 1 -- 172.21.15.96:0/3296676763 >> v1:172.21.15.102:6789/0 conn(0x7fc45806bb50 legacy=0x7fc458159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.883+0000 7fc45dc57640 1 -- 172.21.15.96:0/3296676763 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580c3220 con 0x7fc4581538f0 2023-12-01T23:18:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.885+0000 7fc45dc57640 1 --2- 172.21.15.96:0/3296676763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009870 tx=0x7fc44c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ad0ece929dc154 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45cc55640 1 -- 172.21.15.96:0/3296676763 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c031640 con 0x7fc4581538f0 2023-12-01T23:18:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45cc55640 1 -- 172.21.15.96:0/3296676763 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c0317a0 con 0x7fc4581538f0 2023-12-01T23:18:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45cc55640 1 -- 172.21.15.96:0/3296676763 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c031b30 con 0x7fc4581538f0 2023-12-01T23:18:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 -- 172.21.15.96:0/3296676763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 msgr2=0x7fc4580c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 --2- 172.21.15.96:0/3296676763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009870 tx=0x7fc44c02b8f0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 -- 172.21.15.96:0/3296676763 shutdown_connections 2023-12-01T23:18:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 --2- 172.21.15.96:0/3296676763 >> v2:172.21.15.102:3300/0 conn(0x7fc4580c7b90 0x7fc45806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 --2- 172.21.15.96:0/3296676763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4581538f0 0x7fc4580c8fc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.889+0000 7fc45febb640 1 -- 172.21.15.96:0/3296676763 >> 172.21.15.96:0/3296676763 conn(0x7fc458060f20 msgr2=0x7fc458061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.890+0000 7fc45febb640 1 -- 172.21.15.96:0/3296676763 shutdown_connections 2023-12-01T23:18:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.890+0000 7fc45febb640 1 -- 172.21.15.96:0/3296676763 wait complete. 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 Processor -- start 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 -- start start 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 0x7fc4581587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4581538f0 0x7fc4581469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4581f2b70 con 0x7fc4581538f0 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4581565d0 con 0x7fc45806bb50 2023-12-01T23:18:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.891+0000 7fc45febb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4581f2260 con 0x7fc4580c7b90 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45e458640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4581538f0 0x7fc4581469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45d456640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 0x7fc4581587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45dc57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45d456640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 0x7fc4581587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56484/0 (socket says 172.21.15.96:56484) 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45dc57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:35350/0 (socket says 172.21.15.96:35350) 2023-12-01T23:18:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.892+0000 7fc45d456640 1 -- 172.21.15.96:0/3414088921 learned_addr learned my addr 172.21.15.96:0/3414088921 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.895+0000 7fc45dc57640 1 -- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 msgr2=0x7fc4581587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.895+0000 7fc45dc57640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 0x7fc4581587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.895+0000 7fc45dc57640 1 -- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4581538f0 msgr2=0x7fc4581469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.895+0000 7fc45dc57640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4581538f0 0x7fc4581469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:46.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.895+0000 7fc45dc57640 1 -- 172.21.15.96:0/3414088921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0094d0 con 0x7fc45806bb50 2023-12-01T23:18:46.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.898+0000 7fc45dc57640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc44c033000 tx=0x7fc44c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.902+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c03a9f0 con 0x7fc45806bb50 2023-12-01T23:18:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.902+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c03ab90 con 0x7fc45806bb50 2023-12-01T23:18:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.902+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc458156890 con 0x7fc45806bb50 2023-12-01T23:18:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.902+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0443f0 con 0x7fc45806bb50 2023-12-01T23:18:46.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.902+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458156df0 con 0x7fc45806bb50 2023-12-01T23:18:46.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:46.903+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45806b1a0 con 0x7fc45806bb50 2023-12-01T23:18:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.143+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc44c02f050 con 0x7fc45806bb50 2023-12-01T23:18:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.143+0000 7fc44a7fc640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 0x7fc43c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.143+0000 7fc45d456640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 0x7fc43c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.144+0000 7fc45d456640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 0x7fc43c06d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc458159950 tx=0x7fc454009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:47.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.146+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc44c07a300 con 0x7fc45806bb50 2023-12-01T23:18:47.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.157+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc44c076640 con 0x7fc45806bb50 2023-12-01T23:18:47.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.324+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc458067500 con 0x7fc45806bb50 2023-12-01T23:18:47.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.345+0000 7fc44a7fc640 1 -- 172.21.15.96:0/3414088921 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc44c079c60 con 0x7fc45806bb50 2023-12-01T23:18:47.346 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:18:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 msgr2=0x7fc43c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 0x7fc43c06d380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc458159950 tx=0x7fc454009190 comp rx=0 tx=0).stop 2023-12-01T23:18:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 msgr2=0x7fc458153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc44c033000 tx=0x7fc44c0046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 shutdown_connections 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc43c06aec0 0x7fc43c06d380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4581538f0 0x7fc4581469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4580c7b90 0x7fc4581587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 --2- 172.21.15.96:0/3414088921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc45806bb50 0x7fc458153f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 >> 172.21.15.96:0/3414088921 conn(0x7fc458060f20 msgr2=0x7fc458159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 shutdown_connections 2023-12-01T23:18:47.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.347+0000 7fc45febb640 1 -- 172.21.15.96:0/3414088921 wait complete. 2023-12-01T23:18:47.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:18:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.460+0000 7f1423aa6640 1 Processor -- start 2023-12-01T23:18:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.460+0000 7f1423aa6640 1 -- start start 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c153be0 0x7f141c159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f141c06fa00 0x7f141c0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 0x7f141c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c0c3340 con 0x7f141c06fa00 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141c153fc0 con 0x7f141c0c5e60 2023-12-01T23:18:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1423aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c06b7b0 con 0x7f141c153be0 2023-12-01T23:18:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.461+0000 7f1421041640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f141c06fa00 0x7f141c0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.462+0000 7f1421842640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c153be0 0x7f141c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.462+0000 7f1422043640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 0x7f141c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.462+0000 7f1421041640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f141c06fa00 0x7f141c0c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54346/0 (socket says 172.21.15.96:54346) 2023-12-01T23:18:47.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.462+0000 7f1421041640 1 -- 172.21.15.96:0/2002980779 learned_addr learned my addr 172.21.15.96:0/2002980779 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1421041640 1 -- 172.21.15.96:0/2002980779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c153be0 msgr2=0x7f141c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1421041640 1 --2- 172.21.15.96:0/2002980779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c153be0 0x7f141c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1421041640 1 -- 172.21.15.96:0/2002980779 >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 msgr2=0x7f141c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1421041640 1 --2- 172.21.15.96:0/2002980779 >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 0x7f141c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1421041640 1 -- 172.21.15.96:0/2002980779 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c06ba90 con 0x7f141c06fa00 2023-12-01T23:18:47.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.464+0000 7f1422043640 1 --2- 172.21.15.96:0/2002980779 >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 0x7f141c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:18:47.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.466+0000 7f1421041640 1 --2- 172.21.15.96:0/2002980779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c06fa00 0x7f141c0c41b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f141c15a990 tx=0x7f140c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d894d7dac57ee50 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.469+0000 7f1420840640 1 -- 172.21.15.96:0/2002980779 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c031870 con 0x7f141c06fa00 2023-12-01T23:18:47.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.469+0000 7f1420840640 1 -- 172.21.15.96:0/2002980779 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c0319d0 con 0x7f141c06fa00 2023-12-01T23:18:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1420840640 1 -- 172.21.15.96:0/2002980779 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c031d60 con 0x7f141c06fa00 2023-12-01T23:18:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 -- 172.21.15.96:0/2002980779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c06fa00 msgr2=0x7f141c0c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2002980779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c06fa00 0x7f141c0c41b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f141c15a990 tx=0x7f140c02b910 comp rx=0 tx=0).stop 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 -- 172.21.15.96:0/2002980779 shutdown_connections 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2002980779 >> v2:172.21.15.102:3300/0 conn(0x7f141c0c5e60 0x7f141c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2002980779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c06fa00 0x7f141c0c41b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2002980779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c153be0 0x7f141c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 -- 172.21.15.96:0/2002980779 >> 172.21.15.96:0/2002980779 conn(0x7f141c0c7f60 msgr2=0x7f141c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 -- 172.21.15.96:0/2002980779 shutdown_connections 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.470+0000 7f1423aa6640 1 -- 172.21.15.96:0/2002980779 wait complete. 2023-12-01T23:18:47.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 Processor -- start 2023-12-01T23:18:47.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 -- start start 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 0x7f141c071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f141c0c5e60 0x7f141c1ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 0x7f141c1efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c1595a0 con 0x7f141c153be0 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c15a6f0 con 0x7f141c0c5e60 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.472+0000 7f1423aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c158990 con 0x7f141c06fa00 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.473+0000 7f1422043640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 0x7f141c1efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.473+0000 7f1421842640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 0x7f141c071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.473+0000 7f1421041640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f141c0c5e60 0x7f141c1ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.473+0000 7f1422043640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 0x7f141c1efaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54348/0 (socket says 172.21.15.96:54348) 2023-12-01T23:18:47.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.473+0000 7f1422043640 1 -- 172.21.15.96:0/2911006438 learned_addr learned my addr 172.21.15.96:0/2911006438 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.476+0000 7f1421842640 1 -- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f141c0c5e60 msgr2=0x7f141c1ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.476+0000 7f1421842640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f141c0c5e60 0x7f141c1ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.476+0000 7f1421842640 1 -- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 msgr2=0x7f141c1efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.476+0000 7f1421842640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 0x7f141c1efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.477+0000 7f1421842640 1 -- 172.21.15.96:0/2911006438 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414009a70 con 0x7f141c06fa00 2023-12-01T23:18:47.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.479+0000 7f1421842640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 0x7f141c071bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f141800e870 tx=0x7f141800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:47.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.481+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800ee60 con 0x7f141c06fa00 2023-12-01T23:18:47.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.481+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0094d0 con 0x7f141c06fa00 2023-12-01T23:18:47.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.481+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c158f50 con 0x7f141c06fa00 2023-12-01T23:18:47.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.482+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c067500 con 0x7f141c06fa00 2023-12-01T23:18:47.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.483+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418005990 con 0x7f141c06fa00 2023-12-01T23:18:47.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.483+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418005d00 con 0x7f141c06fa00 2023-12-01T23:18:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.726+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f141800c940 con 0x7f141c06fa00 2023-12-01T23:18:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.727+0000 7f14127fc640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 0x7f140006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:47.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.727+0000 7f1421041640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 0x7f140006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:47.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.727+0000 7f1421041640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 0x7f140006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f140c036000 tx=0x7f140c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.731+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1418058b90 con 0x7f141c06fa00 2023-12-01T23:18:47.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.743+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1418054ed0 con 0x7f141c06fa00 2023-12-01T23:18:47.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.913+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f141c071720 con 0x7f141c06fa00 2023-12-01T23:18:47.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.934+0000 7f14127fc640 1 -- 172.21.15.96:0/2911006438 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1418021020 con 0x7f141c06fa00 2023-12-01T23:18:47.935 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 msgr2=0x7f140006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 0x7f140006d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f140c036000 tx=0x7f140c03c040 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 msgr2=0x7f141c071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 0x7f141c071bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f141800e870 tx=0x7f141800ed30 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 shutdown_connections 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f140006ae40 0x7f140006d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c153be0 0x7f141c1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f141c0c5e60 0x7f141c1ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 --2- 172.21.15.96:0/2911006438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f141c06fa00 0x7f141c071bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.935+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 >> 172.21.15.96:0/2911006438 conn(0x7f141c0c7f60 msgr2=0x7f141c152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:47.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.936+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 shutdown_connections 2023-12-01T23:18:47.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:47.936+0000 7f1423aa6640 1 -- 172.21.15.96:0/2911006438 wait complete. 2023-12-01T23:18:47.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T23:18:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.047+0000 7f0c33a87640 1 Processor -- start 2023-12-01T23:18:48.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.047+0000 7f0c33a87640 1 -- start start 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c33a87640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c33a87640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c2c0710e0 0x7f0c2c153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c33a87640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c0ca6c0 con 0x7f0c2c0c7700 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c33a87640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c15da60 con 0x7f0c2c0710e0 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c33a87640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c159880 con 0x7f0c2c070d00 2023-12-01T23:18:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c31022640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0c2c0710e0 0x7f0c2c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c31823640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c32024640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0c2c0c7700 0x7f0c2c0c8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:41234/0 (socket says 172.21.15.96:41234) 2023-12-01T23:18:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.048+0000 7f0c32024640 1 -- 172.21.15.96:0/2746638545 learned_addr learned my addr 172.21.15.96:0/2746638545 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.051+0000 7f0c31823640 1 -- 172.21.15.96:0/2746638545 >> v2:172.21.15.96:3300/0 conn(0x7f0c2c0710e0 msgr2=0x7f0c2c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.051+0000 7f0c31823640 1 --2- 172.21.15.96:0/2746638545 >> v2:172.21.15.96:3300/0 conn(0x7f0c2c0710e0 0x7f0c2c153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.051+0000 7f0c31823640 1 -- 172.21.15.96:0/2746638545 >> v1:172.21.15.102:6789/0 conn(0x7f0c2c0c7700 legacy=0x7f0c2c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.051+0000 7f0c31823640 1 -- 172.21.15.96:0/2746638545 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c159b60 con 0x7f0c2c070d00 2023-12-01T23:18:48.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.053+0000 7f0c31823640 1 --2- 172.21.15.96:0/2746638545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c15d520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097a0 tx=0x7f0c2802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e357fe15c0cca9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.056+0000 7f0c30821640 1 -- 172.21.15.96:0/2746638545 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28030610 con 0x7f0c2c070d00 2023-12-01T23:18:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.056+0000 7f0c30821640 1 -- 172.21.15.96:0/2746638545 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28030770 con 0x7f0c2c070d00 2023-12-01T23:18:48.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.056+0000 7f0c30821640 1 -- 172.21.15.96:0/2746638545 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28030b00 con 0x7f0c2c070d00 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 -- 172.21.15.96:0/2746638545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 msgr2=0x7f0c2c15d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2746638545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c15d520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097a0 tx=0x7f0c2802b960 comp rx=0 tx=0).stop 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 -- 172.21.15.96:0/2746638545 shutdown_connections 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2746638545 >> v2:172.21.15.96:3300/0 conn(0x7f0c2c0710e0 0x7f0c2c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2746638545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c15d520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 -- 172.21.15.96:0/2746638545 >> 172.21.15.96:0/2746638545 conn(0x7f0c2c06ab30 msgr2=0x7f0c2c06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 -- 172.21.15.96:0/2746638545 shutdown_connections 2023-12-01T23:18:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.057+0000 7f0c33a87640 1 -- 172.21.15.96:0/2746638545 wait complete. 2023-12-01T23:18:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.058+0000 7f0c33a87640 1 Processor -- start 2023-12-01T23:18:48.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.058+0000 7f0c33a87640 1 -- start start 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c1ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c2c0c7700 0x7f0c2c153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c1e2d10 con 0x7f0c2c0710e0 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c153cc0 con 0x7f0c2c0c7700 2023-12-01T23:18:48.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.059+0000 7f0c33a87640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c0c6860 con 0x7f0c2c070d00 2023-12-01T23:18:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.060+0000 7f0c31022640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.060+0000 7f0c31823640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c1ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.060+0000 7f0c32024640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c2c0c7700 0x7f0c2c153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.060+0000 7f0c31022640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54376/0 (socket says 172.21.15.96:54376) 2023-12-01T23:18:48.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.060+0000 7f0c31022640 1 -- 172.21.15.96:0/2607883395 learned_addr learned my addr 172.21.15.96:0/2607883395 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.063+0000 7f0c31022640 1 -- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 msgr2=0x7f0c2c1ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.063+0000 7f0c31022640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c1ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.063+0000 7f0c31022640 1 -- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c2c0c7700 msgr2=0x7f0c2c153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.063+0000 7f0c31022640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c2c0c7700 0x7f0c2c153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.063+0000 7f0c31022640 1 -- 172.21.15.96:0/2607883395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009400 con 0x7f0c2c0710e0 2023-12-01T23:18:48.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.065+0000 7f0c31022640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e9b0 tx=0x7f0c1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.069+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c009670 con 0x7f0c2c0710e0 2023-12-01T23:18:48.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.069+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00c9a0 con 0x7f0c2c0710e0 2023-12-01T23:18:48.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.069+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00cd50 con 0x7f0c2c0710e0 2023-12-01T23:18:48.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.069+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c154480 con 0x7f0c2c0710e0 2023-12-01T23:18:48.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.069+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c1541a0 con 0x7f0c2c0710e0 2023-12-01T23:18:48.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.070+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c0c69f0 con 0x7f0c2c0710e0 2023-12-01T23:18:48.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.310+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c1c013470 con 0x7f0c2c0710e0 2023-12-01T23:18:48.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.311+0000 7f0c227fc640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 0x7f0c1006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.311+0000 7f0c31823640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 0x7f0c1006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.311+0000 7f0c31823640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 0x7f0c1006d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c28036000 tx=0x7f0c28008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.324+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0c1c0589b0 con 0x7f0c2c0710e0 2023-12-01T23:18:48.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.324+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c1c054cf0 con 0x7f0c2c0710e0 2023-12-01T23:18:48.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.503+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c2c067500 con 0x7f0c2c0710e0 2023-12-01T23:18:48.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.508+0000 7f0c227fc640 1 -- 172.21.15.96:0/2607883395 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c1c021080 con 0x7f0c2c0710e0 2023-12-01T23:18:48.510 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-12-01T23:18:48.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.510+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 msgr2=0x7f0c1006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.510+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 0x7f0c1006d350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c28036000 tx=0x7f0c28008030 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.510+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 msgr2=0x7f0c2c0c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.510+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c00e9b0 tx=0x7f0c1c00ee70 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 shutdown_connections 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0c1006ae90 0x7f0c1006d350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c2c0c7700 0x7f0c2c153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0c2c0710e0 0x7f0c2c0c6cf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 --2- 172.21.15.96:0/2607883395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c2c070d00 0x7f0c2c1ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 >> 172.21.15.96:0/2607883395 conn(0x7f0c2c06ab30 msgr2=0x7f0c2c1573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 shutdown_connections 2023-12-01T23:18:48.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.511+0000 7f0c33a87640 1 -- 172.21.15.96:0/2607883395 wait complete. 2023-12-01T23:18:48.522 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:18:48.522 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T23:18:48.537 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:48.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.677+0000 7fbcac83d640 1 Processor -- start 2023-12-01T23:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.677+0000 7fbcac83d640 1 -- start start 2023-12-01T23:18:48.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbcac83d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 0x7fbca8159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbcac83d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbcac83d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8153fc0 con 0x7fbca806fa00 2023-12-01T23:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbcac83d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca80c3340 con 0x7fbca8153be0 2023-12-01T23:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbcac83d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca806b7b0 con 0x7fbca80c5e60 2023-12-01T23:18:48.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.678+0000 7fbca659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 0x7fbca8159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.679+0000 7fbca6d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.679+0000 7fbca6d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56534/0 (socket says 172.21.15.96:56534) 2023-12-01T23:18:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.679+0000 7fbca659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 0x7fbca8159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:35394/0 (socket says 172.21.15.96:35394) 2023-12-01T23:18:48.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.679+0000 7fbca6d9d640 1 -- 172.21.15.96:0/3839290393 learned_addr learned my addr 172.21.15.96:0/3839290393 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.681+0000 7fbca6d9d640 1 -- 172.21.15.96:0/3839290393 >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 msgr2=0x7fbca8159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.681+0000 7fbca6d9d640 1 --2- 172.21.15.96:0/3839290393 >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 0x7fbca8159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.681+0000 7fbca6d9d640 1 -- 172.21.15.96:0/3839290393 >> v1:172.21.15.102:6789/0 conn(0x7fbca806fa00 legacy=0x7fbca80c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.681+0000 7fbca6d9d640 1 -- 172.21.15.96:0/3839290393 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca806ba90 con 0x7fbca80c5e60 2023-12-01T23:18:48.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.683+0000 7fbca6d9d640 1 --2- 172.21.15.96:0/3839290393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009e50 tx=0x7fbca002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c3fda7b574b2f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.686+0000 7fbca559a640 1 -- 172.21.15.96:0/3839290393 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca002cb00 con 0x7fbca80c5e60 2023-12-01T23:18:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.687+0000 7fbca559a640 1 -- 172.21.15.96:0/3839290393 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca002cc60 con 0x7fbca80c5e60 2023-12-01T23:18:48.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.687+0000 7fbca559a640 1 -- 172.21.15.96:0/3839290393 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00343f0 con 0x7fbca80c5e60 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 -- 172.21.15.96:0/3839290393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 msgr2=0x7fbca81641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 --2- 172.21.15.96:0/3839290393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009e50 tx=0x7fbca002bf60 comp rx=0 tx=0).stop 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 -- 172.21.15.96:0/3839290393 shutdown_connections 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 --2- 172.21.15.96:0/3839290393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca80c5e60 0x7fbca81641b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 --2- 172.21.15.96:0/3839290393 >> v2:172.21.15.102:3300/0 conn(0x7fbca8153be0 0x7fbca8159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 -- 172.21.15.96:0/3839290393 >> 172.21.15.96:0/3839290393 conn(0x7fbca80c7f60 msgr2=0x7fbca80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:48.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 -- 172.21.15.96:0/3839290393 shutdown_connections 2023-12-01T23:18:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.688+0000 7fbcac83d640 1 -- 172.21.15.96:0/3839290393 wait complete. 2023-12-01T23:18:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 Processor -- start 2023-12-01T23:18:48.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 -- start start 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca806fa00 0x7fbca8147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbca80c5e60 0x7fbca8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81598b0 con 0x7fbca8153be0 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81476a0 con 0x7fbca80c5e60 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.690+0000 7fbcac83d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca814b650 con 0x7fbca806fa00 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.691+0000 7fbca6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.691+0000 7fbca5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbca80c5e60 0x7fbca8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.691+0000 7fbca659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca806fa00 0x7fbca8147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.691+0000 7fbca6d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54378/0 (socket says 172.21.15.96:54378) 2023-12-01T23:18:48.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.691+0000 7fbca6d9d640 1 -- 172.21.15.96:0/769267651 learned_addr learned my addr 172.21.15.96:0/769267651 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.694+0000 7fbca6d9d640 1 -- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca806fa00 msgr2=0x7fbca8147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.694+0000 7fbca6d9d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca806fa00 0x7fbca8147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.694+0000 7fbca6d9d640 1 -- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbca80c5e60 msgr2=0x7fbca8159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:48.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.694+0000 7fbca6d9d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbca80c5e60 0x7fbca8159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:48.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.694+0000 7fbca6d9d640 1 -- 172.21.15.96:0/769267651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009b30 con 0x7fbca8153be0 2023-12-01T23:18:48.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.697+0000 7fbca6d9d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009e50 tx=0x7fbca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.700+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0009510 con 0x7fbca8153be0 2023-12-01T23:18:48.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.701+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca003e450 con 0x7fbca8153be0 2023-12-01T23:18:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.701+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca81f0290 con 0x7fbca8153be0 2023-12-01T23:18:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.701+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca003e800 con 0x7fbca8153be0 2023-12-01T23:18:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.701+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca81577d0 con 0x7fbca8153be0 2023-12-01T23:18:48.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.701+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca8159a60 con 0x7fbca8153be0 2023-12-01T23:18:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.721+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbca003e960 con 0x7fbca8153be0 2023-12-01T23:18:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.721+0000 7fbc96ffd640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 0x7fbc8806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:48.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.721+0000 7fbca659c640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 0x7fbc8806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:48.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.722+0000 7fbca659c640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 0x7fbc8806d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009aa0 tx=0x7fbc9c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.956+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbca007b1c0 con 0x7fbca8153be0 2023-12-01T23:18:48.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:48.957+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbca0077500 con 0x7fbca8153be0 2023-12-01T23:18:49.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.132+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca8067500 con 0x7fbca8153be0 2023-12-01T23:18:49.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.178+0000 7fbc96ffd640 1 -- 172.21.15.96:0/769267651 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fbca007ab20 con 0x7fbca8153be0 2023-12-01T23:18:49.180 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:49.180 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 msgr2=0x7fbc8806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 0x7fbc8806d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009aa0 tx=0x7fbc9c009190 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 msgr2=0x7fbca81f29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009e50 tx=0x7fbca0004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 shutdown_connections 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc8806aec0 0x7fbc8806d380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbca8153be0 0x7fbca81f29d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbca80c5e60 0x7fbca8159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 --2- 172.21.15.96:0/769267651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbca806fa00 0x7fbca8147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.180+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 >> 172.21.15.96:0/769267651 conn(0x7fbca80c7f60 msgr2=0x7fbca8071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.181+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 shutdown_connections 2023-12-01T23:18:49.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.181+0000 7fbcac83d640 1 -- 172.21.15.96:0/769267651 wait complete. 2023-12-01T23:18:49.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:18:49.193 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:18:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.295+0000 7f5285100640 1 Processor -- start 2023-12-01T23:18:49.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.295+0000 7f5285100640 1 -- start start 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.296+0000 7f5285100640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52801501c0 0x7f5280159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.296+0000 7f5285100640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5280072b60 con 0x7f52800bff00 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.296+0000 7f5285100640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52800c1a90 con 0x7f5280156e60 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.296+0000 7f5285100640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52801572d0 con 0x7f52801501c0 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.296+0000 7f527ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f52801501c0 0x7f5280159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.297+0000 7f527f59e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5280156e60 0x7f5280071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:41242/0 (socket says 172.21.15.96:41242) 2023-12-01T23:18:49.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.297+0000 7f527f59e640 1 -- 172.21.15.96:0/3799832164 learned_addr learned my addr 172.21.15.96:0/3799832164 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:49.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.299+0000 7f527dd9b640 1 -- 172.21.15.96:0/3799832164 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936125414 0 0) 0x7f52800c1a90 con 0x7f5280156e60 2023-12-01T23:18:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.299+0000 7f527dd9b640 1 -- 172.21.15.96:0/3799832164 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5268003520 con 0x7f5280156e60 2023-12-01T23:18:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.300+0000 7f527ed9d640 1 -- 172.21.15.96:0/3799832164 >> v1:172.21.15.102:6789/0 conn(0x7f5280156e60 legacy=0x7f5280071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.300+0000 7f527ed9d640 1 -- 172.21.15.96:0/3799832164 >> v1:172.21.15.96:6789/0 conn(0x7f52800bff00 legacy=0x7f5280072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.300+0000 7f527ed9d640 1 -- 172.21.15.96:0/3799832164 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800c1d30 con 0x7f52801501c0 2023-12-01T23:18:49.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.304+0000 7f527ed9d640 1 --2- 172.21.15.96:0/3799832164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280159860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d90 tx=0x7f527002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ba8d85765a480e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:49.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.306+0000 7f527dd9b640 1 -- 172.21.15.96:0/3799832164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527002cd80 con 0x7f52801501c0 2023-12-01T23:18:49.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f527dd9b640 1 -- 172.21.15.96:0/3799832164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5270034440 con 0x7f52801501c0 2023-12-01T23:18:49.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f527dd9b640 1 -- 172.21.15.96:0/3799832164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700347b0 con 0x7f52801501c0 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 -- 172.21.15.96:0/3799832164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 msgr2=0x7f5280159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 --2- 172.21.15.96:0/3799832164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280159860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d90 tx=0x7f527002bfd0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 -- 172.21.15.96:0/3799832164 shutdown_connections 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 --2- 172.21.15.96:0/3799832164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280159860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 -- 172.21.15.96:0/3799832164 >> 172.21.15.96:0/3799832164 conn(0x7f528006cd60 msgr2=0x7f528006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:49.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 -- 172.21.15.96:0/3799832164 shutdown_connections 2023-12-01T23:18:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.308+0000 7f5285100640 1 -- 172.21.15.96:0/3799832164 wait complete. 2023-12-01T23:18:49.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.310+0000 7f5285100640 1 Processor -- start 2023-12-01T23:18:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.310+0000 7f5285100640 1 -- start start 2023-12-01T23:18:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52800bff00 0x7f52801527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5280156e60 0x7f5280158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280155810 con 0x7f52801501c0 2023-12-01T23:18:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52801511c0 con 0x7f5280156e60 2023-12-01T23:18:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f5285100640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52801520a0 con 0x7f52800bff00 2023-12-01T23:18:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f527e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f527e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54392/0 (socket says 172.21.15.96:54392) 2023-12-01T23:18:49.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f527e59c640 1 -- 172.21.15.96:0/1683079826 learned_addr learned my addr 172.21.15.96:0/1683079826 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:49.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f527f59e640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5280156e60 0x7f5280158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.311+0000 7f527ed9d640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52800bff00 0x7f52801527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.315+0000 7f527e59c640 1 -- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52800bff00 msgr2=0x7f52801527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.315+0000 7f527e59c640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52800bff00 0x7f52801527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.315+0000 7f527e59c640 1 -- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5280156e60 msgr2=0x7f5280158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.315+0000 7f527e59c640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5280156e60 0x7f5280158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.315+0000 7f527e59c640 1 -- 172.21.15.96:0/1683079826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009a70 con 0x7f52801501c0 2023-12-01T23:18:49.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.317+0000 7f527e59c640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f527400c400 tx=0x7f527400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.320+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740052d0 con 0x7f52801501c0 2023-12-01T23:18:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.320+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5274005430 con 0x7f52801501c0 2023-12-01T23:18:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.320+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274003830 con 0x7f52801501c0 2023-12-01T23:18:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.320+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280150c00 con 0x7f52801501c0 2023-12-01T23:18:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.321+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5280155430 con 0x7f52801501c0 2023-12-01T23:18:49.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.321+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52800c77e0 con 0x7f52801501c0 2023-12-01T23:18:49.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.340+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5274003990 con 0x7f52801501c0 2023-12-01T23:18:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.340+0000 7f52677fe640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 0x7f526c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.340+0000 7f527ed9d640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 0x7f526c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.340+0000 7f527ed9d640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 0x7f526c06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5270036000 tx=0x7f5270030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.576+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5274057db0 con 0x7f52801501c0 2023-12-01T23:18:49.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.576+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52740540f0 con 0x7f52801501c0 2023-12-01T23:18:49.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.746+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5280155950 con 0x7f52801501c0 2023-12-01T23:18:49.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.751+0000 7f52677fe640 1 -- 172.21.15.96:0/1683079826 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5274017020 con 0x7f52801501c0 2023-12-01T23:18:49.752 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:18:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 msgr2=0x7f526c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 0x7f526c06d350 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5270036000 tx=0x7f5270030000 comp rx=0 tx=0).stop 2023-12-01T23:18:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 msgr2=0x7f5280155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f527400c400 tx=0x7f527400c8c0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 shutdown_connections 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f526c06ae90 0x7f526c06d350 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5280156e60 0x7f5280158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52801501c0 0x7f5280155c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 --2- 172.21.15.96:0/1683079826 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f52800bff00 0x7f52801527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 >> 172.21.15.96:0/1683079826 conn(0x7f528006cd60 msgr2=0x7f5280072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 shutdown_connections 2023-12-01T23:18:49.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.753+0000 7f5285100640 1 -- 172.21.15.96:0/1683079826 wait complete. 2023-12-01T23:18:49.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:18:49.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.867+0000 7fa14c04f640 1 Processor -- start 2023-12-01T23:18:49.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.867+0000 7fa14c04f640 1 -- start start 2023-12-01T23:18:49.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.868+0000 7fa14c04f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa144070d00 0x7fa14415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.868+0000 7fa14c04f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa144153a90 0x7fa1440c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.868+0000 7fa14c04f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1440ca6c0 con 0x7fa1440710e0 2023-12-01T23:18:49.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.868+0000 7fa14c04f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14415da60 con 0x7fa144070d00 2023-12-01T23:18:49.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.868+0000 7fa14c04f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa144159880 con 0x7fa144153a90 2023-12-01T23:18:49.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.869+0000 7fa149deb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa144070d00 0x7fa14415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.869+0000 7fa14a5ec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa144153a90 0x7fa1440c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.869+0000 7fa149deb640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa144070d00 0x7fa14415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54408/0 (socket says 172.21.15.96:54408) 2023-12-01T23:18:49.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.869+0000 7fa149deb640 1 -- 172.21.15.96:0/2300896685 learned_addr learned my addr 172.21.15.96:0/2300896685 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:49.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.871+0000 7fa149deb640 1 -- 172.21.15.96:0/2300896685 >> v2:172.21.15.102:3300/0 conn(0x7fa144153a90 msgr2=0x7fa1440c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:49.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.871+0000 7fa149deb640 1 --2- 172.21.15.96:0/2300896685 >> v2:172.21.15.102:3300/0 conn(0x7fa144153a90 0x7fa1440c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.871+0000 7fa149deb640 1 -- 172.21.15.96:0/2300896685 >> v1:172.21.15.102:6789/0 conn(0x7fa1440710e0 legacy=0x7fa144153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.871+0000 7fa149deb640 1 -- 172.21.15.96:0/2300896685 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144159b60 con 0x7fa144070d00 2023-12-01T23:18:49.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.873+0000 7fa149deb640 1 --2- 172.21.15.96:0/2300896685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa14415d520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa14406fc00 tx=0x7fa14002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b439f3bfc46ab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:49.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.876+0000 7fa148de9640 1 -- 172.21.15.96:0/2300896685 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002cbb0 con 0x7fa144070d00 2023-12-01T23:18:49.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.876+0000 7fa148de9640 1 -- 172.21.15.96:0/2300896685 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14002cd10 con 0x7fa144070d00 2023-12-01T23:18:49.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.876+0000 7fa148de9640 1 -- 172.21.15.96:0/2300896685 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140034610 con 0x7fa144070d00 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 -- 172.21.15.96:0/2300896685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 msgr2=0x7fa14415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 --2- 172.21.15.96:0/2300896685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa14415d520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa14406fc00 tx=0x7fa14002c010 comp rx=0 tx=0).stop 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 -- 172.21.15.96:0/2300896685 shutdown_connections 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 --2- 172.21.15.96:0/2300896685 >> v2:172.21.15.102:3300/0 conn(0x7fa144153a90 0x7fa1440c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 --2- 172.21.15.96:0/2300896685 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa14415d520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 -- 172.21.15.96:0/2300896685 >> 172.21.15.96:0/2300896685 conn(0x7fa14406ab30 msgr2=0x7fa14406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 -- 172.21.15.96:0/2300896685 shutdown_connections 2023-12-01T23:18:49.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.877+0000 7fa14c04f640 1 -- 172.21.15.96:0/2300896685 wait complete. 2023-12-01T23:18:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.878+0000 7fa14c04f640 1 Processor -- start 2023-12-01T23:18:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.878+0000 7fa14c04f640 1 -- start start 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1440710e0 0x7fa1441f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa144153a90 0x7fa1441522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1441ee980 con 0x7fa144070d00 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14415bf20 con 0x7fa144153a90 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa14c04f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14415c5e0 con 0x7fa1440710e0 2023-12-01T23:18:49.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.879+0000 7fa149deb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.880+0000 7fa149deb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54422/0 (socket says 172.21.15.96:54422) 2023-12-01T23:18:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.880+0000 7fa149deb640 1 -- 172.21.15.96:0/3211987499 learned_addr learned my addr 172.21.15.96:0/3211987499 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.880+0000 7fa14a5ec640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa144153a90 0x7fa1441522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.880+0000 7fa1495ea640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1440710e0 0x7fa1441f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:49.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.883+0000 7fa149deb640 1 -- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1440710e0 msgr2=0x7fa1441f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.883+0000 7fa149deb640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1440710e0 0x7fa1441f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.883+0000 7fa149deb640 1 -- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa144153a90 msgr2=0x7fa1441522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.883+0000 7fa149deb640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa144153a90 0x7fa1441522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:49.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.883+0000 7fa149deb640 1 -- 172.21.15.96:0/3211987499 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140009b30 con 0x7fa144070d00 2023-12-01T23:18:49.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.885+0000 7fa149deb640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa140036040 tx=0x7fa140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.888+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140009510 con 0x7fa144070d00 2023-12-01T23:18:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.888+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14003e450 con 0x7fa144070d00 2023-12-01T23:18:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.888+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1441f2430 con 0x7fa144070d00 2023-12-01T23:18:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.888+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14003e800 con 0x7fa144070d00 2023-12-01T23:18:49.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.888+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1441eeb90 con 0x7fa144070d00 2023-12-01T23:18:49.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:49.889+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa144067500 con 0x7fa144070d00 2023-12-01T23:18:50.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.132+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa14003e960 con 0x7fa144070d00 2023-12-01T23:18:50.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.132+0000 7fa13a7fc640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 0x7fa12806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.132+0000 7fa1495ea640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 0x7fa12806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:50.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.133+0000 7fa1495ea640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 0x7fa12806d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1440b2130 tx=0x7fa134009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.146+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa14007b7a0 con 0x7fa144070d00 2023-12-01T23:18:50.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.146+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa140077ae0 con 0x7fa144070d00 2023-12-01T23:18:50.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.322+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa14414c030 con 0x7fa144070d00 2023-12-01T23:18:50.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.369+0000 7fa13a7fc640 1 -- 172.21.15.96:0/3211987499 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa140043020 con 0x7fa144070d00 2023-12-01T23:18:50.370 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 msgr2=0x7fa12806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 0x7fa12806d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa1440b2130 tx=0x7fa134009040 comp rx=0 tx=0).stop 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 msgr2=0x7fa1440c4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa140036040 tx=0x7fa140004a40 comp rx=0 tx=0).stop 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 shutdown_connections 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa12806ae40 0x7fa12806d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa144153a90 0x7fa1441522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1440710e0 0x7fa1441f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 --2- 172.21.15.96:0/3211987499 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa144070d00 0x7fa1440c4ae0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 >> 172.21.15.96:0/3211987499 conn(0x7fa14406ab30 msgr2=0x7fa144158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:50.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 shutdown_connections 2023-12-01T23:18:50.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.371+0000 7fa14c04f640 1 -- 172.21.15.96:0/3211987499 wait complete. 2023-12-01T23:18:50.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:18:50.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.487+0000 7f8c84cc2640 1 Processor -- start 2023-12-01T23:18:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.487+0000 7f8c84cc2640 1 -- start start 2023-12-01T23:18:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.488+0000 7f8c84cc2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8c8015d830 0x7f8c801533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.488+0000 7f8c84cc2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8015cc90 con 0x7f8c800ca1b0 2023-12-01T23:18:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.488+0000 7f8c84cc2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c801598b0 con 0x7f8c800c9dd0 2023-12-01T23:18:50.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.488+0000 7f8c84cc2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c801596a0 con 0x7f8c8015d830 2023-12-01T23:18:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.489+0000 7f8c77fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f8c800ca1b0 0x7f8c8015d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38942/0 (socket says 172.21.15.96:38942) 2023-12-01T23:18:50.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.489+0000 7f8c77fff640 1 -- 172.21.15.96:0/788252388 learned_addr learned my addr 172.21.15.96:0/788252388 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.491+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455174580 0 0) 0x7f8c8015cc90 con 0x7f8c800ca1b0 2023-12-01T23:18:50.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.491+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6c003520 con 0x7f8c800ca1b0 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350597370 0 0) 0x7f8c6c003520 con 0x7f8c800ca1b0 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 >> v2:172.21.15.102:3300/0 conn(0x7f8c8015d830 msgr2=0x7f8c801533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 --2- 172.21.15.96:0/788252388 >> v2:172.21.15.102:3300/0 conn(0x7f8c8015d830 0x7f8c801533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 >> v1:172.21.15.102:6789/0 conn(0x7f8c800c9dd0 legacy=0x7f8c800c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80159b90 con 0x7f8c800ca1b0 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f8c68001670 con 0x7f8c800ca1b0 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 >> v1:172.21.15.96:6789/0 conn(0x7f8c800ca1b0 legacy=0x7f8c8015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c6c0039c0 0x7f8c6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 0x7f8c6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c801596a0 con 0x7f8c6c0052a0 2023-12-01T23:18:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c00c1e0 con 0x7f8c6c0039c0 2023-12-01T23:18:50.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.495+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c00c3a0 con 0x7f8c6c0047c0 2023-12-01T23:18:50.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.497+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 0x7f8c6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:50.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0047c0 msgr2=0x7f8c6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:50.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0047c0 0x7f8c6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c6c0039c0 msgr2=0x7f8c6c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:50.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c6c0039c0 0x7f8c6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/788252388 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c003520 con 0x7f8c6c0052a0 2023-12-01T23:18:50.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.500+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/788252388 reap_dead start 2023-12-01T23:18:50.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.502+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 0x7f8c6c00b980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e10 tx=0x7f8c6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12800e8b6075eb74 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.505+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802cd50 con 0x7f8c6c0052a0 2023-12-01T23:18:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.505+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c78003990 con 0x7f8c6c0052a0 2023-12-01T23:18:50.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.505+0000 7f8c7dd9b640 1 -- 172.21.15.96:0/788252388 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78003d20 con 0x7f8c6c0052a0 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 -- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 msgr2=0x7f8c6c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 0x7f8c6c00b980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009e10 tx=0x7f8c6c0057f0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 -- 172.21.15.96:0/788252388 shutdown_connections 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/788252388 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c6c0052a0 0x7f8c6c00b980 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 -- 172.21.15.96:0/788252388 >> 172.21.15.96:0/788252388 conn(0x7f8c80061100 msgr2=0x7f8c800614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 -- 172.21.15.96:0/788252388 shutdown_connections 2023-12-01T23:18:50.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.506+0000 7f8c84cc2640 1 -- 172.21.15.96:0/788252388 wait complete. 2023-12-01T23:18:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.507+0000 7f8c84cc2640 1 Processor -- start 2023-12-01T23:18:50.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.507+0000 7f8c84cc2640 1 -- start start 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0052a0 0x7f8c801eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80153f00 0x7f8c801eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800c4390 con 0x7f8c801ef280 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80153d70 con 0x7f8c80153f00 2023-12-01T23:18:50.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c84cc2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80153820 con 0x7f8c6c0052a0 2023-12-01T23:18:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.508+0000 7f8c7ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.509+0000 7f8c7ed9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54438/0 (socket says 172.21.15.96:54438) 2023-12-01T23:18:50.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.509+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/3973143300 learned_addr learned my addr 172.21.15.96:0/3973143300 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.512+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0052a0 msgr2=0x7f8c801eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.512+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0052a0 0x7f8c801eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.512+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80153f00 msgr2=0x7f8c801eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.512+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80153f00 0x7f8c801eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.512+0000 7f8c7ed9d640 1 -- 172.21.15.96:0/3973143300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80153a90 con 0x7f8c801ef280 2023-12-01T23:18:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.514+0000 7f8c7ed9d640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009f00 tx=0x7f8c78004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.518+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78036070 con 0x7f8c801ef280 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.518+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780361f0 con 0x7f8c801ef280 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.518+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7802cd90 con 0x7f8c801ef280 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.518+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800cc700 con 0x7f8c801ef280 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.518+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800cccc0 con 0x7f8c801ef280 2023-12-01T23:18:50.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.519+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c800cc540 con 0x7f8c801ef280 2023-12-01T23:18:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.537+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c78034440 con 0x7f8c801ef280 2023-12-01T23:18:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.538+0000 7f8c76ffd640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 0x7f8c6006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.538+0000 7f8c7e59c640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 0x7f8c6006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:50.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.538+0000 7f8c7e59c640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 0x7f8c6006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c700014e0 tx=0x7f8c70007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.776+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c7807aa20 con 0x7f8c801ef280 2023-12-01T23:18:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.776+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c780765d0 con 0x7f8c801ef280 2023-12-01T23:18:50.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.945+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c800ccee0 con 0x7f8c801ef280 2023-12-01T23:18:50.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.950+0000 7f8c76ffd640 1 -- 172.21.15.96:0/3973143300 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c78043070 con 0x7f8c801ef280 2023-12-01T23:18:50.951 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 msgr2=0x7f8c6006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 0x7f8c6006d350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c700014e0 tx=0x7f8c70007990 comp rx=0 tx=0).stop 2023-12-01T23:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 msgr2=0x7f8c801f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:50.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009f00 tx=0x7f8c78004b50 comp rx=0 tx=0).stop 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 shutdown_connections 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f8c6006ae90 0x7f8c6006d350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8c801ef280 0x7f8c801f2030 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c80153f00 0x7f8c801eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 --2- 172.21.15.96:0/3973143300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8c6c0052a0 0x7f8c801eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 >> 172.21.15.96:0/3973143300 conn(0x7f8c80061100 msgr2=0x7f8c800c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 shutdown_connections 2023-12-01T23:18:50.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:50.952+0000 7f8c84cc2640 1 -- 172.21.15.96:0/3973143300 wait complete. 2023-12-01T23:18:50.964 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:18:51.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 Processor -- start 2023-12-01T23:18:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 -- start start 2023-12-01T23:18:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 0x7f82dc159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc153fc0 con 0x7f82dc06fa00 2023-12-01T23:18:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82dc06b7b0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.065+0000 7f82e1f83640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0c3340 con 0x7f82dc153be0 2023-12-01T23:18:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.066+0000 7f82daffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f82dc06fa00 0x7f82dc0c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38958/0 (socket says 172.21.15.96:38958) 2023-12-01T23:18:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.066+0000 7f82daffd640 1 -- 172.21.15.96:0/3606040626 learned_addr learned my addr 172.21.15.96:0/3606040626 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:51.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.066+0000 7f82db7fe640 1 --2- 172.21.15.96:0/3606040626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 0x7f82dc159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864764789 0 0) 0x7f82dc153fc0 con 0x7f82dc06fa00 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c4003520 con 0x7f82dc06fa00 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772576306 0 0) 0x7f82dc06b7b0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82dc153fc0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82db7fe640 1 -- 172.21.15.96:0/3606040626 >> v1:172.21.15.102:6789/0 conn(0x7f82dc0c5e60 legacy=0x7f82dc1641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82db7fe640 1 -- 172.21.15.96:0/3606040626 >> v1:172.21.15.96:6789/0 conn(0x7f82dc06fa00 legacy=0x7f82dc0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.069+0000 7f82db7fe640 1 -- 172.21.15.96:0/3606040626 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc06ba90 con 0x7f82dc153be0 2023-12-01T23:18:51.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.071+0000 7f82db7fe640 1 --2- 172.21.15.96:0/3606040626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 0x7f82dc159890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097d0 tx=0x7f82cc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13ba681617681a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.075+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc031890 con 0x7f82dc153be0 2023-12-01T23:18:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.075+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0319f0 con 0x7f82dc153be0 2023-12-01T23:18:51.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.075+0000 7f82da7fc640 1 -- 172.21.15.96:0/3606040626 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc031d80 con 0x7f82dc153be0 2023-12-01T23:18:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 -- 172.21.15.96:0/3606040626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 msgr2=0x7f82dc159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 --2- 172.21.15.96:0/3606040626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 0x7f82dc159890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097d0 tx=0x7f82cc02b930 comp rx=0 tx=0).stop 2023-12-01T23:18:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 -- 172.21.15.96:0/3606040626 shutdown_connections 2023-12-01T23:18:51.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 --2- 172.21.15.96:0/3606040626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc153be0 0x7f82dc159890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 -- 172.21.15.96:0/3606040626 >> 172.21.15.96:0/3606040626 conn(0x7f82dc0c7f60 msgr2=0x7f82dc0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 -- 172.21.15.96:0/3606040626 shutdown_connections 2023-12-01T23:18:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.076+0000 7f82e1f83640 1 -- 172.21.15.96:0/3606040626 wait complete. 2023-12-01T23:18:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.077+0000 7f82e1f83640 1 Processor -- start 2023-12-01T23:18:51.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 -- start start 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc06fa00 0x7f82dc14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82dc153be0 0x7f82dc14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1f0670 con 0x7f82dc0c5e60 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc14c840 con 0x7f82dc153be0 2023-12-01T23:18:51.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.078+0000 7f82e1f83640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1efa30 con 0x7f82dc06fa00 2023-12-01T23:18:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.079+0000 7f82daffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.079+0000 7f82dbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82dc153be0 0x7f82dc14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.079+0000 7f82db7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc06fa00 0x7f82dc14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.079+0000 7f82daffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54452/0 (socket says 172.21.15.96:54452) 2023-12-01T23:18:51.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.079+0000 7f82daffd640 1 -- 172.21.15.96:0/4273160563 learned_addr learned my addr 172.21.15.96:0/4273160563 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:51.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.082+0000 7f82daffd640 1 -- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc06fa00 msgr2=0x7f82dc14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.082+0000 7f82daffd640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc06fa00 0x7f82dc14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.082+0000 7f82daffd640 1 -- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82dc153be0 msgr2=0x7f82dc14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.082+0000 7f82daffd640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82dc153be0 0x7f82dc14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.082+0000 7f82daffd640 1 -- 172.21.15.96:0/4273160563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009400 con 0x7f82dc0c5e60 2023-12-01T23:18:51.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.084+0000 7f82daffd640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c460 tx=0x7f82d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.086+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0005ce0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.086+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc1efcd0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.086+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc1f0290 con 0x7f82dc0c5e60 2023-12-01T23:18:51.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.087+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0700e0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.088+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0005e40 con 0x7f82dc0c5e60 2023-12-01T23:18:51.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.088+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0007270 con 0x7f82dc0c5e60 2023-12-01T23:18:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.333+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82d00073d0 con 0x7f82dc0c5e60 2023-12-01T23:18:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.333+0000 7f82c3fff640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.334+0000 7f82db7fe640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.334+0000 7f82db7fe640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 0x7f82c806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82cc036000 tx=0x7f82cc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.347+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f82d0058200 con 0x7f82dc0c5e60 2023-12-01T23:18:51.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.347+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82d0054540 con 0x7f82dc0c5e60 2023-12-01T23:18:51.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.520+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f82dc067500 con 0x7f82dc0c5e60 2023-12-01T23:18:51.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.525+0000 7f82c3fff640 1 -- 172.21.15.96:0/4273160563 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f82d0057b60 con 0x7f82dc0c5e60 2023-12-01T23:18:51.526 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:18:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 msgr2=0x7f82c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 0x7f82c806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f82cc036000 tx=0x7f82cc03c040 comp rx=0 tx=0).stop 2023-12-01T23:18:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 msgr2=0x7f82dc14bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f82d000c460 tx=0x7f82d000c920 comp rx=0 tx=0).stop 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 shutdown_connections 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f82c806ae70 0x7f82c806d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82dc153be0 0x7f82dc14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82dc0c5e60 0x7f82dc14bde0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 --2- 172.21.15.96:0/4273160563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82dc06fa00 0x7f82dc14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 >> 172.21.15.96:0/4273160563 conn(0x7f82dc0c7f60 msgr2=0x7f82dc151780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 shutdown_connections 2023-12-01T23:18:51.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.527+0000 7f82e1f83640 1 -- 172.21.15.96:0/4273160563 wait complete. 2023-12-01T23:18:51.539 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T23:18:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.639+0000 7f0f713f5640 1 Processor -- start 2023-12-01T23:18:51.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.639+0000 7f0f713f5640 1 -- start start 2023-12-01T23:18:51.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f6c153640 0x7f0f6c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c0c4210 0x7f0f6c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c15a6e0 con 0x7f0f6c0c4810 2023-12-01T23:18:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c06bba0 con 0x7f0f6c153640 2023-12-01T23:18:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.640+0000 7f0f713f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c06be60 con 0x7f0f6c0c4210 2023-12-01T23:18:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.641+0000 7f0f6b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.641+0000 7f0f6affd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f6c153640 0x7f0f6c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.641+0000 7f0f6b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54460/0 (socket says 172.21.15.96:54460) 2023-12-01T23:18:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.641+0000 7f0f6b7fe640 1 -- 172.21.15.96:0/301498361 learned_addr learned my addr 172.21.15.96:0/301498361 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:51.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.641+0000 7f0f6a7fc640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c0c4210 0x7f0f6c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.643+0000 7f0f6b7fe640 1 -- 172.21.15.96:0/301498361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c0c4210 msgr2=0x7f0f6c15a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.643+0000 7f0f6b7fe640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c0c4210 0x7f0f6c15a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.643+0000 7f0f6b7fe640 1 -- 172.21.15.96:0/301498361 >> v2:172.21.15.102:3300/0 conn(0x7f0f6c153640 msgr2=0x7f0f6c153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.643+0000 7f0f6b7fe640 1 --2- 172.21.15.96:0/301498361 >> v2:172.21.15.102:3300/0 conn(0x7f0f6c153640 0x7f0f6c153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.643+0000 7f0f6b7fe640 1 -- 172.21.15.96:0/301498361 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c06c140 con 0x7f0f6c0c4810 2023-12-01T23:18:51.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.646+0000 7f0f6b7fe640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cc8c0 tx=0x7f0f6402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea67e3a0eb86f21e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.651+0000 7f0f69ffb640 1 -- 172.21.15.96:0/301498361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64030860 con 0x7f0f6c0c4810 2023-12-01T23:18:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.651+0000 7f0f69ffb640 1 -- 172.21.15.96:0/301498361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640309c0 con 0x7f0f6c0c4810 2023-12-01T23:18:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.651+0000 7f0f69ffb640 1 -- 172.21.15.96:0/301498361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64030d50 con 0x7f0f6c0c4810 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 -- 172.21.15.96:0/301498361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4810 msgr2=0x7f0f6c0c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cc8c0 tx=0x7f0f6402b9a0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 -- 172.21.15.96:0/301498361 shutdown_connections 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c4c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 --2- 172.21.15.96:0/301498361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c0c4210 0x7f0f6c15a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 --2- 172.21.15.96:0/301498361 >> v2:172.21.15.102:3300/0 conn(0x7f0f6c153640 0x7f0f6c153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 -- 172.21.15.96:0/301498361 >> 172.21.15.96:0/301498361 conn(0x7f0f6c08b610 msgr2=0x7f0f6c060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 -- 172.21.15.96:0/301498361 shutdown_connections 2023-12-01T23:18:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.652+0000 7f0f713f5640 1 -- 172.21.15.96:0/301498361 wait complete. 2023-12-01T23:18:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 Processor -- start 2023-12-01T23:18:51.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 -- start start 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c153640 0x7f0f6c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c7cc0 con 0x7f0f6c0c4210 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1f3010 con 0x7f0f6c0c4810 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.654+0000 7f0f713f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1ef840 con 0x7f0f6c153640 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.655+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.655+0000 7f0f6b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c153640 0x7f0f6c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.655+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54474/0 (socket says 172.21.15.96:54474) 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.655+0000 7f0f6affd640 1 -- 172.21.15.96:0/3015564285 learned_addr learned my addr 172.21.15.96:0/3015564285 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:51.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.655+0000 7f0f6a7fc640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.658+0000 7f0f6affd640 1 -- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c153640 msgr2=0x7f0f6c14c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.658+0000 7f0f6affd640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c153640 0x7f0f6c14c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.658+0000 7f0f6affd640 1 -- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6c0c4810 msgr2=0x7f0f6c0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.658+0000 7f0f6affd640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:51.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.659+0000 7f0f6affd640 1 -- 172.21.15.96:0/3015564285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640094d0 con 0x7f0f6c0c4210 2023-12-01T23:18:51.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.661+0000 7f0f6affd640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009db0 tx=0x7f0f5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.665+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c014480 con 0x7f0f6c0c4210 2023-12-01T23:18:51.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.665+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00f040 con 0x7f0f6c0c4210 2023-12-01T23:18:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.665+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c1f3520 con 0x7f0f6c0c4210 2023-12-01T23:18:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.665+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c014800 con 0x7f0f6c0c4210 2023-12-01T23:18:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.665+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c1ef1f0 con 0x7f0f6c0c4210 2023-12-01T23:18:51.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.666+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c06d030 con 0x7f0f6c0c4210 2023-12-01T23:18:51.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.909+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f5c014960 con 0x7f0f6c0c4210 2023-12-01T23:18:51.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.909+0000 7f0f537fe640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 0x7f0f5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:51.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.909+0000 7f0f6a7fc640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 0x7f0f5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:51.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.910+0000 7f0f6a7fc640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 0x7f0f5806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c152190 tx=0x7f0f60009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:51.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.949+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f5c0596e0 con 0x7f0f6c0c4210 2023-12-01T23:18:51.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:51.952+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f5c055a20 con 0x7f0f6c0c4210 2023-12-01T23:18:52.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.132+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f6c06d260 con 0x7f0f6c0c4210 2023-12-01T23:18:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.147+0000 7f0f537fe640 1 -- 172.21.15.96:0/3015564285 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0f5c059040 con 0x7f0f6c0c4210 2023-12-01T23:18:52.148 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-12-01T23:18:52.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 msgr2=0x7f0f5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 0x7f0f5806d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c152190 tx=0x7f0f60009110 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 msgr2=0x7f0f6c1efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009db0 tx=0x7f0f5c00c490 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 shutdown_connections 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5806ae40 0x7f0f5806d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6c153640 0x7f0f6c14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6c0c4810 0x7f0f6c0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 --2- 172.21.15.96:0/3015564285 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f6c0c4210 0x7f0f6c1efcd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 >> 172.21.15.96:0/3015564285 conn(0x7f0f6c08b610 msgr2=0x7f0f6c0c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.149+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 shutdown_connections 2023-12-01T23:18:52.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.150+0000 7f0f713f5640 1 -- 172.21.15.96:0/3015564285 wait complete. 2023-12-01T23:18:52.161 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-12-01T23:18:52.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:52.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-01T23:18:52.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[94246]: fuse finished with error 0 and tester_r 0 2023-12-01T23:18:52.188 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:18:52.255 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:18:52.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:18:52.255 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-01T23:18:52.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:52.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.418+0000 7f6ae59b0640 1 Processor -- start 2023-12-01T23:18:52.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.418+0000 7f6ae59b0640 1 -- start start 2023-12-01T23:18:52.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.419+0000 7f6ae59b0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ae014fd70 0x7f6ae0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.419+0000 7f6ae59b0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6ae0071c40 0x7f6ae00c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.419+0000 7f6ae59b0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae0071420 con 0x7f6ae00c7eb0 2023-12-01T23:18:52.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.419+0000 7f6ae59b0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae0155b20 con 0x7f6ae0071c40 2023-12-01T23:18:52.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.419+0000 7f6ae59b0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae01592d0 con 0x7f6ae014fd70 2023-12-01T23:18:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.420+0000 7f6ade7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6ae0071c40 0x7f6ae00c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.420+0000 7f6ade7fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6ae0071c40 0x7f6ae00c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54478/0 (socket says 172.21.15.96:54478) 2023-12-01T23:18:52.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.420+0000 7f6ade7fc640 1 -- 172.21.15.96:0/2051722325 learned_addr learned my addr 172.21.15.96:0/2051722325 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.422+0000 7f6ade7fc640 1 -- 172.21.15.96:0/2051722325 >> v2:172.21.15.102:3300/0 conn(0x7f6ae014fd70 msgr2=0x7f6ae0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.422+0000 7f6ade7fc640 1 --2- 172.21.15.96:0/2051722325 >> v2:172.21.15.102:3300/0 conn(0x7f6ae014fd70 0x7f6ae0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.422+0000 7f6ade7fc640 1 -- 172.21.15.96:0/2051722325 >> v1:172.21.15.102:6789/0 conn(0x7f6ae00c7eb0 legacy=0x7f6ae0159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:52.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.422+0000 7f6ade7fc640 1 -- 172.21.15.96:0/2051722325 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00c65f0 con 0x7f6ae0071c40 2023-12-01T23:18:52.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.424+0000 7f6ade7fc640 1 --2- 172.21.15.96:0/2051722325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae0071c40 0x7f6ae00c7970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00c85d0 tx=0x7f6ad402c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e833d995a77b899 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:52.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.426+0000 7f6addffb640 1 -- 172.21.15.96:0/2051722325 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4032860 con 0x7f6ae0071c40 2023-12-01T23:18:52.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6addffb640 1 -- 172.21.15.96:0/2051722325 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad40329c0 con 0x7f6ae0071c40 2023-12-01T23:18:52.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6addffb640 1 -- 172.21.15.96:0/2051722325 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4032d50 con 0x7f6ae0071c40 2023-12-01T23:18:52.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2051722325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae0071c40 msgr2=0x7f6ae00c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2051722325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae0071c40 0x7f6ae00c7970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00c85d0 tx=0x7f6ad402c900 comp rx=0 tx=0).stop 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2051722325 shutdown_connections 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2051722325 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae0071c40 0x7f6ae00c7970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.428+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2051722325 >> v2:172.21.15.102:3300/0 conn(0x7f6ae014fd70 0x7f6ae0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.429+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2051722325 >> 172.21.15.96:0/2051722325 conn(0x7f6ae006cd60 msgr2=0x7f6ae006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.429+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2051722325 shutdown_connections 2023-12-01T23:18:52.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.429+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2051722325 wait complete. 2023-12-01T23:18:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.430+0000 7f6ae59b0640 1 Processor -- start 2023-12-01T23:18:52.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.430+0000 7f6ae59b0640 1 -- start start 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ae0071c40 0x7f6ae01577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ae00c7eb0 0x7f6ae00ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0158570 con 0x7f6ae014fd70 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00c9da0 con 0x7f6ae00c7eb0 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6ae59b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0158b00 con 0x7f6ae0071c40 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6adf7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54484/0 (socket says 172.21.15.96:54484) 2023-12-01T23:18:52.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.431+0000 7f6adf7fe640 1 -- 172.21.15.96:0/2415294476 learned_addr learned my addr 172.21.15.96:0/2415294476 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.435+0000 7f6adf7fe640 1 -- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ae0071c40 msgr2=0x7f6ae01577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.435+0000 7f6adf7fe640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ae0071c40 0x7f6ae01577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.435+0000 7f6adf7fe640 1 -- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ae00c7eb0 msgr2=0x7f6ae00ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.435+0000 7f6adf7fe640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ae00c7eb0 0x7f6ae00ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.435+0000 7f6adf7fe640 1 -- 172.21.15.96:0/2415294476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40094d0 con 0x7f6ae014fd70 2023-12-01T23:18:52.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.437+0000 7f6adf7fe640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c780 tx=0x7f6ad800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:52.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.441+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8003d80 con 0x7f6ae014fd70 2023-12-01T23:18:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.441+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800ce90 con 0x7f6ae014fd70 2023-12-01T23:18:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.441+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80052b0 con 0x7f6ae014fd70 2023-12-01T23:18:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.441+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae0158de0 con 0x7f6ae014fd70 2023-12-01T23:18:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.441+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae0157f40 con 0x7f6ae014fd70 2023-12-01T23:18:52.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.442+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0071290 con 0x7f6ae014fd70 2023-12-01T23:18:52.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.461+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ad8005410 con 0x7f6ae014fd70 2023-12-01T23:18:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.461+0000 7f6ac7fff640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 0x7f6acc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.461+0000 7f6adeffd640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 0x7f6acc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:52.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.462+0000 7f6adeffd640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 0x7f6acc06d350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009670 tx=0x7f6ad0006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:52.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.464+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ad8058790 con 0x7f6ae014fd70 2023-12-01T23:18:52.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.698+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ad80543d0 con 0x7f6ae014fd70 2023-12-01T23:18:52.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.914+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ae0067500 con 0x7f6ae014fd70 2023-12-01T23:18:52.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.953+0000 7f6ac7fff640 1 -- 172.21.15.96:0/2415294476 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f6ad80579f0 con 0x7f6ae014fd70 2023-12-01T23:18:52.954 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:52.955 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 msgr2=0x7f6acc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 0x7f6acc06d350 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009670 tx=0x7f6ad0006bf0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 msgr2=0x7f6ae00ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c780 tx=0x7f6ad800cc40 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 shutdown_connections 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6acc06ae90 0x7f6acc06d350 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6ae014fd70 0x7f6ae00ca770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ae00c7eb0 0x7f6ae00ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 --2- 172.21.15.96:0/2415294476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ae0071c40 0x7f6ae01577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 >> 172.21.15.96:0/2415294476 conn(0x7f6ae006cd60 msgr2=0x7f6ae006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 shutdown_connections 2023-12-01T23:18:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:52.955+0000 7f6ae59b0640 1 -- 172.21.15.96:0/2415294476 wait complete. 2023-12-01T23:18:52.968 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:53.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.065+0000 7efd54ad3640 1 Processor -- start 2023-12-01T23:18:53.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.065+0000 7efd54ad3640 1 -- start start 2023-12-01T23:18:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.066+0000 7efd54ad3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd5015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.066+0000 7efd54ad3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efd500ceef0 0x7efd500cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.066+0000 7efd54ad3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5015a700 con 0x7efd50153890 2023-12-01T23:18:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.066+0000 7efd54ad3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd500ca870 con 0x7efd500ceef0 2023-12-01T23:18:53.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.066+0000 7efd54ad3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50159af0 con 0x7efd50153c70 2023-12-01T23:18:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.067+0000 7efd4dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd5015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.067+0000 7efd4ed9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efd500ceef0 0x7efd500cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.067+0000 7efd4e59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efd50153890 0x7efd500c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:41280/0 (socket says 172.21.15.96:41280) 2023-12-01T23:18:53.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.067+0000 7efd4e59c640 1 -- 172.21.15.96:0/3494955893 learned_addr learned my addr 172.21.15.96:0/3494955893 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.070+0000 7efd4dd9b640 1 -- 172.21.15.96:0/3494955893 >> v2:172.21.15.96:3300/0 conn(0x7efd500ceef0 msgr2=0x7efd500cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.070+0000 7efd4dd9b640 1 --2- 172.21.15.96:0/3494955893 >> v2:172.21.15.96:3300/0 conn(0x7efd500ceef0 0x7efd500cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.070+0000 7efd4dd9b640 1 -- 172.21.15.96:0/3494955893 >> v1:172.21.15.102:6789/0 conn(0x7efd50153890 legacy=0x7efd500c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.070+0000 7efd4dd9b640 1 -- 172.21.15.96:0/3494955893 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50159dd0 con 0x7efd50153c70 2023-12-01T23:18:53.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.071+0000 7efd4dd9b640 1 --2- 172.21.15.96:0/3494955893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd5015d950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd440097a0 tx=0x7efd4402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a2b71346bb5f19 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.075+0000 7efd4d59a640 1 -- 172.21.15.96:0/3494955893 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44030610 con 0x7efd50153c70 2023-12-01T23:18:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.075+0000 7efd4d59a640 1 -- 172.21.15.96:0/3494955893 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44030770 con 0x7efd50153c70 2023-12-01T23:18:53.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.075+0000 7efd4d59a640 1 -- 172.21.15.96:0/3494955893 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44030b00 con 0x7efd50153c70 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 -- 172.21.15.96:0/3494955893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 msgr2=0x7efd5015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 --2- 172.21.15.96:0/3494955893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd5015d950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efd440097a0 tx=0x7efd4402b960 comp rx=0 tx=0).stop 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 -- 172.21.15.96:0/3494955893 shutdown_connections 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 --2- 172.21.15.96:0/3494955893 >> v2:172.21.15.96:3300/0 conn(0x7efd500ceef0 0x7efd500cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 --2- 172.21.15.96:0/3494955893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd5015d950 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 -- 172.21.15.96:0/3494955893 >> 172.21.15.96:0/3494955893 conn(0x7efd5006ba00 msgr2=0x7efd5006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 -- 172.21.15.96:0/3494955893 shutdown_connections 2023-12-01T23:18:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.076+0000 7efd54ad3640 1 -- 172.21.15.96:0/3494955893 wait complete. 2023-12-01T23:18:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 Processor -- start 2023-12-01T23:18:53.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 -- start start 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd500ceef0 0x7efd50147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd50154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50154880 con 0x7efd50153890 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501489d0 con 0x7efd500ceef0 2023-12-01T23:18:53.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.078+0000 7efd54ad3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd50147560 con 0x7efd50153c70 2023-12-01T23:18:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.079+0000 7efd4dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.079+0000 7efd4e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd500ceef0 0x7efd50147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.079+0000 7efd4ed9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd50154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.079+0000 7efd4dd9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54500/0 (socket says 172.21.15.96:54500) 2023-12-01T23:18:53.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.079+0000 7efd4dd9b640 1 -- 172.21.15.96:0/2263583361 learned_addr learned my addr 172.21.15.96:0/2263583361 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.083+0000 7efd4dd9b640 1 -- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 msgr2=0x7efd50154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.083+0000 7efd4dd9b640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd50154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.083+0000 7efd4dd9b640 1 -- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd500ceef0 msgr2=0x7efd50147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.083+0000 7efd4dd9b640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd500ceef0 0x7efd50147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.083+0000 7efd4dd9b640 1 -- 172.21.15.96:0/2263583361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009400 con 0x7efd50153890 2023-12-01T23:18:53.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.085+0000 7efd4dd9b640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd44009890 tx=0x7efd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.088+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4403e070 con 0x7efd50153890 2023-12-01T23:18:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.088+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440397a0 con 0x7efd50153890 2023-12-01T23:18:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.088+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd50146fa0 con 0x7efd50153890 2023-12-01T23:18:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.088+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44039b70 con 0x7efd50153890 2023-12-01T23:18:53.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.088+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd501541c0 con 0x7efd50153890 2023-12-01T23:18:53.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.089+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd501549c0 con 0x7efd50153890 2023-12-01T23:18:53.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.107+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd44039cd0 con 0x7efd50153890 2023-12-01T23:18:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.108+0000 7efd3effd640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 0x7efd3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.108+0000 7efd4e59c640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 0x7efd3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.108+0000 7efd4e59c640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 0x7efd3006d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd400012e0 tx=0x7efd40001a30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.110+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd4407af30 con 0x7efd50153890 2023-12-01T23:18:53.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.343+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd44077270 con 0x7efd50153890 2023-12-01T23:18:53.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.511+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd501549c0 con 0x7efd50153890 2023-12-01T23:18:53.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.550+0000 7efd3effd640 1 -- 172.21.15.96:0/2263583361 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7efd501549c0 con 0x7efd50153890 2023-12-01T23:18:53.552 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:53.552 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 msgr2=0x7efd3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 0x7efd3006d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd400012e0 tx=0x7efd40001a30 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 msgr2=0x7efd50146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efd44009890 tx=0x7efd440046c0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 shutdown_connections 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efd3006ae40 0x7efd3006d300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd50153c70 0x7efd50154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd50153890 0x7efd50146930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 --2- 172.21.15.96:0/2263583361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd500ceef0 0x7efd50147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 >> 172.21.15.96:0/2263583361 conn(0x7efd5006ba00 msgr2=0x7efd5015c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 shutdown_connections 2023-12-01T23:18:53.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.552+0000 7efd54ad3640 1 -- 172.21.15.96:0/2263583361 wait complete. 2023-12-01T23:18:53.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-01T23:18:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.666+0000 7fb1f962b640 1 Processor -- start 2023-12-01T23:18:53.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.666+0000 7fb1f962b640 1 -- start start 2023-12-01T23:18:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.667+0000 7fb1f962b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1f4153890 0x7fb1f415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.667+0000 7fb1f962b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.667+0000 7fb1f962b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f415a700 con 0x7fb1f40ceef0 2023-12-01T23:18:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.667+0000 7fb1f962b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f40ca870 con 0x7fb1f4153890 2023-12-01T23:18:53.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.667+0000 7fb1f962b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f4159af0 con 0x7fb1f4153c70 2023-12-01T23:18:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.668+0000 7fb1f2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb1f4153890 0x7fb1f415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.668+0000 7fb1ebfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.668+0000 7fb1ebfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f40c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56684/0 (socket says 172.21.15.96:56684) 2023-12-01T23:18:53.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.668+0000 7fb1ebfff640 1 -- 172.21.15.96:0/924680844 learned_addr learned my addr 172.21.15.96:0/924680844 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.671+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/924680844 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 msgr2=0x7fb1f40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:53.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.671+0000 7fb1f2ffd640 1 --2- 172.21.15.96:0/924680844 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f40c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.671+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/924680844 >> v1:172.21.15.96:6789/0 conn(0x7fb1f40ceef0 legacy=0x7fb1f415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.671+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/924680844 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4159dd0 con 0x7fb1f4153890 2023-12-01T23:18:53.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.675+0000 7fb1f2ffd640 1 --2- 172.21.15.96:0/924680844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f4153890 0x7fb1f415d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8f5011a16a316e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.677+0000 7fb1f27fc640 1 -- 172.21.15.96:0/924680844 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4030610 con 0x7fb1f4153890 2023-12-01T23:18:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f27fc640 1 -- 172.21.15.96:0/924680844 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4030770 con 0x7fb1f4153890 2023-12-01T23:18:53.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f27fc640 1 -- 172.21.15.96:0/924680844 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4030b00 con 0x7fb1f4153890 2023-12-01T23:18:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 -- 172.21.15.96:0/924680844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f4153890 msgr2=0x7fb1f415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 --2- 172.21.15.96:0/924680844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f4153890 0x7fb1f415d950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40097a0 tx=0x7fb1e402b960 comp rx=0 tx=0).stop 2023-12-01T23:18:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 -- 172.21.15.96:0/924680844 shutdown_connections 2023-12-01T23:18:53.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 --2- 172.21.15.96:0/924680844 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f40c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 --2- 172.21.15.96:0/924680844 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f4153890 0x7fb1f415d950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 -- 172.21.15.96:0/924680844 >> 172.21.15.96:0/924680844 conn(0x7fb1f406ba00 msgr2=0x7fb1f406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 -- 172.21.15.96:0/924680844 shutdown_connections 2023-12-01T23:18:53.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.679+0000 7fb1f962b640 1 -- 172.21.15.96:0/924680844 wait complete. 2023-12-01T23:18:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.681+0000 7fb1f962b640 1 Processor -- start 2023-12-01T23:18:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.681+0000 7fb1f962b640 1 -- start start 2023-12-01T23:18:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f4153890 0x7fb1f4145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f41f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41f01d0 con 0x7fb1f40ceef0 2023-12-01T23:18:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40b4f30 con 0x7fb1f4153890 2023-12-01T23:18:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f962b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41461d0 con 0x7fb1f4153c70 2023-12-01T23:18:53.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f41f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1ebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f4153890 0x7fb1f4145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54532/0 (socket says 172.21.15.96:54532) 2023-12-01T23:18:53.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.682+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/3322124172 learned_addr learned my addr 172.21.15.96:0/3322124172 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.686+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 msgr2=0x7fb1f41f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.686+0000 7fb1f2ffd640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f41f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.686+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f4153890 msgr2=0x7fb1f4145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.686+0000 7fb1f2ffd640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f4153890 0x7fb1f4145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:53.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.686+0000 7fb1f2ffd640 1 -- 172.21.15.96:0/3322124172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009400 con 0x7fb1f40ceef0 2023-12-01T23:18:53.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.688+0000 7fb1f2ffd640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1e402bf70 tx=0x7fb1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.692+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e403e040 con 0x7fb1f40ceef0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.692+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4039cb0 con 0x7fb1f40ceef0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.692+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f41f3950 con 0x7fb1f40ceef0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.692+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4044630 con 0x7fb1f40ceef0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.692+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f41ef830 con 0x7fb1f40ceef0 2023-12-01T23:18:53.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.693+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f4067500 con 0x7fb1f40ceef0 2023-12-01T23:18:53.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.935+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1e404d3b0 con 0x7fb1f40ceef0 2023-12-01T23:18:53.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.936+0000 7fb1eb7fe640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 0x7fb1d406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:53.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.936+0000 7fb1ebfff640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 0x7fb1d406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:53.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.936+0000 7fb1ebfff640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 0x7fb1d406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4157a60 tx=0x7fb1dc009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:53.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.949+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1e4039e20 con 0x7fb1f40ceef0 2023-12-01T23:18:53.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:53.949+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1e40770d0 con 0x7fb1f40ceef0 2023-12-01T23:18:54.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:54.171+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb1f4153020 con 0x7fb1f40ceef0 2023-12-01T23:18:55.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.191+0000 7fb1eb7fe640 1 -- 172.21.15.96:0/3322124172 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1e40340b0 con 0x7fb1f40ceef0 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 msgr2=0x7fb1d406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 0x7fb1d406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4157a60 tx=0x7fb1dc009240 comp rx=0 tx=0).stop 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 msgr2=0x7fb1f41526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb1e402bf70 tx=0x7fb1e4004730 comp rx=0 tx=0).stop 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 shutdown_connections 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb1d406ae90 0x7fb1d406d350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f4153c70 0x7fb1f41f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f4153890 0x7fb1f4145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 --2- 172.21.15.96:0/3322124172 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1f40ceef0 0x7fb1f41526f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 >> 172.21.15.96:0/3322124172 conn(0x7fb1f406ba00 msgr2=0x7fb1f415b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 shutdown_connections 2023-12-01T23:18:55.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.193+0000 7fb1f962b640 1 -- 172.21.15.96:0/3322124172 wait complete. 2023-12-01T23:18:55.206 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-12-01T23:18:55.206 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-01T23:18:55.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.310+0000 7f9d7af53640 1 Processor -- start 2023-12-01T23:18:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.310+0000 7f9d7af53640 1 -- start start 2023-12-01T23:18:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.311+0000 7f9d7af53640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9d74153640 0x7f9d74153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.311+0000 7f9d7af53640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406bba0 con 0x7f9d740c4210 2023-12-01T23:18:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.311+0000 7f9d7af53640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406be60 con 0x7f9d740c4810 2023-12-01T23:18:55.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.311+0000 7f9d7af53640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7406c140 con 0x7f9d74153640 2023-12-01T23:18:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.312+0000 7f9d73fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9d740c4210 0x7f9d7415a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:38962/0 (socket says 172.21.15.96:38962) 2023-12-01T23:18:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.312+0000 7f9d73fff640 1 -- 172.21.15.96:0/1943585278 learned_addr learned my addr 172.21.15.96:0/1943585278 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:55.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.312+0000 7f9d78cef640 1 --2- 172.21.15.96:0/1943585278 >> v2:172.21.15.102:3300/0 conn(0x7f9d74153640 0x7f9d74153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:55.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.314+0000 7f9d737fe640 1 -- 172.21.15.96:0/1943585278 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521058794 0 0) 0x7f9d7406bba0 con 0x7f9d740c4210 2023-12-01T23:18:55.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.314+0000 7f9d737fe640 1 -- 172.21.15.96:0/1943585278 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d64003520 con 0x7f9d740c4210 2023-12-01T23:18:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.315+0000 7f9d78cef640 1 -- 172.21.15.96:0/1943585278 >> v1:172.21.15.102:6789/0 conn(0x7f9d740c4810 legacy=0x7f9d740b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.315+0000 7f9d78cef640 1 -- 172.21.15.96:0/1943585278 >> v1:172.21.15.96:6789/0 conn(0x7f9d740c4210 legacy=0x7f9d7415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.315+0000 7f9d78cef640 1 -- 172.21.15.96:0/1943585278 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7406c420 con 0x7f9d74153640 2023-12-01T23:18:55.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.320+0000 7f9d78cef640 1 --2- 172.21.15.96:0/1943585278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d74153640 0x7f9d74153a20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d680097a0 tx=0x7f9d6802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb004435d112baf server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:55.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.324+0000 7f9d737fe640 1 -- 172.21.15.96:0/1943585278 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6802f810 con 0x7f9d74153640 2023-12-01T23:18:55.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.324+0000 7f9d737fe640 1 -- 172.21.15.96:0/1943585278 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6802f970 con 0x7f9d74153640 2023-12-01T23:18:55.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.324+0000 7f9d737fe640 1 -- 172.21.15.96:0/1943585278 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6802fd00 con 0x7f9d74153640 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 -- 172.21.15.96:0/1943585278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d74153640 msgr2=0x7f9d74153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1943585278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d74153640 0x7f9d74153a20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d680097a0 tx=0x7f9d6802b9f0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 -- 172.21.15.96:0/1943585278 shutdown_connections 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1943585278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d74153640 0x7f9d74153a20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 -- 172.21.15.96:0/1943585278 >> 172.21.15.96:0/1943585278 conn(0x7f9d7408b610 msgr2=0x7f9d74060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 -- 172.21.15.96:0/1943585278 shutdown_connections 2023-12-01T23:18:55.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.325+0000 7f9d7af53640 1 -- 172.21.15.96:0/1943585278 wait complete. 2023-12-01T23:18:55.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.326+0000 7f9d7af53640 1 Processor -- start 2023-12-01T23:18:55.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.326+0000 7f9d7af53640 1 -- start start 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d740c4210 0x7f9d740cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d740c4810 0x7f9d7414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d741541e0 con 0x7f9d74153640 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7414ffb0 con 0x7f9d740c4210 2023-12-01T23:18:55.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d7af53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740c8a20 con 0x7f9d740c4810 2023-12-01T23:18:55.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.327+0000 7f9d794f0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:55.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.328+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d740c4810 0x7f9d7414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:55.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.328+0000 7f9d78cef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d740c4210 0x7f9d740cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:55.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.328+0000 7f9d794f0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54542/0 (socket says 172.21.15.96:54542) 2023-12-01T23:18:55.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.328+0000 7f9d794f0640 1 -- 172.21.15.96:0/1948789820 learned_addr learned my addr 172.21.15.96:0/1948789820 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:55.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.331+0000 7f9d794f0640 1 -- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d740c4810 msgr2=0x7f9d7414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.331+0000 7f9d794f0640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d740c4810 0x7f9d7414b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.331+0000 7f9d794f0640 1 -- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d740c4210 msgr2=0x7f9d740cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:55.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.331+0000 7f9d794f0640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d740c4210 0x7f9d740cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:55.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.331+0000 7f9d794f0640 1 -- 172.21.15.96:0/1948789820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009400 con 0x7f9d74153640 2023-12-01T23:18:55.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.334+0000 7f9d794f0640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7a0 tx=0x7f9d6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:55.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.337+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c003b70 con 0x7f9d74153640 2023-12-01T23:18:55.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.337+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c003cf0 con 0x7f9d74153640 2023-12-01T23:18:55.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.337+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d740c71d0 con 0x7f9d74153640 2023-12-01T23:18:55.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.337+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c003ea0 con 0x7f9d74153640 2023-12-01T23:18:55.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.337+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d740c8740 con 0x7f9d74153640 2023-12-01T23:18:55.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.338+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d740740e0 con 0x7f9d74153640 2023-12-01T23:18:55.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.357+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d6c00aa90 con 0x7f9d74153640 2023-12-01T23:18:55.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.357+0000 7f9d717fa640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 0x7f9d5806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:55.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.357+0000 7f9d78cef640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 0x7f9d5806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:55.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.358+0000 7f9d78cef640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 0x7f9d5806d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d68036000 tx=0x7f9d68008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.600+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d6c058bf0 con 0x7f9d74153640 2023-12-01T23:18:55.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.600+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d6c054f30 con 0x7f9d74153640 2023-12-01T23:18:55.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:55.810+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9d740c5cd0 con 0x7f9d74153640 2023-12-01T23:18:56.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.678+0000 7f9d717fa640 1 -- 172.21.15.96:0/1948789820 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d6c058550 con 0x7f9d74153640 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 msgr2=0x7f9d5806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 0x7f9d5806d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9d68036000 tx=0x7f9d68008030 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 msgr2=0x7f9d7414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c7a0 tx=0x7f9d6c00cc60 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 shutdown_connections 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9d5806ae90 0x7f9d5806d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d74153640 0x7f9d7414bc20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d740c4810 0x7f9d7414b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 --2- 172.21.15.96:0/1948789820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d740c4210 0x7f9d740cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 >> 172.21.15.96:0/1948789820 conn(0x7f9d7408b610 msgr2=0x7f9d74157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:56.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 shutdown_connections 2023-12-01T23:18:56.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.680+0000 7f9d7af53640 1 -- 172.21.15.96:0/1948789820 wait complete. 2023-12-01T23:18:56.692 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-01T23:18:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.794+0000 7f376f7b6640 1 Processor -- start 2023-12-01T23:18:56.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 -- start start 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37680c4060 0x7f376815a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37680cee80 0x7f37680cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376815a690 con 0x7f37681538b0 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680b2830 con 0x7f37680cee80 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.795+0000 7f376f7b6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37680c9db0 con 0x7f37680c4060 2023-12-01T23:18:56.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.796+0000 7f376d552640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f37681538b0 0x7f37680cc0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:42544/0 (socket says 172.21.15.96:42544) 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.796+0000 7f376d552640 1 -- 172.21.15.96:0/3863124421 learned_addr learned my addr 172.21.15.96:0/3863124421 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.797+0000 7f376dd53640 1 --2- 172.21.15.96:0/3863124421 >> v2:172.21.15.96:3300/0 conn(0x7f37680cee80 0x7f37680cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.799+0000 7f376cd51640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37680c4060 0x7f376815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.799+0000 7f376dd53640 1 -- 172.21.15.96:0/3863124421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37680c4060 msgr2=0x7f376815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.799+0000 7f376dd53640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37680c4060 0x7f376815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.799+0000 7f376dd53640 1 -- 172.21.15.96:0/3863124421 >> v1:172.21.15.102:6789/0 conn(0x7f37681538b0 legacy=0x7f37680cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.799+0000 7f376dd53640 1 -- 172.21.15.96:0/3863124421 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680cbc20 con 0x7f37680cee80 2023-12-01T23:18:56.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.801+0000 7f376dd53640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f37680cf2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3760009d90 tx=0x7f376002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fca9a079d8f3cf server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:56.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.805+0000 7f375ffff640 1 -- 172.21.15.96:0/3863124421 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376002cce0 con 0x7f37680cee80 2023-12-01T23:18:56.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.805+0000 7f375ffff640 1 -- 172.21.15.96:0/3863124421 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376002ce40 con 0x7f37680cee80 2023-12-01T23:18:56.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.805+0000 7f375ffff640 1 -- 172.21.15.96:0/3863124421 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760034660 con 0x7f37680cee80 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 -- 172.21.15.96:0/3863124421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 msgr2=0x7f37680cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f37680cf2d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3760009d90 tx=0x7f376002bf30 comp rx=0 tx=0).stop 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 -- 172.21.15.96:0/3863124421 shutdown_connections 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f37680cf2d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 --2- 172.21.15.96:0/3863124421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37680c4060 0x7f376815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 -- 172.21.15.96:0/3863124421 >> 172.21.15.96:0/3863124421 conn(0x7f376808afb0 msgr2=0x7f376808b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 -- 172.21.15.96:0/3863124421 shutdown_connections 2023-12-01T23:18:56.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.806+0000 7f376f7b6640 1 -- 172.21.15.96:0/3863124421 wait complete. 2023-12-01T23:18:56.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.807+0000 7f376f7b6640 1 Processor -- start 2023-12-01T23:18:56.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.807+0000 7f376f7b6640 1 -- start start 2023-12-01T23:18:56.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c4060 0x7f37681ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37681538b0 0x7f376815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768155e80 con 0x7f37680cee80 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768156fa0 con 0x7f37680c4060 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376f7b6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37681560d0 con 0x7f37681538b0 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376cd51640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376cd51640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36142/0 (socket says 172.21.15.96:36142) 2023-12-01T23:18:56.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.808+0000 7f376cd51640 1 -- 172.21.15.96:0/1641458353 learned_addr learned my addr 172.21.15.96:0/1641458353 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:56.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.812+0000 7f376cd51640 1 -- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37681538b0 msgr2=0x7f376815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.812+0000 7f376cd51640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37681538b0 0x7f376815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.812+0000 7f376cd51640 1 -- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c4060 msgr2=0x7f37681ef3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:56.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.812+0000 7f376cd51640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c4060 0x7f37681ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:56.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.812+0000 7f376cd51640 1 -- 172.21.15.96:0/1641458353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760009a70 con 0x7f37680cee80 2023-12-01T23:18:56.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.814+0000 7f376cd51640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f375800c820 tx=0x7f375800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.816+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758004220 con 0x7f37680cee80 2023-12-01T23:18:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.816+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3768156390 con 0x7f37680cee80 2023-12-01T23:18:56.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.816+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3768156950 con 0x7f37680cee80 2023-12-01T23:18:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.817+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37680b5160 con 0x7f37680cee80 2023-12-01T23:18:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.818+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800ce10 con 0x7f37680cee80 2023-12-01T23:18:56.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:56.818+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580077b0 con 0x7f37680cee80 2023-12-01T23:18:57.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.061+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3758007910 con 0x7f37680cee80 2023-12-01T23:18:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.061+0000 7f375dffb640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 0x7f374c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.061+0000 7f376d552640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 0x7f374c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:57.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.062+0000 7f376d552640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 0x7f374c06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3764000f60 tx=0x7f3764007a80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:57.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.075+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3758058ca0 con 0x7f37680cee80 2023-12-01T23:18:57.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.075+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37580548e0 con 0x7f37680cee80 2023-12-01T23:18:57.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:57.283+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f376815b160 con 0x7f37680cee80 2023-12-01T23:18:58.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.314+0000 7f375dffb640 1 -- 172.21.15.96:0/1641458353 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f376815b160 con 0x7f37680cee80 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 msgr2=0x7f374c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 0x7f374c06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3764000f60 tx=0x7f3764007a80 comp rx=0 tx=0).stop 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 msgr2=0x7f376815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f375800c820 tx=0x7f375800cce0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 shutdown_connections 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f374c06ae40 0x7f374c06d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37681538b0 0x7f376815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37680cee80 0x7f376815b440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 --2- 172.21.15.96:0/1641458353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37680c4060 0x7f37681ef3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 >> 172.21.15.96:0/1641458353 conn(0x7f376808afb0 msgr2=0x7f37680cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:58.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 shutdown_connections 2023-12-01T23:18:58.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.316+0000 7f376f7b6640 1 -- 172.21.15.96:0/1641458353 wait complete. 2023-12-01T23:18:58.328 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-01T23:18:58.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:18:58.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.428+0000 7f0f695f5640 1 Processor -- start 2023-12-01T23:18:58.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.428+0000 7f0f695f5640 1 -- start start 2023-12-01T23:18:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.429+0000 7f0f695f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f64151630 0x7f0f6406f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.429+0000 7f0f695f5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f640c2000 0x7f0f640c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.429+0000 7f0f695f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6415b9c0 con 0x7f0f64157f50 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.429+0000 7f0f695f5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f641583c0 con 0x7f0f640c2000 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.429+0000 7f0f695f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f640c2970 con 0x7f0f64151630 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.430+0000 7f0f637fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f640c2000 0x7f0f640c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.430+0000 7f0f62ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f64151630 0x7f0f6406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.430+0000 7f0f637fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0f640c2000 0x7f0f640c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36150/0 (socket says 172.21.15.96:36150) 2023-12-01T23:18:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.430+0000 7f0f637fe640 1 -- 172.21.15.96:0/3370847946 learned_addr learned my addr 172.21.15.96:0/3370847946 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.432+0000 7f0f637fe640 1 -- 172.21.15.96:0/3370847946 >> v2:172.21.15.102:3300/0 conn(0x7f0f64151630 msgr2=0x7f0f6406f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.432+0000 7f0f637fe640 1 --2- 172.21.15.96:0/3370847946 >> v2:172.21.15.102:3300/0 conn(0x7f0f64151630 0x7f0f6406f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.432+0000 7f0f637fe640 1 -- 172.21.15.96:0/3370847946 >> v1:172.21.15.102:6789/0 conn(0x7f0f64157f50 legacy=0x7f0f640c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.432+0000 7f0f637fe640 1 -- 172.21.15.96:0/3370847946 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6415ab60 con 0x7f0f640c2000 2023-12-01T23:18:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.434+0000 7f0f637fe640 1 --2- 172.21.15.96:0/3370847946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f64061ea0 tx=0x7f0f5c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aa19ac664f679b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.437+0000 7f0f61ffb640 1 -- 172.21.15.96:0/3370847946 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c02f850 con 0x7f0f640c2000 2023-12-01T23:18:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f61ffb640 1 -- 172.21.15.96:0/3370847946 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c02f9b0 con 0x7f0f640c2000 2023-12-01T23:18:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f61ffb640 1 -- 172.21.15.96:0/3370847946 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c02fd40 con 0x7f0f640c2000 2023-12-01T23:18:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 -- 172.21.15.96:0/3370847946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 msgr2=0x7f0f640c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3370847946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f64061ea0 tx=0x7f0f5c02ba30 comp rx=0 tx=0).stop 2023-12-01T23:18:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 -- 172.21.15.96:0/3370847946 shutdown_connections 2023-12-01T23:18:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3370847946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3370847946 >> v2:172.21.15.102:3300/0 conn(0x7f0f64151630 0x7f0f6406f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 -- 172.21.15.96:0/3370847946 >> 172.21.15.96:0/3370847946 conn(0x7f0f64061100 msgr2=0x7f0f640614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 -- 172.21.15.96:0/3370847946 shutdown_connections 2023-12-01T23:18:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.438+0000 7f0f695f5640 1 -- 172.21.15.96:0/3370847946 wait complete. 2023-12-01T23:18:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 Processor -- start 2023-12-01T23:18:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 -- start start 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f64151630 0x7f0f64155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f64157f50 0x7f0f641559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641efb20 con 0x7f0f640c2000 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641f3240 con 0x7f0f64157f50 2023-12-01T23:18:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.440+0000 7f0f695f5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641ef1f0 con 0x7f0f64151630 2023-12-01T23:18:58.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.441+0000 7f0f62ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.441+0000 7f0f627fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f64151630 0x7f0f64155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.441+0000 7f0f62ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36162/0 (socket says 172.21.15.96:36162) 2023-12-01T23:18:58.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.441+0000 7f0f62ffd640 1 -- 172.21.15.96:0/3997262716 learned_addr learned my addr 172.21.15.96:0/3997262716 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:58.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.441+0000 7f0f637fe640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f64157f50 0x7f0f641559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.444+0000 7f0f62ffd640 1 -- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f64151630 msgr2=0x7f0f64155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.444+0000 7f0f62ffd640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f64151630 0x7f0f64155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.444+0000 7f0f62ffd640 1 -- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f64157f50 msgr2=0x7f0f641559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.444+0000 7f0f62ffd640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f64157f50 0x7f0f641559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.444+0000 7f0f62ffd640 1 -- 172.21.15.96:0/3997262716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0094d0 con 0x7f0f640c2000 2023-12-01T23:18:58.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.447+0000 7f0f62ffd640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400efc0 tx=0x7f0f5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:58.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.450+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54014480 con 0x7f0f640c2000 2023-12-01T23:18:58.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.450+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400f040 con 0x7f0f640c2000 2023-12-01T23:18:58.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.450+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54014800 con 0x7f0f640c2000 2023-12-01T23:18:58.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.450+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f641ef4d0 con 0x7f0f640c2000 2023-12-01T23:18:58.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.450+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f641eeea0 con 0x7f0f640c2000 2023-12-01T23:18:58.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.451+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f640740e0 con 0x7f0f640c2000 2023-12-01T23:18:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.692+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f54014960 con 0x7f0f640c2000 2023-12-01T23:18:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.692+0000 7f0f4b7fe640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 0x7f0f5006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.693+0000 7f0f627fc640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 0x7f0f5006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:58.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.693+0000 7f0f627fc640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 0x7f0f5006d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f64151100 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:58.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.705+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f54059780 con 0x7f0f640c2000 2023-12-01T23:18:58.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.705+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f54055ac0 con 0x7f0f640c2000 2023-12-01T23:18:58.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.910+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f640b1a00 con 0x7f0f640c2000 2023-12-01T23:18:58.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.922+0000 7f0f4b7fe640 1 -- 172.21.15.96:0/3997262716 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f0f540590e0 con 0x7f0f640c2000 2023-12-01T23:18:58.923 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:58.924 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:18:58.924 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 msgr2=0x7f0f5006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 0x7f0f5006d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0f64151100 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 msgr2=0x7f0f640c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400efc0 tx=0x7f0f5400c490 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 shutdown_connections 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0f5006ae90 0x7f0f5006d350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f64157f50 0x7f0f641559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f64151630 0x7f0f64155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 --2- 172.21.15.96:0/3997262716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f640c2000 0x7f0f640c2b40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 >> 172.21.15.96:0/3997262716 conn(0x7f0f64061100 msgr2=0x7f0f640c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:58.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 shutdown_connections 2023-12-01T23:18:58.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:58.925+0000 7f0f695f5640 1 -- 172.21.15.96:0/3997262716 wait complete. 2023-12-01T23:18:58.937 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:18:59.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.036+0000 7f9305261640 1 Processor -- start 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.036+0000 7f9305261640 1 -- start start 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f93000c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f930006eef0 0x7f930006e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93000c2bf0 0x7f930006e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000c8500 con 0x7f93000c2bf0 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000c7f30 con 0x7f930006eef0 2023-12-01T23:18:59.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.037+0000 7f9305261640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93000c0ea0 con 0x7f9300150470 2023-12-01T23:18:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.038+0000 7f92ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93000c2bf0 0x7f930006e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.038+0000 7f92fe7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f930006eef0 0x7f930006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.038+0000 7f92feffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f93000c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.038+0000 7f92ff7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f93000c2bf0 0x7f930006e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36178/0 (socket says 172.21.15.96:36178) 2023-12-01T23:18:59.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.038+0000 7f92ff7fe640 1 -- 172.21.15.96:0/3177006206 learned_addr learned my addr 172.21.15.96:0/3177006206 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:59.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.040+0000 7f92ff7fe640 1 -- 172.21.15.96:0/3177006206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 msgr2=0x7f93000c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:59.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.040+0000 7f92ff7fe640 1 --2- 172.21.15.96:0/3177006206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f93000c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.040+0000 7f92ff7fe640 1 -- 172.21.15.96:0/3177006206 >> v2:172.21.15.102:3300/0 conn(0x7f930006eef0 msgr2=0x7f930006e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:59.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.040+0000 7f92ff7fe640 1 --2- 172.21.15.96:0/3177006206 >> v2:172.21.15.102:3300/0 conn(0x7f930006eef0 0x7f930006e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.040+0000 7f92ff7fe640 1 -- 172.21.15.96:0/3177006206 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000c16b0 con 0x7f93000c2bf0 2023-12-01T23:18:59.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.042+0000 7f92ff7fe640 1 --2- 172.21.15.96:0/3177006206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93000c2bf0 0x7f930006e6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9300070840 tx=0x7f92f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc7f9c910a1c7f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f92fdffb640 1 -- 172.21.15.96:0/3177006206 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8031870 con 0x7f93000c2bf0 2023-12-01T23:18:59.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f92fdffb640 1 -- 172.21.15.96:0/3177006206 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80319d0 con 0x7f93000c2bf0 2023-12-01T23:18:59.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f92fdffb640 1 -- 172.21.15.96:0/3177006206 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8031d60 con 0x7f93000c2bf0 2023-12-01T23:18:59.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 -- 172.21.15.96:0/3177006206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93000c2bf0 msgr2=0x7f930006e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 --2- 172.21.15.96:0/3177006206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93000c2bf0 0x7f930006e6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9300070840 tx=0x7f92f802b910 comp rx=0 tx=0).stop 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 -- 172.21.15.96:0/3177006206 shutdown_connections 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 --2- 172.21.15.96:0/3177006206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93000c2bf0 0x7f930006e6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 --2- 172.21.15.96:0/3177006206 >> v2:172.21.15.102:3300/0 conn(0x7f930006eef0 0x7f930006e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 --2- 172.21.15.96:0/3177006206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f93000c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.046+0000 7f9305261640 1 -- 172.21.15.96:0/3177006206 >> 172.21.15.96:0/3177006206 conn(0x7f9300072930 msgr2=0x7f93000cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.047+0000 7f9305261640 1 -- 172.21.15.96:0/3177006206 shutdown_connections 2023-12-01T23:18:59.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.047+0000 7f9305261640 1 -- 172.21.15.96:0/3177006206 wait complete. 2023-12-01T23:18:59.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.048+0000 7f9305261640 1 Processor -- start 2023-12-01T23:18:59.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.048+0000 7f9305261640 1 -- start start 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93000c2bf0 0x7f9300158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f9300158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000c4f40 con 0x7f930006eef0 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000c5220 con 0x7f93000c2bf0 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f9305261640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930015a470 con 0x7f9300150470 2023-12-01T23:18:59.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f92feffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f92fe7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93000c2bf0 0x7f9300158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f9300158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.049+0000 7f92feffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36182/0 (socket says 172.21.15.96:36182) 2023-12-01T23:18:59.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.050+0000 7f92feffd640 1 -- 172.21.15.96:0/1788824339 learned_addr learned my addr 172.21.15.96:0/1788824339 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:59.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.053+0000 7f92feffd640 1 -- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 msgr2=0x7f9300158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.053+0000 7f92feffd640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f9300158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.053+0000 7f92feffd640 1 -- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93000c2bf0 msgr2=0x7f9300158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.053+0000 7f92feffd640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93000c2bf0 0x7f9300158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.053+0000 7f92feffd640 1 -- 172.21.15.96:0/1788824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80094d0 con 0x7f930006eef0 2023-12-01T23:18:59.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.055+0000 7f92feffd640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009d10 tx=0x7f92f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.059+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0009b80 con 0x7f930006eef0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.059+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f000f040 con 0x7f930006eef0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.059+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f0014680 con 0x7f930006eef0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.059+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930014f930 con 0x7f930006eef0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.059+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93001ef7a0 con 0x7f930006eef0 2023-12-01T23:18:59.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.060+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000740e0 con 0x7f930006eef0 2023-12-01T23:18:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.079+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92f00147e0 con 0x7f930006eef0 2023-12-01T23:18:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.080+0000 7f92e77fe640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 0x7f92ec06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.080+0000 7f92fe7fc640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 0x7f92ec06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.080+0000 7f92fe7fc640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 0x7f92ec06d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f930014ed00 tx=0x7f92f4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.083+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f92f0059700 con 0x7f930006eef0 2023-12-01T23:18:59.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.320+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92f0055a40 con 0x7f930006eef0 2023-12-01T23:18:59.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.520+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f930006ecd0 con 0x7f930006eef0 2023-12-01T23:18:59.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.557+0000 7f92e77fe640 1 -- 172.21.15.96:0/1788824339 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f92f0059060 con 0x7f930006eef0 2023-12-01T23:18:59.558 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:18:59.559 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:18:59.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 msgr2=0x7f92ec06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 0x7f92ec06d350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f930014ed00 tx=0x7f92f4009190 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 msgr2=0x7f930006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009d10 tx=0x7f92f000c490 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 shutdown_connections 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f92ec06ae90 0x7f92ec06d350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9300150470 0x7f9300158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93000c2bf0 0x7f9300158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 --2- 172.21.15.96:0/1788824339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f930006eef0 0x7f930006a770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 >> 172.21.15.96:0/1788824339 conn(0x7f9300072930 msgr2=0x7f930006e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 shutdown_connections 2023-12-01T23:18:59.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.560+0000 7f9305261640 1 -- 172.21.15.96:0/1788824339 wait complete. 2023-12-01T23:18:59.572 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-01T23:18:59.572 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:18:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.670+0000 7fca31cd0640 1 Processor -- start 2023-12-01T23:18:59.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.670+0000 7fca31cd0640 1 -- start start 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca2c1501c0 0x7fca2c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c0bff00 0x7fca2c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca2c072450 0x7fca2c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0c1a90 con 0x7fca2c1501c0 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c0c1d30 con 0x7fca2c072450 2023-12-01T23:18:59.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.671+0000 7fca31cd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0c2010 con 0x7fca2c0bff00 2023-12-01T23:18:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.672+0000 7fca2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca2c1501c0 0x7fca2c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.672+0000 7fca2bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fca2c072450 0x7fca2c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.672+0000 7fca2b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fca2c1501c0 0x7fca2c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36190/0 (socket says 172.21.15.96:36190) 2023-12-01T23:18:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.672+0000 7fca2b7fe640 1 -- 172.21.15.96:0/1940442035 learned_addr learned my addr 172.21.15.96:0/1940442035 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:59.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.672+0000 7fca2affd640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c0bff00 0x7fca2c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.674+0000 7fca2b7fe640 1 -- 172.21.15.96:0/1940442035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c0bff00 msgr2=0x7fca2c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.674+0000 7fca2b7fe640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c0bff00 0x7fca2c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.674+0000 7fca2b7fe640 1 -- 172.21.15.96:0/1940442035 >> v2:172.21.15.102:3300/0 conn(0x7fca2c072450 msgr2=0x7fca2c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:18:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.674+0000 7fca2b7fe640 1 --2- 172.21.15.96:0/1940442035 >> v2:172.21.15.102:3300/0 conn(0x7fca2c072450 0x7fca2c071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.674+0000 7fca2b7fe640 1 -- 172.21.15.96:0/1940442035 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c156380 con 0x7fca2c1501c0 2023-12-01T23:18:59.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.676+0000 7fca2b7fe640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c159860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca2c062050 tx=0x7fca1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a1be68c332db66 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca2a7fc640 1 -- 172.21.15.96:0/1940442035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c030860 con 0x7fca2c1501c0 2023-12-01T23:18:59.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca2a7fc640 1 -- 172.21.15.96:0/1940442035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c0309c0 con 0x7fca2c1501c0 2023-12-01T23:18:59.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca2a7fc640 1 -- 172.21.15.96:0/1940442035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c030d50 con 0x7fca2c1501c0 2023-12-01T23:18:59.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 -- 172.21.15.96:0/1940442035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 msgr2=0x7fca2c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c159860 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca2c062050 tx=0x7fca1c02b9a0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 -- 172.21.15.96:0/1940442035 shutdown_connections 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 --2- 172.21.15.96:0/1940442035 >> v2:172.21.15.102:3300/0 conn(0x7fca2c072450 0x7fca2c071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c0bff00 0x7fca2c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 --2- 172.21.15.96:0/1940442035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c159860 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.680+0000 7fca31cd0640 1 -- 172.21.15.96:0/1940442035 >> 172.21.15.96:0/1940442035 conn(0x7fca2c06cd60 msgr2=0x7fca2c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.681+0000 7fca31cd0640 1 -- 172.21.15.96:0/1940442035 shutdown_connections 2023-12-01T23:18:59.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.681+0000 7fca31cd0640 1 -- 172.21.15.96:0/1940442035 wait complete. 2023-12-01T23:18:59.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.682+0000 7fca31cd0640 1 Processor -- start 2023-12-01T23:18:59.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.682+0000 7fca31cd0640 1 -- start start 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c072450 0x7fca2c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca2c0bff00 0x7fca2c1f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c1ed340 con 0x7fca2c1501c0 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c1f1800 con 0x7fca2c0bff00 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca31cd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c1ee290 con 0x7fca2c072450 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca2affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca2c0bff00 0x7fca2c1f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.683+0000 7fca2b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c072450 0x7fca2c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.684+0000 7fca2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36196/0 (socket says 172.21.15.96:36196) 2023-12-01T23:18:59.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.684+0000 7fca2bfff640 1 -- 172.21.15.96:0/3844307068 learned_addr learned my addr 172.21.15.96:0/3844307068 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:18:59.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.687+0000 7fca2bfff640 1 -- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c072450 msgr2=0x7fca2c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.687+0000 7fca2bfff640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c072450 0x7fca2c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.687+0000 7fca2bfff640 1 -- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca2c0bff00 msgr2=0x7fca2c1f12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:18:59.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.687+0000 7fca2bfff640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca2c0bff00 0x7fca2c1f12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:18:59.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.687+0000 7fca2bfff640 1 -- 172.21.15.96:0/3844307068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0094d0 con 0x7fca2c1501c0 2023-12-01T23:18:59.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.690+0000 7fca2bfff640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca2400eed0 tx=0x7fca2400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.693+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24010040 con 0x7fca2c1501c0 2023-12-01T23:18:59.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.693+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24014400 con 0x7fca2c1501c0 2023-12-01T23:18:59.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.693+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24009ea0 con 0x7fca2c1501c0 2023-12-01T23:18:59.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.693+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2c150ec0 con 0x7fca2c1501c0 2023-12-01T23:18:59.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.693+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c151480 con 0x7fca2c1501c0 2023-12-01T23:18:59.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.694+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c0c77e0 con 0x7fca2c1501c0 2023-12-01T23:18:59.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.939+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca240147b0 con 0x7fca2c1501c0 2023-12-01T23:18:59.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.939+0000 7fca13fff640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 0x7fca1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:18:59.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.939+0000 7fca2b7fe640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 0x7fca1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:18:59.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.940+0000 7fca2b7fe640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 0x7fca1806d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca1c036000 tx=0x7fca1c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:18:59.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.952+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca24059280 con 0x7fca2c1501c0 2023-12-01T23:18:59.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:18:59.952+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca240555c0 con 0x7fca2c1501c0 2023-12-01T23:19:00.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.133+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca2c0c1730 con 0x7fca1806ae70 2023-12-01T23:19:00.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.142+0000 7fca13fff640 1 -- 172.21.15.96:0/3844307068 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345285 (secure 0 0 0) 0x7fca1c039450 con 0x7fca1806ae70 2023-12-01T23:19:00.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 msgr2=0x7fca1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 0x7fca1806d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca1c036000 tx=0x7fca1c008030 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 msgr2=0x7fca2c1edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca2400eed0 tx=0x7fca2400b480 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 shutdown_connections 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fca1806ae70 0x7fca1806d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca2c1501c0 0x7fca2c1edd50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca2c0bff00 0x7fca2c1f12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 --2- 172.21.15.96:0/3844307068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca2c072450 0x7fca2c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 >> 172.21.15.96:0/3844307068 conn(0x7fca2c06cd60 msgr2=0x7fca2c14acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 shutdown_connections 2023-12-01T23:19:00.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.146+0000 7fca31cd0640 1 -- 172.21.15.96:0/3844307068 wait complete. 2023-12-01T23:19:00.158 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-12-01T23:18:59.795757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218568,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756152,"statfs":{"total":773094113280,"available":772870299648,"internally_reserved":0,"allocated":2457600,"data_stored":2090854,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12737,"internal_metadata":221236799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002817"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828324+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:18:34.828324+0000","last_peered":"2023-12-01T23:18:34.828324+0000","last_clean":"2023-12-01T23:18:34.828324+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:18:34.828324+0000","last_undegraded":"2023-12-01T23:18:34.828324+0000","last_fullsized":"2023-12-01T23:18:34.828324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784668+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:18:34.784668+0000","last_peered":"2023-12-01T23:18:34.784668+0000","last_clean":"2023-12-01T23:18:34.784668+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:18:34.784668+0000","last_undegraded":"2023-12-01T23:18:34.784668+0000","last_fullsized":"2023-12-01T23:18:34.784668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866489+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:18:35.866489+0000","last_peered":"2023-12-01T23:18:35.866489+0000","last_clean":"2023-12-01T23:18:35.866489+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:18:35.866489+0000","last_undegraded":"2023-12-01T23:18:35.866489+0000","last_fullsized":"2023-12-01T23:18:35.866489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784751+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:18:34.784751+0000","last_peered":"2023-12-01T23:18:34.784751+0000","last_clean":"2023-12-01T23:18:34.784751+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:18:34.784751+0000","last_undegraded":"2023-12-01T23:18:34.784751+0000","last_fullsized":"2023-12-01T23:18:34.784751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828043+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:18:34.828043+0000","last_peered":"2023-12-01T23:18:34.828043+0000","last_clean":"2023-12-01T23:18:34.828043+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:18:34.828043+0000","last_undegraded":"2023-12-01T23:18:34.828043+0000","last_fullsized":"2023-12-01T23:18:34.828043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245374+0000","last_change":"2023-12-01T23:18:34.787052+0000","last_active":"2023-12-01T23:18:36.245374+0000","last_peered":"2023-12-01T23:18:36.245374+0000","last_clean":"2023-12-01T23:18:36.245374+0000","last_became_active":"2023-12-01T23:18:34.786671+0000","last_became_peered":"2023-12-01T23:18:34.786671+0000","last_unstale":"2023-12-01T23:18:36.245374+0000","last_undegraded":"2023-12-01T23:18:36.245374+0000","last_fullsized":"2023-12-01T23:18:36.245374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:31.773956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759098+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:18:34.759098+0000","last_peered":"2023-12-01T23:18:34.759098+0000","last_clean":"2023-12-01T23:18:34.759098+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:18:34.759098+0000","last_undegraded":"2023-12-01T23:18:34.759098+0000","last_fullsized":"2023-12-01T23:18:34.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785886+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:18:34.785886+0000","last_peered":"2023-12-01T23:18:34.785886+0000","last_clean":"2023-12-01T23:18:34.785886+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:18:34.785886+0000","last_undegraded":"2023-12-01T23:18:34.785886+0000","last_fullsized":"2023-12-01T23:18:34.785886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245809+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:18:36.245809+0000","last_peered":"2023-12-01T23:18:36.245809+0000","last_clean":"2023-12-01T23:18:36.245809+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:18:36.245809+0000","last_undegraded":"2023-12-01T23:18:36.245809+0000","last_fullsized":"2023-12-01T23:18:36.245809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759053+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:18:34.759053+0000","last_peered":"2023-12-01T23:18:34.759053+0000","last_clean":"2023-12-01T23:18:34.759053+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:18:34.759053+0000","last_undegraded":"2023-12-01T23:18:34.759053+0000","last_fullsized":"2023-12-01T23:18:34.759053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786203+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:18:34.786203+0000","last_peered":"2023-12-01T23:18:34.786203+0000","last_clean":"2023-12-01T23:18:34.786203+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:18:34.786203+0000","last_undegraded":"2023-12-01T23:18:34.786203+0000","last_fullsized":"2023-12-01T23:18:34.786203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245949+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:18:36.245949+0000","last_peered":"2023-12-01T23:18:36.245949+0000","last_clean":"2023-12-01T23:18:36.245949+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:18:36.245949+0000","last_undegraded":"2023-12-01T23:18:36.245949+0000","last_fullsized":"2023-12-01T23:18:36.245949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759109+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:18:34.759109+0000","last_peered":"2023-12-01T23:18:34.759109+0000","last_clean":"2023-12-01T23:18:34.759109+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:18:34.759109+0000","last_undegraded":"2023-12-01T23:18:34.759109+0000","last_fullsized":"2023-12-01T23:18:34.759109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245916+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:18:36.245916+0000","last_peered":"2023-12-01T23:18:36.245916+0000","last_clean":"2023-12-01T23:18:36.245916+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:18:36.245916+0000","last_undegraded":"2023-12-01T23:18:36.245916+0000","last_fullsized":"2023-12-01T23:18:36.245916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784022+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:18:34.784022+0000","last_peered":"2023-12-01T23:18:34.784022+0000","last_clean":"2023-12-01T23:18:34.784022+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:18:34.784022+0000","last_undegraded":"2023-12-01T23:18:34.784022+0000","last_fullsized":"2023-12-01T23:18:34.784022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768545+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:18:34.768545+0000","last_peered":"2023-12-01T23:18:34.768545+0000","last_clean":"2023-12-01T23:18:34.768545+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:18:34.768545+0000","last_undegraded":"2023-12-01T23:18:34.768545+0000","last_fullsized":"2023-12-01T23:18:34.768545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246329+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:18:36.246329+0000","last_peered":"2023-12-01T23:18:36.246329+0000","last_clean":"2023-12-01T23:18:36.246329+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:18:36.246329+0000","last_undegraded":"2023-12-01T23:18:36.246329+0000","last_fullsized":"2023-12-01T23:18:36.246329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783932+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:18:34.783932+0000","last_peered":"2023-12-01T23:18:34.783932+0000","last_clean":"2023-12-01T23:18:34.783932+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:18:34.783932+0000","last_undegraded":"2023-12-01T23:18:34.783932+0000","last_fullsized":"2023-12-01T23:18:34.783932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767868+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:18:34.767868+0000","last_peered":"2023-12-01T23:18:34.767868+0000","last_clean":"2023-12-01T23:18:34.767868+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:18:34.767868+0000","last_undegraded":"2023-12-01T23:18:34.767868+0000","last_fullsized":"2023-12-01T23:18:34.767868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856617+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:18:35.856617+0000","last_peered":"2023-12-01T23:18:35.856617+0000","last_clean":"2023-12-01T23:18:35.856617+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:18:35.856617+0000","last_undegraded":"2023-12-01T23:18:35.856617+0000","last_fullsized":"2023-12-01T23:18:35.856617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777575+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:18:34.777575+0000","last_peered":"2023-12-01T23:18:34.777575+0000","last_clean":"2023-12-01T23:18:34.777575+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:18:34.777575+0000","last_undegraded":"2023-12-01T23:18:34.777575+0000","last_fullsized":"2023-12-01T23:18:34.777575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758714+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:18:34.758714+0000","last_peered":"2023-12-01T23:18:34.758714+0000","last_clean":"2023-12-01T23:18:34.758714+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:18:34.758714+0000","last_undegraded":"2023-12-01T23:18:34.758714+0000","last_fullsized":"2023-12-01T23:18:34.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245493+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:18:36.245493+0000","last_peered":"2023-12-01T23:18:36.245493+0000","last_clean":"2023-12-01T23:18:36.245493+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:18:36.245493+0000","last_undegraded":"2023-12-01T23:18:36.245493+0000","last_fullsized":"2023-12-01T23:18:36.245493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829303+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:18:34.829303+0000","last_peered":"2023-12-01T23:18:34.829303+0000","last_clean":"2023-12-01T23:18:34.829303+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:18:34.829303+0000","last_undegraded":"2023-12-01T23:18:34.829303+0000","last_fullsized":"2023-12-01T23:18:34.829303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753914+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:18:34.753914+0000","last_peered":"2023-12-01T23:18:34.753914+0000","last_clean":"2023-12-01T23:18:34.753914+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:18:34.753914+0000","last_undegraded":"2023-12-01T23:18:34.753914+0000","last_fullsized":"2023-12-01T23:18:34.753914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246240+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:18:36.246240+0000","last_peered":"2023-12-01T23:18:36.246240+0000","last_clean":"2023-12-01T23:18:36.246240+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:18:36.246240+0000","last_undegraded":"2023-12-01T23:18:36.246240+0000","last_fullsized":"2023-12-01T23:18:36.246240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784985+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:18:34.784985+0000","last_peered":"2023-12-01T23:18:34.784985+0000","last_clean":"2023-12-01T23:18:34.784985+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:18:34.784985+0000","last_undegraded":"2023-12-01T23:18:34.784985+0000","last_fullsized":"2023-12-01T23:18:34.784985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.732271+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:18:35.732271+0000","last_peered":"2023-12-01T23:18:35.732271+0000","last_clean":"2023-12-01T23:18:35.732271+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:18:35.732271+0000","last_undegraded":"2023-12-01T23:18:35.732271+0000","last_fullsized":"2023-12-01T23:18:35.732271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866421+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:18:35.866421+0000","last_peered":"2023-12-01T23:18:35.866421+0000","last_clean":"2023-12-01T23:18:35.866421+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:18:35.866421+0000","last_undegraded":"2023-12-01T23:18:35.866421+0000","last_fullsized":"2023-12-01T23:18:35.866421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768150+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:18:34.768150+0000","last_peered":"2023-12-01T23:18:34.768150+0000","last_clean":"2023-12-01T23:18:34.768150+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:18:34.768150+0000","last_undegraded":"2023-12-01T23:18:34.768150+0000","last_fullsized":"2023-12-01T23:18:34.768150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759244+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:18:34.759244+0000","last_peered":"2023-12-01T23:18:34.759244+0000","last_clean":"2023-12-01T23:18:34.759244+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:18:34.759244+0000","last_undegraded":"2023-12-01T23:18:34.759244+0000","last_fullsized":"2023-12-01T23:18:34.759244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245847+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:18:36.245847+0000","last_peered":"2023-12-01T23:18:36.245847+0000","last_clean":"2023-12-01T23:18:36.245847+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:18:36.245847+0000","last_undegraded":"2023-12-01T23:18:36.245847+0000","last_fullsized":"2023-12-01T23:18:36.245847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786277+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:18:34.786277+0000","last_peered":"2023-12-01T23:18:34.786277+0000","last_clean":"2023-12-01T23:18:34.786277+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:18:34.786277+0000","last_undegraded":"2023-12-01T23:18:34.786277+0000","last_fullsized":"2023-12-01T23:18:34.786277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768227+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:18:34.768227+0000","last_peered":"2023-12-01T23:18:34.768227+0000","last_clean":"2023-12-01T23:18:34.768227+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:18:34.768227+0000","last_undegraded":"2023-12-01T23:18:34.768227+0000","last_fullsized":"2023-12-01T23:18:34.768227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856126+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:18:35.856126+0000","last_peered":"2023-12-01T23:18:35.856126+0000","last_clean":"2023-12-01T23:18:35.856126+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:18:35.856126+0000","last_undegraded":"2023-12-01T23:18:35.856126+0000","last_fullsized":"2023-12-01T23:18:35.856126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778077+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:18:34.778077+0000","last_peered":"2023-12-01T23:18:34.778077+0000","last_clean":"2023-12-01T23:18:34.778077+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:18:34.778077+0000","last_undegraded":"2023-12-01T23:18:34.778077+0000","last_fullsized":"2023-12-01T23:18:34.778077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786794+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:18:34.786794+0000","last_peered":"2023-12-01T23:18:34.786794+0000","last_clean":"2023-12-01T23:18:34.786794+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:18:34.786794+0000","last_undegraded":"2023-12-01T23:18:34.786794+0000","last_fullsized":"2023-12-01T23:18:34.786794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856624+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:18:35.856624+0000","last_peered":"2023-12-01T23:18:35.856624+0000","last_clean":"2023-12-01T23:18:35.856624+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:18:35.856624+0000","last_undegraded":"2023-12-01T23:18:35.856624+0000","last_fullsized":"2023-12-01T23:18:35.856624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767757+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:18:34.767757+0000","last_peered":"2023-12-01T23:18:34.767757+0000","last_clean":"2023-12-01T23:18:34.767757+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:18:34.767757+0000","last_undegraded":"2023-12-01T23:18:34.767757+0000","last_fullsized":"2023-12-01T23:18:34.767757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830640+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:18:34.830640+0000","last_peered":"2023-12-01T23:18:34.830640+0000","last_clean":"2023-12-01T23:18:34.830640+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:18:34.830640+0000","last_undegraded":"2023-12-01T23:18:34.830640+0000","last_fullsized":"2023-12-01T23:18:34.830640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856610+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:18:35.856610+0000","last_peered":"2023-12-01T23:18:35.856610+0000","last_clean":"2023-12-01T23:18:35.856610+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:18:35.856610+0000","last_undegraded":"2023-12-01T23:18:35.856610+0000","last_fullsized":"2023-12-01T23:18:35.856610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827686+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:18:34.827686+0000","last_peered":"2023-12-01T23:18:34.827686+0000","last_clean":"2023-12-01T23:18:34.827686+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:18:34.827686+0000","last_undegraded":"2023-12-01T23:18:34.827686+0000","last_fullsized":"2023-12-01T23:18:34.827686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758788+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:18:34.758788+0000","last_peered":"2023-12-01T23:18:34.758788+0000","last_clean":"2023-12-01T23:18:34.758788+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:18:34.758788+0000","last_undegraded":"2023-12-01T23:18:34.758788+0000","last_fullsized":"2023-12-01T23:18:34.758788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245861+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:18:36.245861+0000","last_peered":"2023-12-01T23:18:36.245861+0000","last_clean":"2023-12-01T23:18:36.245861+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:18:36.245861+0000","last_undegraded":"2023-12-01T23:18:36.245861+0000","last_fullsized":"2023-12-01T23:18:36.245861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783998+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:18:34.783998+0000","last_peered":"2023-12-01T23:18:34.783998+0000","last_clean":"2023-12-01T23:18:34.783998+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:18:34.783998+0000","last_undegraded":"2023-12-01T23:18:34.783998+0000","last_fullsized":"2023-12-01T23:18:34.783998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785908+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:18:34.785908+0000","last_peered":"2023-12-01T23:18:34.785908+0000","last_clean":"2023-12-01T23:18:34.785908+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:18:34.785908+0000","last_undegraded":"2023-12-01T23:18:34.785908+0000","last_fullsized":"2023-12-01T23:18:34.785908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758870+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:18:34.758870+0000","last_peered":"2023-12-01T23:18:34.758870+0000","last_clean":"2023-12-01T23:18:34.758870+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:18:34.758870+0000","last_undegraded":"2023-12-01T23:18:34.758870+0000","last_fullsized":"2023-12-01T23:18:34.758870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246489+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:18:36.246489+0000","last_peered":"2023-12-01T23:18:36.246489+0000","last_clean":"2023-12-01T23:18:36.246489+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:18:36.246489+0000","last_undegraded":"2023-12-01T23:18:36.246489+0000","last_fullsized":"2023-12-01T23:18:36.246489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758994+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:18:34.758994+0000","last_peered":"2023-12-01T23:18:34.758994+0000","last_clean":"2023-12-01T23:18:34.758994+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:18:34.758994+0000","last_undegraded":"2023-12-01T23:18:34.758994+0000","last_fullsized":"2023-12-01T23:18:34.758994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830694+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:18:34.830694+0000","last_peered":"2023-12-01T23:18:34.830694+0000","last_clean":"2023-12-01T23:18:34.830694+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:18:34.830694+0000","last_undegraded":"2023-12-01T23:18:34.830694+0000","last_fullsized":"2023-12-01T23:18:34.830694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246217+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:18:36.246217+0000","last_peered":"2023-12-01T23:18:36.246217+0000","last_clean":"2023-12-01T23:18:36.246217+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:18:36.246217+0000","last_undegraded":"2023-12-01T23:18:36.246217+0000","last_fullsized":"2023-12-01T23:18:36.246217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785964+0000","last_change":"2023-12-01T23:18:28.873819+0000","last_active":"2023-12-01T23:18:34.785964+0000","last_peered":"2023-12-01T23:18:34.785964+0000","last_clean":"2023-12-01T23:18:34.785964+0000","last_became_active":"2023-12-01T23:18:28.872949+0000","last_became_peered":"2023-12-01T23:18:28.872949+0000","last_unstale":"2023-12-01T23:18:34.785964+0000","last_undegraded":"2023-12-01T23:18:34.785964+0000","last_fullsized":"2023-12-01T23:18:34.785964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768052+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:18:34.768052+0000","last_peered":"2023-12-01T23:18:34.768052+0000","last_clean":"2023-12-01T23:18:34.768052+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:18:34.768052+0000","last_undegraded":"2023-12-01T23:18:34.768052+0000","last_fullsized":"2023-12-01T23:18:34.768052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245798+0000","last_change":"2023-12-01T23:18:34.834125+0000","last_active":"2023-12-01T23:18:36.245798+0000","last_peered":"2023-12-01T23:18:36.245798+0000","last_clean":"2023-12-01T23:18:36.245798+0000","last_became_active":"2023-12-01T23:18:34.833739+0000","last_became_peered":"2023-12-01T23:18:34.833739+0000","last_unstale":"2023-12-01T23:18:36.245798+0000","last_undegraded":"2023-12-01T23:18:36.245798+0000","last_fullsized":"2023-12-01T23:18:36.245798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:04.156636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759250+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:18:34.759250+0000","last_peered":"2023-12-01T23:18:34.759250+0000","last_clean":"2023-12-01T23:18:34.759250+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:18:34.759250+0000","last_undegraded":"2023-12-01T23:18:34.759250+0000","last_fullsized":"2023-12-01T23:18:34.759250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830583+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:18:34.830583+0000","last_peered":"2023-12-01T23:18:34.830583+0000","last_clean":"2023-12-01T23:18:34.830583+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:18:34.830583+0000","last_undegraded":"2023-12-01T23:18:34.830583+0000","last_fullsized":"2023-12-01T23:18:34.830583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245379+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:18:36.245379+0000","last_peered":"2023-12-01T23:18:36.245379+0000","last_clean":"2023-12-01T23:18:36.245379+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:18:36.245379+0000","last_undegraded":"2023-12-01T23:18:36.245379+0000","last_fullsized":"2023-12-01T23:18:36.245379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759012+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.759012+0000","last_peered":"2023-12-01T23:18:34.759012+0000","last_clean":"2023-12-01T23:18:34.759012+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:18:34.759012+0000","last_undegraded":"2023-12-01T23:18:34.759012+0000","last_fullsized":"2023-12-01T23:18:34.759012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778257+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:18:34.778257+0000","last_peered":"2023-12-01T23:18:34.778257+0000","last_clean":"2023-12-01T23:18:34.778257+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:18:34.778257+0000","last_undegraded":"2023-12-01T23:18:34.778257+0000","last_fullsized":"2023-12-01T23:18:34.778257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245873+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:18:36.245873+0000","last_peered":"2023-12-01T23:18:36.245873+0000","last_clean":"2023-12-01T23:18:36.245873+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:18:36.245873+0000","last_undegraded":"2023-12-01T23:18:36.245873+0000","last_fullsized":"2023-12-01T23:18:36.245873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758841+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:18:34.758841+0000","last_peered":"2023-12-01T23:18:34.758841+0000","last_clean":"2023-12-01T23:18:34.758841+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:18:34.758841+0000","last_undegraded":"2023-12-01T23:18:34.758841+0000","last_fullsized":"2023-12-01T23:18:34.758841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827350+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:18:34.827350+0000","last_peered":"2023-12-01T23:18:34.827350+0000","last_clean":"2023-12-01T23:18:34.827350+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:18:34.827350+0000","last_undegraded":"2023-12-01T23:18:34.827350+0000","last_fullsized":"2023-12-01T23:18:34.827350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245779+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:18:36.245779+0000","last_peered":"2023-12-01T23:18:36.245779+0000","last_clean":"2023-12-01T23:18:36.245779+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:18:36.245779+0000","last_undegraded":"2023-12-01T23:18:36.245779+0000","last_fullsized":"2023-12-01T23:18:36.245779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753529+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:18:34.753529+0000","last_peered":"2023-12-01T23:18:34.753529+0000","last_clean":"2023-12-01T23:18:34.753529+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:18:34.753529+0000","last_undegraded":"2023-12-01T23:18:34.753529+0000","last_fullsized":"2023-12-01T23:18:34.753529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867099+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:18:35.867099+0000","last_peered":"2023-12-01T23:18:35.867099+0000","last_clean":"2023-12-01T23:18:35.867099+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:18:35.867099+0000","last_undegraded":"2023-12-01T23:18:35.867099+0000","last_fullsized":"2023-12-01T23:18:35.867099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759024+0000","last_change":"2023-12-01T23:18:28.872268+0000","last_active":"2023-12-01T23:18:34.759024+0000","last_peered":"2023-12-01T23:18:34.759024+0000","last_clean":"2023-12-01T23:18:34.759024+0000","last_became_active":"2023-12-01T23:18:28.872020+0000","last_became_peered":"2023-12-01T23:18:28.872020+0000","last_unstale":"2023-12-01T23:18:34.759024+0000","last_undegraded":"2023-12-01T23:18:34.759024+0000","last_fullsized":"2023-12-01T23:18:34.759024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786751+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:18:34.786751+0000","last_peered":"2023-12-01T23:18:34.786751+0000","last_clean":"2023-12-01T23:18:34.786751+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:18:34.786751+0000","last_undegraded":"2023-12-01T23:18:34.786751+0000","last_fullsized":"2023-12-01T23:18:34.786751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866861+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:18:35.866861+0000","last_peered":"2023-12-01T23:18:35.866861+0000","last_clean":"2023-12-01T23:18:35.866861+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:18:35.866861+0000","last_undegraded":"2023-12-01T23:18:35.866861+0000","last_fullsized":"2023-12-01T23:18:35.866861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828897+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:18:34.828897+0000","last_peered":"2023-12-01T23:18:34.828897+0000","last_clean":"2023-12-01T23:18:34.828897+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:18:34.828897+0000","last_undegraded":"2023-12-01T23:18:34.828897+0000","last_fullsized":"2023-12-01T23:18:34.828897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829997+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:18:34.829997+0000","last_peered":"2023-12-01T23:18:34.829997+0000","last_clean":"2023-12-01T23:18:34.829997+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:18:34.829997+0000","last_undegraded":"2023-12-01T23:18:34.829997+0000","last_fullsized":"2023-12-01T23:18:34.829997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246916+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:18:36.246916+0000","last_peered":"2023-12-01T23:18:36.246916+0000","last_clean":"2023-12-01T23:18:36.246916+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:18:36.246916+0000","last_undegraded":"2023-12-01T23:18:36.246916+0000","last_fullsized":"2023-12-01T23:18:36.246916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758889+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:18:34.758889+0000","last_peered":"2023-12-01T23:18:34.758889+0000","last_clean":"2023-12-01T23:18:34.758889+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:18:34.758889+0000","last_undegraded":"2023-12-01T23:18:34.758889+0000","last_fullsized":"2023-12-01T23:18:34.758889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:44.926031+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:18:44.926031+0000","last_peered":"2023-12-01T23:18:44.926031+0000","last_clean":"2023-12-01T23:18:44.926031+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:18:44.926031+0000","last_undegraded":"2023-12-01T23:18:44.926031+0000","last_fullsized":"2023-12-01T23:18:44.926031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856252+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:18:35.856252+0000","last_peered":"2023-12-01T23:18:35.856252+0000","last_clean":"2023-12-01T23:18:35.856252+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:18:35.856252+0000","last_undegraded":"2023-12-01T23:18:35.856252+0000","last_fullsized":"2023-12-01T23:18:35.856252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778209+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:18:34.778209+0000","last_peered":"2023-12-01T23:18:34.778209+0000","last_clean":"2023-12-01T23:18:34.778209+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:18:34.778209+0000","last_undegraded":"2023-12-01T23:18:34.778209+0000","last_fullsized":"2023-12-01T23:18:34.778209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767988+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:18:34.767988+0000","last_peered":"2023-12-01T23:18:34.767988+0000","last_clean":"2023-12-01T23:18:34.767988+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:18:34.767988+0000","last_undegraded":"2023-12-01T23:18:34.767988+0000","last_fullsized":"2023-12-01T23:18:34.767988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245639+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:18:36.245639+0000","last_peered":"2023-12-01T23:18:36.245639+0000","last_clean":"2023-12-01T23:18:36.245639+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:18:36.245639+0000","last_undegraded":"2023-12-01T23:18:36.245639+0000","last_fullsized":"2023-12-01T23:18:36.245639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828158+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:18:34.828158+0000","last_peered":"2023-12-01T23:18:34.828158+0000","last_clean":"2023-12-01T23:18:34.828158+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:18:34.828158+0000","last_undegraded":"2023-12-01T23:18:34.828158+0000","last_fullsized":"2023-12-01T23:18:34.828158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786608+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:18:34.786608+0000","last_peered":"2023-12-01T23:18:34.786608+0000","last_clean":"2023-12-01T23:18:34.786608+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:18:34.786608+0000","last_undegraded":"2023-12-01T23:18:34.786608+0000","last_fullsized":"2023-12-01T23:18:34.786608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866572+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:18:35.866572+0000","last_peered":"2023-12-01T23:18:35.866572+0000","last_clean":"2023-12-01T23:18:35.866572+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:18:35.866572+0000","last_undegraded":"2023-12-01T23:18:35.866572+0000","last_fullsized":"2023-12-01T23:18:35.866572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786471+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:18:34.786471+0000","last_peered":"2023-12-01T23:18:34.786471+0000","last_clean":"2023-12-01T23:18:34.786471+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:18:34.786471+0000","last_undegraded":"2023-12-01T23:18:34.786471+0000","last_fullsized":"2023-12-01T23:18:34.786471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753827+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:18:34.753827+0000","last_peered":"2023-12-01T23:18:34.753827+0000","last_clean":"2023-12-01T23:18:34.753827+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:18:34.753827+0000","last_undegraded":"2023-12-01T23:18:34.753827+0000","last_fullsized":"2023-12-01T23:18:34.753827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866532+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:18:35.866532+0000","last_peered":"2023-12-01T23:18:35.866532+0000","last_clean":"2023-12-01T23:18:35.866532+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:18:35.866532+0000","last_undegraded":"2023-12-01T23:18:35.866532+0000","last_fullsized":"2023-12-01T23:18:35.866532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245667+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:18:36.245667+0000","last_peered":"2023-12-01T23:18:36.245667+0000","last_clean":"2023-12-01T23:18:36.245667+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:18:36.245667+0000","last_undegraded":"2023-12-01T23:18:36.245667+0000","last_fullsized":"2023-12-01T23:18:36.245667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767701+0000","last_change":"2023-12-01T23:18:28.821615+0000","last_active":"2023-12-01T23:18:34.767701+0000","last_peered":"2023-12-01T23:18:34.767701+0000","last_clean":"2023-12-01T23:18:34.767701+0000","last_became_active":"2023-12-01T23:18:28.821335+0000","last_became_peered":"2023-12-01T23:18:28.821335+0000","last_unstale":"2023-12-01T23:18:34.767701+0000","last_undegraded":"2023-12-01T23:18:34.767701+0000","last_fullsized":"2023-12-01T23:18:34.767701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787322+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:18:34.787322+0000","last_peered":"2023-12-01T23:18:34.787322+0000","last_clean":"2023-12-01T23:18:34.787322+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:18:34.787322+0000","last_undegraded":"2023-12-01T23:18:34.787322+0000","last_fullsized":"2023-12-01T23:18:34.787322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246556+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:18:36.246556+0000","last_peered":"2023-12-01T23:18:36.246556+0000","last_clean":"2023-12-01T23:18:36.246556+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:18:36.246556+0000","last_undegraded":"2023-12-01T23:18:36.246556+0000","last_fullsized":"2023-12-01T23:18:36.246556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784060+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:18:34.784060+0000","last_peered":"2023-12-01T23:18:34.784060+0000","last_clean":"2023-12-01T23:18:34.784060+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:18:34.784060+0000","last_undegraded":"2023-12-01T23:18:34.784060+0000","last_fullsized":"2023-12-01T23:18:34.784060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784195+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:18:34.784195+0000","last_peered":"2023-12-01T23:18:34.784195+0000","last_clean":"2023-12-01T23:18:34.784195+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:18:34.784195+0000","last_undegraded":"2023-12-01T23:18:34.784195+0000","last_fullsized":"2023-12-01T23:18:34.784195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753679+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:18:34.753679+0000","last_peered":"2023-12-01T23:18:34.753679+0000","last_clean":"2023-12-01T23:18:34.753679+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:18:34.753679+0000","last_undegraded":"2023-12-01T23:18:34.753679+0000","last_fullsized":"2023-12-01T23:18:34.753679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830120+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:18:34.830120+0000","last_peered":"2023-12-01T23:18:34.830120+0000","last_clean":"2023-12-01T23:18:34.830120+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:18:34.830120+0000","last_undegraded":"2023-12-01T23:18:34.830120+0000","last_fullsized":"2023-12-01T23:18:34.830120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245476+0000","last_change":"2023-12-01T23:18:34.837693+0000","last_active":"2023-12-01T23:18:36.245476+0000","last_peered":"2023-12-01T23:18:36.245476+0000","last_clean":"2023-12-01T23:18:36.245476+0000","last_became_active":"2023-12-01T23:18:34.837313+0000","last_became_peered":"2023-12-01T23:18:34.837313+0000","last_unstale":"2023-12-01T23:18:36.245476+0000","last_undegraded":"2023-12-01T23:18:36.245476+0000","last_fullsized":"2023-12-01T23:18:36.245476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:26.160117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784206+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:18:34.784206+0000","last_peered":"2023-12-01T23:18:34.784206+0000","last_clean":"2023-12-01T23:18:34.784206+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:18:34.784206+0000","last_undegraded":"2023-12-01T23:18:34.784206+0000","last_fullsized":"2023-12-01T23:18:34.784206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777604+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:18:34.777604+0000","last_peered":"2023-12-01T23:18:34.777604+0000","last_clean":"2023-12-01T23:18:34.777604+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:18:34.777604+0000","last_undegraded":"2023-12-01T23:18:34.777604+0000","last_fullsized":"2023-12-01T23:18:34.777604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867004+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:18:35.867004+0000","last_peered":"2023-12-01T23:18:35.867004+0000","last_clean":"2023-12-01T23:18:35.867004+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:18:35.867004+0000","last_undegraded":"2023-12-01T23:18:35.867004+0000","last_fullsized":"2023-12-01T23:18:35.867004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753650+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:18:34.753650+0000","last_peered":"2023-12-01T23:18:34.753650+0000","last_clean":"2023-12-01T23:18:34.753650+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:18:34.753650+0000","last_undegraded":"2023-12-01T23:18:34.753650+0000","last_fullsized":"2023-12-01T23:18:34.753650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830553+0000","last_change":"2023-12-01T23:18:28.878753+0000","last_active":"2023-12-01T23:18:34.830553+0000","last_peered":"2023-12-01T23:18:34.830553+0000","last_clean":"2023-12-01T23:18:34.830553+0000","last_became_active":"2023-12-01T23:18:28.878547+0000","last_became_peered":"2023-12-01T23:18:28.878547+0000","last_unstale":"2023-12-01T23:18:34.830553+0000","last_undegraded":"2023-12-01T23:18:34.830553+0000","last_fullsized":"2023-12-01T23:18:34.830553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786682+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:18:34.786682+0000","last_peered":"2023-12-01T23:18:34.786682+0000","last_clean":"2023-12-01T23:18:34.786682+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:18:34.786682+0000","last_undegraded":"2023-12-01T23:18:34.786682+0000","last_fullsized":"2023-12-01T23:18:34.786682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829191+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:18:34.829191+0000","last_peered":"2023-12-01T23:18:34.829191+0000","last_clean":"2023-12-01T23:18:34.829191+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:18:34.829191+0000","last_undegraded":"2023-12-01T23:18:34.829191+0000","last_fullsized":"2023-12-01T23:18:34.829191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784569+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:18:34.784569+0000","last_peered":"2023-12-01T23:18:34.784569+0000","last_clean":"2023-12-01T23:18:34.784569+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:18:34.784569+0000","last_undegraded":"2023-12-01T23:18:34.784569+0000","last_fullsized":"2023-12-01T23:18:34.784569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767962+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:18:34.767962+0000","last_peered":"2023-12-01T23:18:34.767962+0000","last_clean":"2023-12-01T23:18:34.767962+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:18:34.767962+0000","last_undegraded":"2023-12-01T23:18:34.767962+0000","last_fullsized":"2023-12-01T23:18:34.767962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753917+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:18:34.753917+0000","last_peered":"2023-12-01T23:18:34.753917+0000","last_clean":"2023-12-01T23:18:34.753917+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:18:34.753917+0000","last_undegraded":"2023-12-01T23:18:34.753917+0000","last_fullsized":"2023-12-01T23:18:34.753917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784917+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:18:34.784917+0000","last_peered":"2023-12-01T23:18:34.784917+0000","last_clean":"2023-12-01T23:18:34.784917+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:18:34.784917+0000","last_undegraded":"2023-12-01T23:18:34.784917+0000","last_fullsized":"2023-12-01T23:18:34.784917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787245+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:18:34.787245+0000","last_peered":"2023-12-01T23:18:34.787245+0000","last_clean":"2023-12-01T23:18:34.787245+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:18:34.787245+0000","last_undegraded":"2023-12-01T23:18:34.787245+0000","last_fullsized":"2023-12-01T23:18:34.787245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784036+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:18:34.784036+0000","last_peered":"2023-12-01T23:18:34.784036+0000","last_clean":"2023-12-01T23:18:34.784036+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:18:34.784036+0000","last_undegraded":"2023-12-01T23:18:34.784036+0000","last_fullsized":"2023-12-01T23:18:34.784036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786612+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:18:34.786612+0000","last_peered":"2023-12-01T23:18:34.786612+0000","last_clean":"2023-12-01T23:18:34.786612+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:18:34.786612+0000","last_undegraded":"2023-12-01T23:18:34.786612+0000","last_fullsized":"2023-12-01T23:18:34.786612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828033+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:18:34.828033+0000","last_peered":"2023-12-01T23:18:34.828033+0000","last_clean":"2023-12-01T23:18:34.828033+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:18:34.828033+0000","last_undegraded":"2023-12-01T23:18:34.828033+0000","last_fullsized":"2023-12-01T23:18:34.828033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753755+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:18:34.753755+0000","last_peered":"2023-12-01T23:18:34.753755+0000","last_clean":"2023-12-01T23:18:34.753755+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:18:34.753755+0000","last_undegraded":"2023-12-01T23:18:34.753755+0000","last_fullsized":"2023-12-01T23:18:34.753755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759182+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:18:34.759182+0000","last_peered":"2023-12-01T23:18:34.759182+0000","last_clean":"2023-12-01T23:18:34.759182+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:18:34.759182+0000","last_undegraded":"2023-12-01T23:18:34.759182+0000","last_fullsized":"2023-12-01T23:18:34.759182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830476+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:18:34.830476+0000","last_peered":"2023-12-01T23:18:34.830476+0000","last_clean":"2023-12-01T23:18:34.830476+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:18:34.830476+0000","last_undegraded":"2023-12-01T23:18:34.830476+0000","last_fullsized":"2023-12-01T23:18:34.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786114+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:18:34.786114+0000","last_peered":"2023-12-01T23:18:34.786114+0000","last_clean":"2023-12-01T23:18:34.786114+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:18:34.786114+0000","last_undegraded":"2023-12-01T23:18:34.786114+0000","last_fullsized":"2023-12-01T23:18:34.786114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787165+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:18:34.787165+0000","last_peered":"2023-12-01T23:18:34.787165+0000","last_clean":"2023-12-01T23:18:34.787165+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:18:34.787165+0000","last_undegraded":"2023-12-01T23:18:34.787165+0000","last_fullsized":"2023-12-01T23:18:34.787165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767905+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:18:34.767905+0000","last_peered":"2023-12-01T23:18:34.767905+0000","last_clean":"2023-12-01T23:18:34.767905+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:18:34.767905+0000","last_undegraded":"2023-12-01T23:18:34.767905+0000","last_fullsized":"2023-12-01T23:18:34.767905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828817+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:18:34.828817+0000","last_peered":"2023-12-01T23:18:34.828817+0000","last_clean":"2023-12-01T23:18:34.828817+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:18:34.828817+0000","last_undegraded":"2023-12-01T23:18:34.828817+0000","last_fullsized":"2023-12-01T23:18:34.828817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784004+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:18:34.784004+0000","last_peered":"2023-12-01T23:18:34.784004+0000","last_clean":"2023-12-01T23:18:34.784004+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:18:34.784004+0000","last_undegraded":"2023-12-01T23:18:34.784004+0000","last_fullsized":"2023-12-01T23:18:34.784004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778132+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:18:34.778132+0000","last_peered":"2023-12-01T23:18:34.778132+0000","last_clean":"2023-12-01T23:18:34.778132+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:18:34.778132+0000","last_undegraded":"2023-12-01T23:18:34.778132+0000","last_fullsized":"2023-12-01T23:18:34.778132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753984+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:18:34.753984+0000","last_peered":"2023-12-01T23:18:34.753984+0000","last_clean":"2023-12-01T23:18:34.753984+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:18:34.753984+0000","last_undegraded":"2023-12-01T23:18:34.753984+0000","last_fullsized":"2023-12-01T23:18:34.753984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753831+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:18:34.753831+0000","last_peered":"2023-12-01T23:18:34.753831+0000","last_clean":"2023-12-01T23:18:34.753831+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:18:34.753831+0000","last_undegraded":"2023-12-01T23:18:34.753831+0000","last_fullsized":"2023-12-01T23:18:34.753831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759179+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:18:34.759179+0000","last_peered":"2023-12-01T23:18:34.759179+0000","last_clean":"2023-12-01T23:18:34.759179+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:18:34.759179+0000","last_undegraded":"2023-12-01T23:18:34.759179+0000","last_fullsized":"2023-12-01T23:18:34.759179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783732+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:18:34.783732+0000","last_peered":"2023-12-01T23:18:34.783732+0000","last_clean":"2023-12-01T23:18:34.783732+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:18:34.783732+0000","last_undegraded":"2023-12-01T23:18:34.783732+0000","last_fullsized":"2023-12-01T23:18:34.783732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758745+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:18:34.758745+0000","last_peered":"2023-12-01T23:18:34.758745+0000","last_clean":"2023-12-01T23:18:34.758745+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:18:34.758745+0000","last_undegraded":"2023-12-01T23:18:34.758745+0000","last_fullsized":"2023-12-01T23:18:34.758745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786541+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:18:34.786541+0000","last_peered":"2023-12-01T23:18:34.786541+0000","last_clean":"2023-12-01T23:18:34.786541+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:18:34.786541+0000","last_undegraded":"2023-12-01T23:18:34.786541+0000","last_fullsized":"2023-12-01T23:18:34.786541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758959+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:18:34.758959+0000","last_peered":"2023-12-01T23:18:34.758959+0000","last_clean":"2023-12-01T23:18:34.758959+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:18:34.758959+0000","last_undegraded":"2023-12-01T23:18:34.758959+0000","last_fullsized":"2023-12-01T23:18:34.758959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785803+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.785803+0000","last_peered":"2023-12-01T23:18:34.785803+0000","last_clean":"2023-12-01T23:18:34.785803+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:18:34.785803+0000","last_undegraded":"2023-12-01T23:18:34.785803+0000","last_fullsized":"2023-12-01T23:18:34.785803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827512+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:18:34.827512+0000","last_peered":"2023-12-01T23:18:34.827512+0000","last_clean":"2023-12-01T23:18:34.827512+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:18:34.827512+0000","last_undegraded":"2023-12-01T23:18:34.827512+0000","last_fullsized":"2023-12-01T23:18:34.827512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767682+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:18:34.767682+0000","last_peered":"2023-12-01T23:18:34.767682+0000","last_clean":"2023-12-01T23:18:34.767682+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:18:34.767682+0000","last_undegraded":"2023-12-01T23:18:34.767682+0000","last_fullsized":"2023-12-01T23:18:34.767682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759106+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:18:34.759106+0000","last_peered":"2023-12-01T23:18:34.759106+0000","last_clean":"2023-12-01T23:18:34.759106+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:18:34.759106+0000","last_undegraded":"2023-12-01T23:18:34.759106+0000","last_fullsized":"2023-12-01T23:18:34.759106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":703555,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703611,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":112731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":112605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:19:00.164 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:19:00.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.297+0000 7f5ed8d2c640 1 Processor -- start 2023-12-01T23:19:00.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.297+0000 7f5ed8d2c640 1 -- start start 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed8d2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 0x7f5ed4159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed8d2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ed40c5e60 0x7f5ed41641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed8d2c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed4153fc0 con 0x7f5ed406fa00 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed8d2c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed40c3340 con 0x7f5ed40c5e60 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed8d2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed406b7b0 con 0x7f5ed4153be0 2023-12-01T23:19:00.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ecbfff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5ed406fa00 0x7f5ed40c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54000/0 (socket says 172.21.15.96:54000) 2023-12-01T23:19:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ecbfff640 1 -- 172.21.15.96:0/1821910165 learned_addr learned my addr 172.21.15.96:0/1821910165 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed2d9d640 1 --2- 172.21.15.96:0/1821910165 >> v2:172.21.15.102:3300/0 conn(0x7f5ed40c5e60 0x7f5ed41641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.298+0000 7f5ed259c640 1 --2- 172.21.15.96:0/1821910165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 0x7f5ed4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.301+0000 7f5ed1d9b640 1 -- 172.21.15.96:0/1821910165 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559233074 0 0) 0x7f5ed4153fc0 con 0x7f5ed406fa00 2023-12-01T23:19:00.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.301+0000 7f5ed1d9b640 1 -- 172.21.15.96:0/1821910165 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec0003520 con 0x7f5ed406fa00 2023-12-01T23:19:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.302+0000 7f5ed259c640 1 -- 172.21.15.96:0/1821910165 >> v2:172.21.15.102:3300/0 conn(0x7f5ed40c5e60 msgr2=0x7f5ed41641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.302+0000 7f5ed259c640 1 --2- 172.21.15.96:0/1821910165 >> v2:172.21.15.102:3300/0 conn(0x7f5ed40c5e60 0x7f5ed41641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.302+0000 7f5ed259c640 1 -- 172.21.15.96:0/1821910165 >> v1:172.21.15.96:6789/0 conn(0x7f5ed406fa00 legacy=0x7f5ed40c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.302+0000 7f5ed259c640 1 -- 172.21.15.96:0/1821910165 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed406ba90 con 0x7f5ed4153be0 2023-12-01T23:19:00.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.306+0000 7f5ed259c640 1 --2- 172.21.15.96:0/1821910165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 0x7f5ed4159890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40097a0 tx=0x7f5ec402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dc01d79089f28cc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:00.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed1d9b640 1 -- 172.21.15.96:0/1821910165 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4031830 con 0x7f5ed4153be0 2023-12-01T23:19:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed1d9b640 1 -- 172.21.15.96:0/1821910165 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4031990 con 0x7f5ed4153be0 2023-12-01T23:19:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed1d9b640 1 -- 172.21.15.96:0/1821910165 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4031d20 con 0x7f5ed4153be0 2023-12-01T23:19:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/1821910165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 msgr2=0x7f5ed4159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/1821910165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 0x7f5ed4159890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40097a0 tx=0x7f5ec402b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/1821910165 shutdown_connections 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/1821910165 >> v2:172.21.15.102:3300/0 conn(0x7f5ed40c5e60 0x7f5ed41641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/1821910165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed4153be0 0x7f5ed4159890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/1821910165 >> 172.21.15.96:0/1821910165 conn(0x7f5ed40c7f60 msgr2=0x7f5ed40c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/1821910165 shutdown_connections 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.312+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/1821910165 wait complete. 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 Processor -- start 2023-12-01T23:19:00.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 -- start start 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed406fa00 0x7f5ed4149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ed4153be0 0x7f5ed41f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414c870 con 0x7f5ed40c5e60 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4157620 con 0x7f5ed4153be0 2023-12-01T23:19:00.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.314+0000 7f5ed8d2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4157900 con 0x7f5ed406fa00 2023-12-01T23:19:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.315+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.315+0000 7f5ed2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ed4153be0 0x7f5ed41f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.315+0000 7f5ecbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36204/0 (socket says 172.21.15.96:36204) 2023-12-01T23:19:00.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.315+0000 7f5ecbfff640 1 -- 172.21.15.96:0/4178990075 learned_addr learned my addr 172.21.15.96:0/4178990075 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:00.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.317+0000 7f5ed259c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed406fa00 0x7f5ed4149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.318+0000 7f5ecbfff640 1 -- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed406fa00 msgr2=0x7f5ed4149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.318+0000 7f5ecbfff640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed406fa00 0x7f5ed4149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.318+0000 7f5ecbfff640 1 -- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ed4153be0 msgr2=0x7f5ed41f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.318+0000 7f5ecbfff640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ed4153be0 0x7f5ed41f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.318+0000 7f5ecbfff640 1 -- 172.21.15.96:0/4178990075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009400 con 0x7f5ed40c5e60 2023-12-01T23:19:00.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.321+0000 7f5ecbfff640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c3e0 tx=0x7f5ebc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:00.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.324+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc005ce0 con 0x7f5ed40c5e60 2023-12-01T23:19:00.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.324+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc005e40 con 0x7f5ed40c5e60 2023-12-01T23:19:00.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.324+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0072f0 con 0x7f5ed40c5e60 2023-12-01T23:19:00.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.324+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed414c220 con 0x7f5ed40c5e60 2023-12-01T23:19:00.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.324+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed41e6480 con 0x7f5ed40c5e60 2023-12-01T23:19:00.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.325+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed4067500 con 0x7f5ed40c5e60 2023-12-01T23:19:00.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.343+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ebc007450 con 0x7f5ed40c5e60 2023-12-01T23:19:00.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.344+0000 7f5ecaffd640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 0x7f5eb406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.344+0000 7f5ed259c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 0x7f5eb406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.344+0000 7f5ed259c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 0x7f5eb406d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4036000 tx=0x7f5ec403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:00.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.347+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ebc057e30 con 0x7f5ed40c5e60 2023-12-01T23:19:00.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.585+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ebc054170 con 0x7f5ed40c5e60 2023-12-01T23:19:00.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.757+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ed406ef20 con 0x7f5eb406aec0 2023-12-01T23:19:00.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.765+0000 7f5ecaffd640 1 -- 172.21.15.96:0/4178990075 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345285 (secure 0 0 0) 0x7f5ec4045410 con 0x7f5eb406aec0 2023-12-01T23:19:00.770 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:00.772 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 msgr2=0x7f5eb406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 0x7f5eb406d380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4036000 tx=0x7f5ec403c040 comp rx=0 tx=0).stop 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 msgr2=0x7f5ed414de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc00c3e0 tx=0x7f5ebc00c8a0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 shutdown_connections 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5eb406aec0 0x7f5eb406d380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ed4153be0 0x7f5ed41f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed40c5e60 0x7f5ed414de80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 --2- 172.21.15.96:0/4178990075 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ed406fa00 0x7f5ed4149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 >> 172.21.15.96:0/4178990075 conn(0x7f5ed40c7f60 msgr2=0x7f5ed40c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 shutdown_connections 2023-12-01T23:19:00.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.769+0000 7f5ed8d2c640 1 -- 172.21.15.96:0/4178990075 wait complete. 2023-12-01T23:19:00.782 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-12-01T23:18:59.795757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218568,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756152,"statfs":{"total":773094113280,"available":772870299648,"internally_reserved":0,"allocated":2457600,"data_stored":2090854,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12737,"internal_metadata":221236799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002817"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828324+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:18:34.828324+0000","last_peered":"2023-12-01T23:18:34.828324+0000","last_clean":"2023-12-01T23:18:34.828324+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:18:34.828324+0000","last_undegraded":"2023-12-01T23:18:34.828324+0000","last_fullsized":"2023-12-01T23:18:34.828324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784668+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:18:34.784668+0000","last_peered":"2023-12-01T23:18:34.784668+0000","last_clean":"2023-12-01T23:18:34.784668+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:18:34.784668+0000","last_undegraded":"2023-12-01T23:18:34.784668+0000","last_fullsized":"2023-12-01T23:18:34.784668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866489+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:18:35.866489+0000","last_peered":"2023-12-01T23:18:35.866489+0000","last_clean":"2023-12-01T23:18:35.866489+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:18:35.866489+0000","last_undegraded":"2023-12-01T23:18:35.866489+0000","last_fullsized":"2023-12-01T23:18:35.866489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784751+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:18:34.784751+0000","last_peered":"2023-12-01T23:18:34.784751+0000","last_clean":"2023-12-01T23:18:34.784751+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:18:34.784751+0000","last_undegraded":"2023-12-01T23:18:34.784751+0000","last_fullsized":"2023-12-01T23:18:34.784751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828043+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:18:34.828043+0000","last_peered":"2023-12-01T23:18:34.828043+0000","last_clean":"2023-12-01T23:18:34.828043+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:18:34.828043+0000","last_undegraded":"2023-12-01T23:18:34.828043+0000","last_fullsized":"2023-12-01T23:18:34.828043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245374+0000","last_change":"2023-12-01T23:18:34.787052+0000","last_active":"2023-12-01T23:18:36.245374+0000","last_peered":"2023-12-01T23:18:36.245374+0000","last_clean":"2023-12-01T23:18:36.245374+0000","last_became_active":"2023-12-01T23:18:34.786671+0000","last_became_peered":"2023-12-01T23:18:34.786671+0000","last_unstale":"2023-12-01T23:18:36.245374+0000","last_undegraded":"2023-12-01T23:18:36.245374+0000","last_fullsized":"2023-12-01T23:18:36.245374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:31.773956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759098+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:18:34.759098+0000","last_peered":"2023-12-01T23:18:34.759098+0000","last_clean":"2023-12-01T23:18:34.759098+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:18:34.759098+0000","last_undegraded":"2023-12-01T23:18:34.759098+0000","last_fullsized":"2023-12-01T23:18:34.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785886+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:18:34.785886+0000","last_peered":"2023-12-01T23:18:34.785886+0000","last_clean":"2023-12-01T23:18:34.785886+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:18:34.785886+0000","last_undegraded":"2023-12-01T23:18:34.785886+0000","last_fullsized":"2023-12-01T23:18:34.785886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245809+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:18:36.245809+0000","last_peered":"2023-12-01T23:18:36.245809+0000","last_clean":"2023-12-01T23:18:36.245809+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:18:36.245809+0000","last_undegraded":"2023-12-01T23:18:36.245809+0000","last_fullsized":"2023-12-01T23:18:36.245809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759053+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:18:34.759053+0000","last_peered":"2023-12-01T23:18:34.759053+0000","last_clean":"2023-12-01T23:18:34.759053+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:18:34.759053+0000","last_undegraded":"2023-12-01T23:18:34.759053+0000","last_fullsized":"2023-12-01T23:18:34.759053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786203+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:18:34.786203+0000","last_peered":"2023-12-01T23:18:34.786203+0000","last_clean":"2023-12-01T23:18:34.786203+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:18:34.786203+0000","last_undegraded":"2023-12-01T23:18:34.786203+0000","last_fullsized":"2023-12-01T23:18:34.786203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245949+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:18:36.245949+0000","last_peered":"2023-12-01T23:18:36.245949+0000","last_clean":"2023-12-01T23:18:36.245949+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:18:36.245949+0000","last_undegraded":"2023-12-01T23:18:36.245949+0000","last_fullsized":"2023-12-01T23:18:36.245949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759109+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:18:34.759109+0000","last_peered":"2023-12-01T23:18:34.759109+0000","last_clean":"2023-12-01T23:18:34.759109+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:18:34.759109+0000","last_undegraded":"2023-12-01T23:18:34.759109+0000","last_fullsized":"2023-12-01T23:18:34.759109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245916+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:18:36.245916+0000","last_peered":"2023-12-01T23:18:36.245916+0000","last_clean":"2023-12-01T23:18:36.245916+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:18:36.245916+0000","last_undegraded":"2023-12-01T23:18:36.245916+0000","last_fullsized":"2023-12-01T23:18:36.245916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784022+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:18:34.784022+0000","last_peered":"2023-12-01T23:18:34.784022+0000","last_clean":"2023-12-01T23:18:34.784022+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:18:34.784022+0000","last_undegraded":"2023-12-01T23:18:34.784022+0000","last_fullsized":"2023-12-01T23:18:34.784022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768545+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:18:34.768545+0000","last_peered":"2023-12-01T23:18:34.768545+0000","last_clean":"2023-12-01T23:18:34.768545+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:18:34.768545+0000","last_undegraded":"2023-12-01T23:18:34.768545+0000","last_fullsized":"2023-12-01T23:18:34.768545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246329+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:18:36.246329+0000","last_peered":"2023-12-01T23:18:36.246329+0000","last_clean":"2023-12-01T23:18:36.246329+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:18:36.246329+0000","last_undegraded":"2023-12-01T23:18:36.246329+0000","last_fullsized":"2023-12-01T23:18:36.246329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783932+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:18:34.783932+0000","last_peered":"2023-12-01T23:18:34.783932+0000","last_clean":"2023-12-01T23:18:34.783932+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:18:34.783932+0000","last_undegraded":"2023-12-01T23:18:34.783932+0000","last_fullsized":"2023-12-01T23:18:34.783932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767868+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:18:34.767868+0000","last_peered":"2023-12-01T23:18:34.767868+0000","last_clean":"2023-12-01T23:18:34.767868+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:18:34.767868+0000","last_undegraded":"2023-12-01T23:18:34.767868+0000","last_fullsized":"2023-12-01T23:18:34.767868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856617+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:18:35.856617+0000","last_peered":"2023-12-01T23:18:35.856617+0000","last_clean":"2023-12-01T23:18:35.856617+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:18:35.856617+0000","last_undegraded":"2023-12-01T23:18:35.856617+0000","last_fullsized":"2023-12-01T23:18:35.856617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777575+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:18:34.777575+0000","last_peered":"2023-12-01T23:18:34.777575+0000","last_clean":"2023-12-01T23:18:34.777575+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:18:34.777575+0000","last_undegraded":"2023-12-01T23:18:34.777575+0000","last_fullsized":"2023-12-01T23:18:34.777575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758714+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:18:34.758714+0000","last_peered":"2023-12-01T23:18:34.758714+0000","last_clean":"2023-12-01T23:18:34.758714+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:18:34.758714+0000","last_undegraded":"2023-12-01T23:18:34.758714+0000","last_fullsized":"2023-12-01T23:18:34.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245493+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:18:36.245493+0000","last_peered":"2023-12-01T23:18:36.245493+0000","last_clean":"2023-12-01T23:18:36.245493+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:18:36.245493+0000","last_undegraded":"2023-12-01T23:18:36.245493+0000","last_fullsized":"2023-12-01T23:18:36.245493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829303+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:18:34.829303+0000","last_peered":"2023-12-01T23:18:34.829303+0000","last_clean":"2023-12-01T23:18:34.829303+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:18:34.829303+0000","last_undegraded":"2023-12-01T23:18:34.829303+0000","last_fullsized":"2023-12-01T23:18:34.829303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753914+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:18:34.753914+0000","last_peered":"2023-12-01T23:18:34.753914+0000","last_clean":"2023-12-01T23:18:34.753914+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:18:34.753914+0000","last_undegraded":"2023-12-01T23:18:34.753914+0000","last_fullsized":"2023-12-01T23:18:34.753914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246240+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:18:36.246240+0000","last_peered":"2023-12-01T23:18:36.246240+0000","last_clean":"2023-12-01T23:18:36.246240+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:18:36.246240+0000","last_undegraded":"2023-12-01T23:18:36.246240+0000","last_fullsized":"2023-12-01T23:18:36.246240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784985+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:18:34.784985+0000","last_peered":"2023-12-01T23:18:34.784985+0000","last_clean":"2023-12-01T23:18:34.784985+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:18:34.784985+0000","last_undegraded":"2023-12-01T23:18:34.784985+0000","last_fullsized":"2023-12-01T23:18:34.784985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.732271+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:18:35.732271+0000","last_peered":"2023-12-01T23:18:35.732271+0000","last_clean":"2023-12-01T23:18:35.732271+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:18:35.732271+0000","last_undegraded":"2023-12-01T23:18:35.732271+0000","last_fullsized":"2023-12-01T23:18:35.732271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866421+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:18:35.866421+0000","last_peered":"2023-12-01T23:18:35.866421+0000","last_clean":"2023-12-01T23:18:35.866421+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:18:35.866421+0000","last_undegraded":"2023-12-01T23:18:35.866421+0000","last_fullsized":"2023-12-01T23:18:35.866421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768150+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:18:34.768150+0000","last_peered":"2023-12-01T23:18:34.768150+0000","last_clean":"2023-12-01T23:18:34.768150+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:18:34.768150+0000","last_undegraded":"2023-12-01T23:18:34.768150+0000","last_fullsized":"2023-12-01T23:18:34.768150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759244+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:18:34.759244+0000","last_peered":"2023-12-01T23:18:34.759244+0000","last_clean":"2023-12-01T23:18:34.759244+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:18:34.759244+0000","last_undegraded":"2023-12-01T23:18:34.759244+0000","last_fullsized":"2023-12-01T23:18:34.759244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245847+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:18:36.245847+0000","last_peered":"2023-12-01T23:18:36.245847+0000","last_clean":"2023-12-01T23:18:36.245847+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:18:36.245847+0000","last_undegraded":"2023-12-01T23:18:36.245847+0000","last_fullsized":"2023-12-01T23:18:36.245847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786277+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:18:34.786277+0000","last_peered":"2023-12-01T23:18:34.786277+0000","last_clean":"2023-12-01T23:18:34.786277+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:18:34.786277+0000","last_undegraded":"2023-12-01T23:18:34.786277+0000","last_fullsized":"2023-12-01T23:18:34.786277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768227+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:18:34.768227+0000","last_peered":"2023-12-01T23:18:34.768227+0000","last_clean":"2023-12-01T23:18:34.768227+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:18:34.768227+0000","last_undegraded":"2023-12-01T23:18:34.768227+0000","last_fullsized":"2023-12-01T23:18:34.768227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856126+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:18:35.856126+0000","last_peered":"2023-12-01T23:18:35.856126+0000","last_clean":"2023-12-01T23:18:35.856126+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:18:35.856126+0000","last_undegraded":"2023-12-01T23:18:35.856126+0000","last_fullsized":"2023-12-01T23:18:35.856126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778077+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:18:34.778077+0000","last_peered":"2023-12-01T23:18:34.778077+0000","last_clean":"2023-12-01T23:18:34.778077+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:18:34.778077+0000","last_undegraded":"2023-12-01T23:18:34.778077+0000","last_fullsized":"2023-12-01T23:18:34.778077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786794+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:18:34.786794+0000","last_peered":"2023-12-01T23:18:34.786794+0000","last_clean":"2023-12-01T23:18:34.786794+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:18:34.786794+0000","last_undegraded":"2023-12-01T23:18:34.786794+0000","last_fullsized":"2023-12-01T23:18:34.786794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856624+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:18:35.856624+0000","last_peered":"2023-12-01T23:18:35.856624+0000","last_clean":"2023-12-01T23:18:35.856624+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:18:35.856624+0000","last_undegraded":"2023-12-01T23:18:35.856624+0000","last_fullsized":"2023-12-01T23:18:35.856624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767757+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:18:34.767757+0000","last_peered":"2023-12-01T23:18:34.767757+0000","last_clean":"2023-12-01T23:18:34.767757+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:18:34.767757+0000","last_undegraded":"2023-12-01T23:18:34.767757+0000","last_fullsized":"2023-12-01T23:18:34.767757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830640+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:18:34.830640+0000","last_peered":"2023-12-01T23:18:34.830640+0000","last_clean":"2023-12-01T23:18:34.830640+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:18:34.830640+0000","last_undegraded":"2023-12-01T23:18:34.830640+0000","last_fullsized":"2023-12-01T23:18:34.830640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856610+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:18:35.856610+0000","last_peered":"2023-12-01T23:18:35.856610+0000","last_clean":"2023-12-01T23:18:35.856610+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:18:35.856610+0000","last_undegraded":"2023-12-01T23:18:35.856610+0000","last_fullsized":"2023-12-01T23:18:35.856610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827686+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:18:34.827686+0000","last_peered":"2023-12-01T23:18:34.827686+0000","last_clean":"2023-12-01T23:18:34.827686+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:18:34.827686+0000","last_undegraded":"2023-12-01T23:18:34.827686+0000","last_fullsized":"2023-12-01T23:18:34.827686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758788+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:18:34.758788+0000","last_peered":"2023-12-01T23:18:34.758788+0000","last_clean":"2023-12-01T23:18:34.758788+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:18:34.758788+0000","last_undegraded":"2023-12-01T23:18:34.758788+0000","last_fullsized":"2023-12-01T23:18:34.758788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245861+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:18:36.245861+0000","last_peered":"2023-12-01T23:18:36.245861+0000","last_clean":"2023-12-01T23:18:36.245861+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:18:36.245861+0000","last_undegraded":"2023-12-01T23:18:36.245861+0000","last_fullsized":"2023-12-01T23:18:36.245861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783998+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:18:34.783998+0000","last_peered":"2023-12-01T23:18:34.783998+0000","last_clean":"2023-12-01T23:18:34.783998+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:18:34.783998+0000","last_undegraded":"2023-12-01T23:18:34.783998+0000","last_fullsized":"2023-12-01T23:18:34.783998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785908+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:18:34.785908+0000","last_peered":"2023-12-01T23:18:34.785908+0000","last_clean":"2023-12-01T23:18:34.785908+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:18:34.785908+0000","last_undegraded":"2023-12-01T23:18:34.785908+0000","last_fullsized":"2023-12-01T23:18:34.785908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758870+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:18:34.758870+0000","last_peered":"2023-12-01T23:18:34.758870+0000","last_clean":"2023-12-01T23:18:34.758870+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:18:34.758870+0000","last_undegraded":"2023-12-01T23:18:34.758870+0000","last_fullsized":"2023-12-01T23:18:34.758870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246489+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:18:36.246489+0000","last_peered":"2023-12-01T23:18:36.246489+0000","last_clean":"2023-12-01T23:18:36.246489+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:18:36.246489+0000","last_undegraded":"2023-12-01T23:18:36.246489+0000","last_fullsized":"2023-12-01T23:18:36.246489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758994+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:18:34.758994+0000","last_peered":"2023-12-01T23:18:34.758994+0000","last_clean":"2023-12-01T23:18:34.758994+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:18:34.758994+0000","last_undegraded":"2023-12-01T23:18:34.758994+0000","last_fullsized":"2023-12-01T23:18:34.758994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830694+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:18:34.830694+0000","last_peered":"2023-12-01T23:18:34.830694+0000","last_clean":"2023-12-01T23:18:34.830694+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:18:34.830694+0000","last_undegraded":"2023-12-01T23:18:34.830694+0000","last_fullsized":"2023-12-01T23:18:34.830694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246217+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:18:36.246217+0000","last_peered":"2023-12-01T23:18:36.246217+0000","last_clean":"2023-12-01T23:18:36.246217+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:18:36.246217+0000","last_undegraded":"2023-12-01T23:18:36.246217+0000","last_fullsized":"2023-12-01T23:18:36.246217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785964+0000","last_change":"2023-12-01T23:18:28.873819+0000","last_active":"2023-12-01T23:18:34.785964+0000","last_peered":"2023-12-01T23:18:34.785964+0000","last_clean":"2023-12-01T23:18:34.785964+0000","last_became_active":"2023-12-01T23:18:28.872949+0000","last_became_peered":"2023-12-01T23:18:28.872949+0000","last_unstale":"2023-12-01T23:18:34.785964+0000","last_undegraded":"2023-12-01T23:18:34.785964+0000","last_fullsized":"2023-12-01T23:18:34.785964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768052+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:18:34.768052+0000","last_peered":"2023-12-01T23:18:34.768052+0000","last_clean":"2023-12-01T23:18:34.768052+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:18:34.768052+0000","last_undegraded":"2023-12-01T23:18:34.768052+0000","last_fullsized":"2023-12-01T23:18:34.768052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245798+0000","last_change":"2023-12-01T23:18:34.834125+0000","last_active":"2023-12-01T23:18:36.245798+0000","last_peered":"2023-12-01T23:18:36.245798+0000","last_clean":"2023-12-01T23:18:36.245798+0000","last_became_active":"2023-12-01T23:18:34.833739+0000","last_became_peered":"2023-12-01T23:18:34.833739+0000","last_unstale":"2023-12-01T23:18:36.245798+0000","last_undegraded":"2023-12-01T23:18:36.245798+0000","last_fullsized":"2023-12-01T23:18:36.245798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:04.156636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759250+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:18:34.759250+0000","last_peered":"2023-12-01T23:18:34.759250+0000","last_clean":"2023-12-01T23:18:34.759250+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:18:34.759250+0000","last_undegraded":"2023-12-01T23:18:34.759250+0000","last_fullsized":"2023-12-01T23:18:34.759250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830583+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:18:34.830583+0000","last_peered":"2023-12-01T23:18:34.830583+0000","last_clean":"2023-12-01T23:18:34.830583+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:18:34.830583+0000","last_undegraded":"2023-12-01T23:18:34.830583+0000","last_fullsized":"2023-12-01T23:18:34.830583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245379+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:18:36.245379+0000","last_peered":"2023-12-01T23:18:36.245379+0000","last_clean":"2023-12-01T23:18:36.245379+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:18:36.245379+0000","last_undegraded":"2023-12-01T23:18:36.245379+0000","last_fullsized":"2023-12-01T23:18:36.245379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759012+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.759012+0000","last_peered":"2023-12-01T23:18:34.759012+0000","last_clean":"2023-12-01T23:18:34.759012+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:18:34.759012+0000","last_undegraded":"2023-12-01T23:18:34.759012+0000","last_fullsized":"2023-12-01T23:18:34.759012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778257+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:18:34.778257+0000","last_peered":"2023-12-01T23:18:34.778257+0000","last_clean":"2023-12-01T23:18:34.778257+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:18:34.778257+0000","last_undegraded":"2023-12-01T23:18:34.778257+0000","last_fullsized":"2023-12-01T23:18:34.778257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245873+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:18:36.245873+0000","last_peered":"2023-12-01T23:18:36.245873+0000","last_clean":"2023-12-01T23:18:36.245873+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:18:36.245873+0000","last_undegraded":"2023-12-01T23:18:36.245873+0000","last_fullsized":"2023-12-01T23:18:36.245873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758841+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:18:34.758841+0000","last_peered":"2023-12-01T23:18:34.758841+0000","last_clean":"2023-12-01T23:18:34.758841+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:18:34.758841+0000","last_undegraded":"2023-12-01T23:18:34.758841+0000","last_fullsized":"2023-12-01T23:18:34.758841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827350+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:18:34.827350+0000","last_peered":"2023-12-01T23:18:34.827350+0000","last_clean":"2023-12-01T23:18:34.827350+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:18:34.827350+0000","last_undegraded":"2023-12-01T23:18:34.827350+0000","last_fullsized":"2023-12-01T23:18:34.827350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245779+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:18:36.245779+0000","last_peered":"2023-12-01T23:18:36.245779+0000","last_clean":"2023-12-01T23:18:36.245779+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:18:36.245779+0000","last_undegraded":"2023-12-01T23:18:36.245779+0000","last_fullsized":"2023-12-01T23:18:36.245779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753529+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:18:34.753529+0000","last_peered":"2023-12-01T23:18:34.753529+0000","last_clean":"2023-12-01T23:18:34.753529+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:18:34.753529+0000","last_undegraded":"2023-12-01T23:18:34.753529+0000","last_fullsized":"2023-12-01T23:18:34.753529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867099+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:18:35.867099+0000","last_peered":"2023-12-01T23:18:35.867099+0000","last_clean":"2023-12-01T23:18:35.867099+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:18:35.867099+0000","last_undegraded":"2023-12-01T23:18:35.867099+0000","last_fullsized":"2023-12-01T23:18:35.867099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759024+0000","last_change":"2023-12-01T23:18:28.872268+0000","last_active":"2023-12-01T23:18:34.759024+0000","last_peered":"2023-12-01T23:18:34.759024+0000","last_clean":"2023-12-01T23:18:34.759024+0000","last_became_active":"2023-12-01T23:18:28.872020+0000","last_became_peered":"2023-12-01T23:18:28.872020+0000","last_unstale":"2023-12-01T23:18:34.759024+0000","last_undegraded":"2023-12-01T23:18:34.759024+0000","last_fullsized":"2023-12-01T23:18:34.759024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786751+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:18:34.786751+0000","last_peered":"2023-12-01T23:18:34.786751+0000","last_clean":"2023-12-01T23:18:34.786751+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:18:34.786751+0000","last_undegraded":"2023-12-01T23:18:34.786751+0000","last_fullsized":"2023-12-01T23:18:34.786751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866861+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:18:35.866861+0000","last_peered":"2023-12-01T23:18:35.866861+0000","last_clean":"2023-12-01T23:18:35.866861+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:18:35.866861+0000","last_undegraded":"2023-12-01T23:18:35.866861+0000","last_fullsized":"2023-12-01T23:18:35.866861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828897+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:18:34.828897+0000","last_peered":"2023-12-01T23:18:34.828897+0000","last_clean":"2023-12-01T23:18:34.828897+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:18:34.828897+0000","last_undegraded":"2023-12-01T23:18:34.828897+0000","last_fullsized":"2023-12-01T23:18:34.828897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829997+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:18:34.829997+0000","last_peered":"2023-12-01T23:18:34.829997+0000","last_clean":"2023-12-01T23:18:34.829997+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:18:34.829997+0000","last_undegraded":"2023-12-01T23:18:34.829997+0000","last_fullsized":"2023-12-01T23:18:34.829997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246916+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:18:36.246916+0000","last_peered":"2023-12-01T23:18:36.246916+0000","last_clean":"2023-12-01T23:18:36.246916+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:18:36.246916+0000","last_undegraded":"2023-12-01T23:18:36.246916+0000","last_fullsized":"2023-12-01T23:18:36.246916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758889+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:18:34.758889+0000","last_peered":"2023-12-01T23:18:34.758889+0000","last_clean":"2023-12-01T23:18:34.758889+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:18:34.758889+0000","last_undegraded":"2023-12-01T23:18:34.758889+0000","last_fullsized":"2023-12-01T23:18:34.758889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:44.926031+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:18:44.926031+0000","last_peered":"2023-12-01T23:18:44.926031+0000","last_clean":"2023-12-01T23:18:44.926031+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:18:44.926031+0000","last_undegraded":"2023-12-01T23:18:44.926031+0000","last_fullsized":"2023-12-01T23:18:44.926031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856252+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:18:35.856252+0000","last_peered":"2023-12-01T23:18:35.856252+0000","last_clean":"2023-12-01T23:18:35.856252+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:18:35.856252+0000","last_undegraded":"2023-12-01T23:18:35.856252+0000","last_fullsized":"2023-12-01T23:18:35.856252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778209+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:18:34.778209+0000","last_peered":"2023-12-01T23:18:34.778209+0000","last_clean":"2023-12-01T23:18:34.778209+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:18:34.778209+0000","last_undegraded":"2023-12-01T23:18:34.778209+0000","last_fullsized":"2023-12-01T23:18:34.778209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767988+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:18:34.767988+0000","last_peered":"2023-12-01T23:18:34.767988+0000","last_clean":"2023-12-01T23:18:34.767988+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:18:34.767988+0000","last_undegraded":"2023-12-01T23:18:34.767988+0000","last_fullsized":"2023-12-01T23:18:34.767988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245639+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:18:36.245639+0000","last_peered":"2023-12-01T23:18:36.245639+0000","last_clean":"2023-12-01T23:18:36.245639+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:18:36.245639+0000","last_undegraded":"2023-12-01T23:18:36.245639+0000","last_fullsized":"2023-12-01T23:18:36.245639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828158+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:18:34.828158+0000","last_peered":"2023-12-01T23:18:34.828158+0000","last_clean":"2023-12-01T23:18:34.828158+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:18:34.828158+0000","last_undegraded":"2023-12-01T23:18:34.828158+0000","last_fullsized":"2023-12-01T23:18:34.828158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786608+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:18:34.786608+0000","last_peered":"2023-12-01T23:18:34.786608+0000","last_clean":"2023-12-01T23:18:34.786608+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:18:34.786608+0000","last_undegraded":"2023-12-01T23:18:34.786608+0000","last_fullsized":"2023-12-01T23:18:34.786608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866572+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:18:35.866572+0000","last_peered":"2023-12-01T23:18:35.866572+0000","last_clean":"2023-12-01T23:18:35.866572+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:18:35.866572+0000","last_undegraded":"2023-12-01T23:18:35.866572+0000","last_fullsized":"2023-12-01T23:18:35.866572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786471+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:18:34.786471+0000","last_peered":"2023-12-01T23:18:34.786471+0000","last_clean":"2023-12-01T23:18:34.786471+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:18:34.786471+0000","last_undegraded":"2023-12-01T23:18:34.786471+0000","last_fullsized":"2023-12-01T23:18:34.786471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753827+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:18:34.753827+0000","last_peered":"2023-12-01T23:18:34.753827+0000","last_clean":"2023-12-01T23:18:34.753827+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:18:34.753827+0000","last_undegraded":"2023-12-01T23:18:34.753827+0000","last_fullsized":"2023-12-01T23:18:34.753827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866532+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:18:35.866532+0000","last_peered":"2023-12-01T23:18:35.866532+0000","last_clean":"2023-12-01T23:18:35.866532+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:18:35.866532+0000","last_undegraded":"2023-12-01T23:18:35.866532+0000","last_fullsized":"2023-12-01T23:18:35.866532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245667+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:18:36.245667+0000","last_peered":"2023-12-01T23:18:36.245667+0000","last_clean":"2023-12-01T23:18:36.245667+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:18:36.245667+0000","last_undegraded":"2023-12-01T23:18:36.245667+0000","last_fullsized":"2023-12-01T23:18:36.245667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767701+0000","last_change":"2023-12-01T23:18:28.821615+0000","last_active":"2023-12-01T23:18:34.767701+0000","last_peered":"2023-12-01T23:18:34.767701+0000","last_clean":"2023-12-01T23:18:34.767701+0000","last_became_active":"2023-12-01T23:18:28.821335+0000","last_became_peered":"2023-12-01T23:18:28.821335+0000","last_unstale":"2023-12-01T23:18:34.767701+0000","last_undegraded":"2023-12-01T23:18:34.767701+0000","last_fullsized":"2023-12-01T23:18:34.767701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787322+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:18:34.787322+0000","last_peered":"2023-12-01T23:18:34.787322+0000","last_clean":"2023-12-01T23:18:34.787322+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:18:34.787322+0000","last_undegraded":"2023-12-01T23:18:34.787322+0000","last_fullsized":"2023-12-01T23:18:34.787322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246556+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:18:36.246556+0000","last_peered":"2023-12-01T23:18:36.246556+0000","last_clean":"2023-12-01T23:18:36.246556+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:18:36.246556+0000","last_undegraded":"2023-12-01T23:18:36.246556+0000","last_fullsized":"2023-12-01T23:18:36.246556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784060+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:18:34.784060+0000","last_peered":"2023-12-01T23:18:34.784060+0000","last_clean":"2023-12-01T23:18:34.784060+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:18:34.784060+0000","last_undegraded":"2023-12-01T23:18:34.784060+0000","last_fullsized":"2023-12-01T23:18:34.784060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784195+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:18:34.784195+0000","last_peered":"2023-12-01T23:18:34.784195+0000","last_clean":"2023-12-01T23:18:34.784195+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:18:34.784195+0000","last_undegraded":"2023-12-01T23:18:34.784195+0000","last_fullsized":"2023-12-01T23:18:34.784195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753679+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:18:34.753679+0000","last_peered":"2023-12-01T23:18:34.753679+0000","last_clean":"2023-12-01T23:18:34.753679+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:18:34.753679+0000","last_undegraded":"2023-12-01T23:18:34.753679+0000","last_fullsized":"2023-12-01T23:18:34.753679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830120+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:18:34.830120+0000","last_peered":"2023-12-01T23:18:34.830120+0000","last_clean":"2023-12-01T23:18:34.830120+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:18:34.830120+0000","last_undegraded":"2023-12-01T23:18:34.830120+0000","last_fullsized":"2023-12-01T23:18:34.830120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245476+0000","last_change":"2023-12-01T23:18:34.837693+0000","last_active":"2023-12-01T23:18:36.245476+0000","last_peered":"2023-12-01T23:18:36.245476+0000","last_clean":"2023-12-01T23:18:36.245476+0000","last_became_active":"2023-12-01T23:18:34.837313+0000","last_became_peered":"2023-12-01T23:18:34.837313+0000","last_unstale":"2023-12-01T23:18:36.245476+0000","last_undegraded":"2023-12-01T23:18:36.245476+0000","last_fullsized":"2023-12-01T23:18:36.245476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:26.160117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784206+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:18:34.784206+0000","last_peered":"2023-12-01T23:18:34.784206+0000","last_clean":"2023-12-01T23:18:34.784206+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:18:34.784206+0000","last_undegraded":"2023-12-01T23:18:34.784206+0000","last_fullsized":"2023-12-01T23:18:34.784206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777604+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:18:34.777604+0000","last_peered":"2023-12-01T23:18:34.777604+0000","last_clean":"2023-12-01T23:18:34.777604+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:18:34.777604+0000","last_undegraded":"2023-12-01T23:18:34.777604+0000","last_fullsized":"2023-12-01T23:18:34.777604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867004+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:18:35.867004+0000","last_peered":"2023-12-01T23:18:35.867004+0000","last_clean":"2023-12-01T23:18:35.867004+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:18:35.867004+0000","last_undegraded":"2023-12-01T23:18:35.867004+0000","last_fullsized":"2023-12-01T23:18:35.867004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753650+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:18:34.753650+0000","last_peered":"2023-12-01T23:18:34.753650+0000","last_clean":"2023-12-01T23:18:34.753650+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:18:34.753650+0000","last_undegraded":"2023-12-01T23:18:34.753650+0000","last_fullsized":"2023-12-01T23:18:34.753650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830553+0000","last_change":"2023-12-01T23:18:28.878753+0000","last_active":"2023-12-01T23:18:34.830553+0000","last_peered":"2023-12-01T23:18:34.830553+0000","last_clean":"2023-12-01T23:18:34.830553+0000","last_became_active":"2023-12-01T23:18:28.878547+0000","last_became_peered":"2023-12-01T23:18:28.878547+0000","last_unstale":"2023-12-01T23:18:34.830553+0000","last_undegraded":"2023-12-01T23:18:34.830553+0000","last_fullsized":"2023-12-01T23:18:34.830553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786682+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:18:34.786682+0000","last_peered":"2023-12-01T23:18:34.786682+0000","last_clean":"2023-12-01T23:18:34.786682+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:18:34.786682+0000","last_undegraded":"2023-12-01T23:18:34.786682+0000","last_fullsized":"2023-12-01T23:18:34.786682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829191+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:18:34.829191+0000","last_peered":"2023-12-01T23:18:34.829191+0000","last_clean":"2023-12-01T23:18:34.829191+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:18:34.829191+0000","last_undegraded":"2023-12-01T23:18:34.829191+0000","last_fullsized":"2023-12-01T23:18:34.829191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784569+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:18:34.784569+0000","last_peered":"2023-12-01T23:18:34.784569+0000","last_clean":"2023-12-01T23:18:34.784569+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:18:34.784569+0000","last_undegraded":"2023-12-01T23:18:34.784569+0000","last_fullsized":"2023-12-01T23:18:34.784569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767962+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:18:34.767962+0000","last_peered":"2023-12-01T23:18:34.767962+0000","last_clean":"2023-12-01T23:18:34.767962+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:18:34.767962+0000","last_undegraded":"2023-12-01T23:18:34.767962+0000","last_fullsized":"2023-12-01T23:18:34.767962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753917+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:18:34.753917+0000","last_peered":"2023-12-01T23:18:34.753917+0000","last_clean":"2023-12-01T23:18:34.753917+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:18:34.753917+0000","last_undegraded":"2023-12-01T23:18:34.753917+0000","last_fullsized":"2023-12-01T23:18:34.753917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784917+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:18:34.784917+0000","last_peered":"2023-12-01T23:18:34.784917+0000","last_clean":"2023-12-01T23:18:34.784917+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:18:34.784917+0000","last_undegraded":"2023-12-01T23:18:34.784917+0000","last_fullsized":"2023-12-01T23:18:34.784917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787245+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:18:34.787245+0000","last_peered":"2023-12-01T23:18:34.787245+0000","last_clean":"2023-12-01T23:18:34.787245+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:18:34.787245+0000","last_undegraded":"2023-12-01T23:18:34.787245+0000","last_fullsized":"2023-12-01T23:18:34.787245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784036+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:18:34.784036+0000","last_peered":"2023-12-01T23:18:34.784036+0000","last_clean":"2023-12-01T23:18:34.784036+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:18:34.784036+0000","last_undegraded":"2023-12-01T23:18:34.784036+0000","last_fullsized":"2023-12-01T23:18:34.784036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786612+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:18:34.786612+0000","last_peered":"2023-12-01T23:18:34.786612+0000","last_clean":"2023-12-01T23:18:34.786612+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:18:34.786612+0000","last_undegraded":"2023-12-01T23:18:34.786612+0000","last_fullsized":"2023-12-01T23:18:34.786612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828033+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:18:34.828033+0000","last_peered":"2023-12-01T23:18:34.828033+0000","last_clean":"2023-12-01T23:18:34.828033+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:18:34.828033+0000","last_undegraded":"2023-12-01T23:18:34.828033+0000","last_fullsized":"2023-12-01T23:18:34.828033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753755+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:18:34.753755+0000","last_peered":"2023-12-01T23:18:34.753755+0000","last_clean":"2023-12-01T23:18:34.753755+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:18:34.753755+0000","last_undegraded":"2023-12-01T23:18:34.753755+0000","last_fullsized":"2023-12-01T23:18:34.753755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759182+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:18:34.759182+0000","last_peered":"2023-12-01T23:18:34.759182+0000","last_clean":"2023-12-01T23:18:34.759182+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:18:34.759182+0000","last_undegraded":"2023-12-01T23:18:34.759182+0000","last_fullsized":"2023-12-01T23:18:34.759182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830476+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:18:34.830476+0000","last_peered":"2023-12-01T23:18:34.830476+0000","last_clean":"2023-12-01T23:18:34.830476+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:18:34.830476+0000","last_undegraded":"2023-12-01T23:18:34.830476+0000","last_fullsized":"2023-12-01T23:18:34.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786114+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:18:34.786114+0000","last_peered":"2023-12-01T23:18:34.786114+0000","last_clean":"2023-12-01T23:18:34.786114+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:18:34.786114+0000","last_undegraded":"2023-12-01T23:18:34.786114+0000","last_fullsized":"2023-12-01T23:18:34.786114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787165+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:18:34.787165+0000","last_peered":"2023-12-01T23:18:34.787165+0000","last_clean":"2023-12-01T23:18:34.787165+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:18:34.787165+0000","last_undegraded":"2023-12-01T23:18:34.787165+0000","last_fullsized":"2023-12-01T23:18:34.787165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767905+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:18:34.767905+0000","last_peered":"2023-12-01T23:18:34.767905+0000","last_clean":"2023-12-01T23:18:34.767905+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:18:34.767905+0000","last_undegraded":"2023-12-01T23:18:34.767905+0000","last_fullsized":"2023-12-01T23:18:34.767905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828817+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:18:34.828817+0000","last_peered":"2023-12-01T23:18:34.828817+0000","last_clean":"2023-12-01T23:18:34.828817+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:18:34.828817+0000","last_undegraded":"2023-12-01T23:18:34.828817+0000","last_fullsized":"2023-12-01T23:18:34.828817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784004+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:18:34.784004+0000","last_peered":"2023-12-01T23:18:34.784004+0000","last_clean":"2023-12-01T23:18:34.784004+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:18:34.784004+0000","last_undegraded":"2023-12-01T23:18:34.784004+0000","last_fullsized":"2023-12-01T23:18:34.784004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778132+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:18:34.778132+0000","last_peered":"2023-12-01T23:18:34.778132+0000","last_clean":"2023-12-01T23:18:34.778132+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:18:34.778132+0000","last_undegraded":"2023-12-01T23:18:34.778132+0000","last_fullsized":"2023-12-01T23:18:34.778132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753984+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:18:34.753984+0000","last_peered":"2023-12-01T23:18:34.753984+0000","last_clean":"2023-12-01T23:18:34.753984+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:18:34.753984+0000","last_undegraded":"2023-12-01T23:18:34.753984+0000","last_fullsized":"2023-12-01T23:18:34.753984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753831+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:18:34.753831+0000","last_peered":"2023-12-01T23:18:34.753831+0000","last_clean":"2023-12-01T23:18:34.753831+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:18:34.753831+0000","last_undegraded":"2023-12-01T23:18:34.753831+0000","last_fullsized":"2023-12-01T23:18:34.753831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759179+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:18:34.759179+0000","last_peered":"2023-12-01T23:18:34.759179+0000","last_clean":"2023-12-01T23:18:34.759179+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:18:34.759179+0000","last_undegraded":"2023-12-01T23:18:34.759179+0000","last_fullsized":"2023-12-01T23:18:34.759179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783732+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:18:34.783732+0000","last_peered":"2023-12-01T23:18:34.783732+0000","last_clean":"2023-12-01T23:18:34.783732+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:18:34.783732+0000","last_undegraded":"2023-12-01T23:18:34.783732+0000","last_fullsized":"2023-12-01T23:18:34.783732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758745+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:18:34.758745+0000","last_peered":"2023-12-01T23:18:34.758745+0000","last_clean":"2023-12-01T23:18:34.758745+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:18:34.758745+0000","last_undegraded":"2023-12-01T23:18:34.758745+0000","last_fullsized":"2023-12-01T23:18:34.758745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786541+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:18:34.786541+0000","last_peered":"2023-12-01T23:18:34.786541+0000","last_clean":"2023-12-01T23:18:34.786541+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:18:34.786541+0000","last_undegraded":"2023-12-01T23:18:34.786541+0000","last_fullsized":"2023-12-01T23:18:34.786541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758959+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:18:34.758959+0000","last_peered":"2023-12-01T23:18:34.758959+0000","last_clean":"2023-12-01T23:18:34.758959+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:18:34.758959+0000","last_undegraded":"2023-12-01T23:18:34.758959+0000","last_fullsized":"2023-12-01T23:18:34.758959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785803+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.785803+0000","last_peered":"2023-12-01T23:18:34.785803+0000","last_clean":"2023-12-01T23:18:34.785803+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:18:34.785803+0000","last_undegraded":"2023-12-01T23:18:34.785803+0000","last_fullsized":"2023-12-01T23:18:34.785803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827512+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:18:34.827512+0000","last_peered":"2023-12-01T23:18:34.827512+0000","last_clean":"2023-12-01T23:18:34.827512+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:18:34.827512+0000","last_undegraded":"2023-12-01T23:18:34.827512+0000","last_fullsized":"2023-12-01T23:18:34.827512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767682+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:18:34.767682+0000","last_peered":"2023-12-01T23:18:34.767682+0000","last_clean":"2023-12-01T23:18:34.767682+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:18:34.767682+0000","last_undegraded":"2023-12-01T23:18:34.767682+0000","last_fullsized":"2023-12-01T23:18:34.767682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759106+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:18:34.759106+0000","last_peered":"2023-12-01T23:18:34.759106+0000","last_clean":"2023-12-01T23:18:34.759106+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:18:34.759106+0000","last_undegraded":"2023-12-01T23:18:34.759106+0000","last_fullsized":"2023-12-01T23:18:34.759106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":703555,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]}]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703611,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":112731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":112605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:19:00.788 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-01T23:19:00.789 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-01T23:19:00.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-01T23:19:00.789 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-01T23:19:00.789 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-01T23:19:00.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.927+0000 7fe4c74a6640 1 Processor -- start 2023-12-01T23:19:00.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.927+0000 7fe4c74a6640 1 -- start start 2023-12-01T23:19:00.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.928+0000 7fe4c74a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 0x7fe4c00cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.928+0000 7fe4c74a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4c00c7700 0x7fe4c00c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.928+0000 7fe4c74a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c006f870 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.928+0000 7fe4c74a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c0159600 con 0x7fe4c00c7700 2023-12-01T23:19:00.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.928+0000 7fe4c74a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c015cd90 con 0x7fe4c01537e0 2023-12-01T23:19:00.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.929+0000 7fe4c5a43640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fe4c00ca0c0 0x7fe4c0159a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54012/0 (socket says 172.21.15.96:54012) 2023-12-01T23:19:00.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.929+0000 7fe4c5242640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 0x7fe4c00cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.929+0000 7fe4c5a43640 1 -- 172.21.15.96:0/2128693691 learned_addr learned my addr 172.21.15.96:0/2128693691 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:00.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.929+0000 7fe4c4a41640 1 --2- 172.21.15.96:0/2128693691 >> v2:172.21.15.102:3300/0 conn(0x7fe4c00c7700 0x7fe4c00c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.931+0000 7fe4c5242640 1 -- 172.21.15.96:0/2128693691 >> v2:172.21.15.102:3300/0 conn(0x7fe4c00c7700 msgr2=0x7fe4c00c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:00.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.931+0000 7fe4c5242640 1 --2- 172.21.15.96:0/2128693691 >> v2:172.21.15.102:3300/0 conn(0x7fe4c00c7700 0x7fe4c00c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.931+0000 7fe4c5242640 1 -- 172.21.15.96:0/2128693691 >> v1:172.21.15.96:6789/0 conn(0x7fe4c00ca0c0 legacy=0x7fe4c0159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.931+0000 7fe4c5242640 1 -- 172.21.15.96:0/2128693691 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c015d070 con 0x7fe4c01537e0 2023-12-01T23:19:00.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.933+0000 7fe4c5242640 1 --2- 172.21.15.96:0/2128693691 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 0x7fe4c00cd6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d90 tx=0x7fe4bc02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ada3cfbf098e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:00.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4b7fff640 1 -- 172.21.15.96:0/2128693691 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc02cce0 con 0x7fe4c01537e0 2023-12-01T23:19:00.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4b7fff640 1 -- 172.21.15.96:0/2128693691 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc02ce40 con 0x7fe4c01537e0 2023-12-01T23:19:00.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4b7fff640 1 -- 172.21.15.96:0/2128693691 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc034660 con 0x7fe4c01537e0 2023-12-01T23:19:00.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 -- 172.21.15.96:0/2128693691 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 msgr2=0x7fe4c00cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/2128693691 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 0x7fe4c00cd6a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009d90 tx=0x7fe4bc02bf30 comp rx=0 tx=0).stop 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 -- 172.21.15.96:0/2128693691 shutdown_connections 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/2128693691 >> v2:172.21.15.102:3300/0 conn(0x7fe4c00c7700 0x7fe4c00c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/2128693691 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c01537e0 0x7fe4c00cd6a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 -- 172.21.15.96:0/2128693691 >> 172.21.15.96:0/2128693691 conn(0x7fe4c0061100 msgr2=0x7fe4c00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 -- 172.21.15.96:0/2128693691 shutdown_connections 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.937+0000 7fe4c74a6640 1 -- 172.21.15.96:0/2128693691 wait complete. 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.938+0000 7fe4c74a6640 1 Processor -- start 2023-12-01T23:19:00.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 -- start start 2023-12-01T23:19:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c00c7700 0x7fe4c00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c01537e0 0x7fe4c00cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00cab00 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00cade0 con 0x7fe4c01537e0 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.939+0000 7fe4c74a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c015b770 con 0x7fe4c00c7700 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.940+0000 7fe4c4a41640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.940+0000 7fe4c5a43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c01537e0 0x7fe4c00cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.940+0000 7fe4c5242640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c00c7700 0x7fe4c00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.940+0000 7fe4c4a41640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36206/0 (socket says 172.21.15.96:36206) 2023-12-01T23:19:00.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.940+0000 7fe4c4a41640 1 -- 172.21.15.96:0/1570624139 learned_addr learned my addr 172.21.15.96:0/1570624139 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.943+0000 7fe4c4a41640 1 -- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c00c7700 msgr2=0x7fe4c00cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.943+0000 7fe4c4a41640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c00c7700 0x7fe4c00cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.943+0000 7fe4c4a41640 1 -- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c01537e0 msgr2=0x7fe4c00cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:00.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.943+0000 7fe4c4a41640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c01537e0 0x7fe4c00cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:00.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.943+0000 7fe4c4a41640 1 -- 172.21.15.96:0/1570624139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009a70 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.945+0000 7fe4c4a41640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e8a0 tx=0x7fe4b000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:00.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.949+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00094f0 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.949+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b000c940 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.949+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c015ba50 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.949+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000ccf0 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.949+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c014e860 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.950+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c0071a70 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.969+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4b0013470 con 0x7fe4c00ca0c0 2023-12-01T23:19:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.970+0000 7fe4b5ffb640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 0x7fe4a406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.970+0000 7fe4c5242640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 0x7fe4a406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:00.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:00.970+0000 7fe4c5242640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 0x7fe4a406d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc036000 tx=0x7fe4bc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:01.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.203+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe4b0058ca0 con 0x7fe4c00ca0c0 2023-12-01T23:19:01.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.203+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4b0054fe0 con 0x7fe4c00ca0c0 2023-12-01T23:19:01.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.413+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe4c0067500 con 0x7fe4c00ca0c0 2023-12-01T23:19:01.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.549+0000 7fe4b5ffb640 1 -- 172.21.15.96:0/1570624139 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7fe4b0021020 con 0x7fe4c00ca0c0 2023-12-01T23:19:01.553 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 msgr2=0x7fe4a406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 0x7fe4a406d350 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc036000 tx=0x7fe4bc030000 comp rx=0 tx=0).stop 2023-12-01T23:19:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 msgr2=0x7fe4c00cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e8a0 tx=0x7fe4b000ed60 comp rx=0 tx=0).stop 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 shutdown_connections 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe4a406ae90 0x7fe4a406d350 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c01537e0 0x7fe4c00cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4c00ca0c0 0x7fe4c00cb270 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 --2- 172.21.15.96:0/1570624139 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c00c7700 0x7fe4c00cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 >> 172.21.15.96:0/1570624139 conn(0x7fe4c0061100 msgr2=0x7fe4c00c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 shutdown_connections 2023-12-01T23:19:01.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.552+0000 7fe4c74a6640 1 -- 172.21.15.96:0/1570624139 wait complete. 2023-12-01T23:19:01.563 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3997971778},{"type":"v1","addr":"172.21.15.96:6801","nonce":3997971778}]},"active_addr":"172.21.15.96:6801/3997971778","active_change":"2023-12-01T23:18:03.594335+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3025139780}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1816853695}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":699721866}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":261086666}]}]} 2023-12-01T23:19:01.567 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-01T23:19:01.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-01T23:19:01.567 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:19:01.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.665+0000 7f4df6bd7640 1 Processor -- start 2023-12-01T23:19:01.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.665+0000 7f4df6bd7640 1 -- start start 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4df6bd7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4df0153be0 0x7f4df0159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4df6bd7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4df006fa00 0x7f4df00c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4df6bd7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df0153fc0 con 0x7f4df00c5e60 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4df6bd7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00c3340 con 0x7f4df006fa00 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4df6bd7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df006b7b0 con 0x7f4df0153be0 2023-12-01T23:19:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.666+0000 7f4deffff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4df006fa00 0x7f4df00c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.667+0000 7f4df4973640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4df0153be0 0x7f4df0159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.667+0000 7f4df4973640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4df0153be0 0x7f4df0159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50126/0 (socket says 172.21.15.96:50126) 2023-12-01T23:19:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.667+0000 7f4df4973640 1 -- 172.21.15.96:0/196654767 learned_addr learned my addr 172.21.15.96:0/196654767 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:01.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.669+0000 7f4df4973640 1 -- 172.21.15.96:0/196654767 >> v2:172.21.15.96:3300/0 conn(0x7f4df006fa00 msgr2=0x7f4df00c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:01.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.669+0000 7f4df4973640 1 --2- 172.21.15.96:0/196654767 >> v2:172.21.15.96:3300/0 conn(0x7f4df006fa00 0x7f4df00c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.669+0000 7f4df4973640 1 -- 172.21.15.96:0/196654767 >> v1:172.21.15.96:6789/0 conn(0x7f4df00c5e60 legacy=0x7f4df006a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.669+0000 7f4df4973640 1 -- 172.21.15.96:0/196654767 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df006ba90 con 0x7f4df0153be0 2023-12-01T23:19:01.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.671+0000 7f4df4973640 1 --2- 172.21.15.96:0/196654767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df0153be0 0x7f4df0159890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4df00610b0 tx=0x7f4de402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=933909ce3e83e3c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:01.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.675+0000 7f4def7fe640 1 -- 172.21.15.96:0/196654767 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4030860 con 0x7f4df0153be0 2023-12-01T23:19:01.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.675+0000 7f4def7fe640 1 -- 172.21.15.96:0/196654767 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40309c0 con 0x7f4df0153be0 2023-12-01T23:19:01.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.675+0000 7f4def7fe640 1 -- 172.21.15.96:0/196654767 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4030d50 con 0x7f4df0153be0 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 -- 172.21.15.96:0/196654767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df0153be0 msgr2=0x7f4df0159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/196654767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df0153be0 0x7f4df0159890 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4df00610b0 tx=0x7f4de402b9a0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 -- 172.21.15.96:0/196654767 shutdown_connections 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/196654767 >> v2:172.21.15.96:3300/0 conn(0x7f4df006fa00 0x7f4df00c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/196654767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df0153be0 0x7f4df0159890 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 -- 172.21.15.96:0/196654767 >> 172.21.15.96:0/196654767 conn(0x7f4df00c7f60 msgr2=0x7f4df00c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 -- 172.21.15.96:0/196654767 shutdown_connections 2023-12-01T23:19:01.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.676+0000 7f4df6bd7640 1 -- 172.21.15.96:0/196654767 wait complete. 2023-12-01T23:19:01.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.677+0000 7f4df6bd7640 1 Processor -- start 2023-12-01T23:19:01.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.677+0000 7f4df6bd7640 1 -- start start 2023-12-01T23:19:01.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df00c5e60 0x7f4df0157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4df0153be0 0x7f4df014e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df014fb10 con 0x7f4df006fa00 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0147460 con 0x7f4df00c5e60 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df6bd7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0147fe0 con 0x7f4df0153be0 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.678+0000 7f4df4973640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.679+0000 7f4df5174640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4df0153be0 0x7f4df014e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.679+0000 7f4df4973640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36222/0 (socket says 172.21.15.96:36222) 2023-12-01T23:19:01.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.679+0000 7f4df4973640 1 -- 172.21.15.96:0/2199390415 learned_addr learned my addr 172.21.15.96:0/2199390415 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:01.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.679+0000 7f4deffff640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df00c5e60 0x7f4df0157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.682+0000 7f4df4973640 1 -- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4df0153be0 msgr2=0x7f4df014e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.682+0000 7f4df4973640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4df0153be0 0x7f4df014e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.682+0000 7f4df4973640 1 -- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df00c5e60 msgr2=0x7f4df0157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:01.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.682+0000 7f4df4973640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df00c5e60 0x7f4df0157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:01.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.682+0000 7f4df4973640 1 -- 172.21.15.96:0/2199390415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40094d0 con 0x7f4df006fa00 2023-12-01T23:19:01.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.684+0000 7f4df4973640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4de4000c00 tx=0x7f4de4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.688+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4039a90 con 0x7f4df006fa00 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.688+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4039bf0 con 0x7f4df006fa00 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.688+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df0150630 con 0x7f4df006fa00 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.688+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4043410 con 0x7f4df006fa00 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.688+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df0147990 con 0x7f4df006fa00 2023-12-01T23:19:01.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.689+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df0067500 con 0x7f4df006fa00 2023-12-01T23:19:01.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.930+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4de404c3b0 con 0x7f4df006fa00 2023-12-01T23:19:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.930+0000 7f4ded7fa640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 0x7f4dd406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.930+0000 7f4deffff640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 0x7f4dd406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.931+0000 7f4deffff640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 0x7f4dd406d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4df01f0590 tx=0x7f4ddc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:01.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.946+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4de407a870 con 0x7f4df006fa00 2023-12-01T23:19:01.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:01.946+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4de4076bb0 con 0x7f4df006fa00 2023-12-01T23:19:02.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.128+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df006f7e0 con 0x7f4df006fa00 2023-12-01T23:19:02.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.166+0000 7f4ded7fa640 1 -- 172.21.15.96:0/2199390415 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f4de4048020 con 0x7f4df006fa00 2023-12-01T23:19:02.170 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:02.170 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 msgr2=0x7f4dd406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 0x7f4dd406d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4df01f0590 tx=0x7f4ddc009190 comp rx=0 tx=0).stop 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 msgr2=0x7f4df014fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4de4000c00 tx=0x7f4de4004730 comp rx=0 tx=0).stop 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 shutdown_connections 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4dd406ae40 0x7f4dd406d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4df0153be0 0x7f4df014e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df00c5e60 0x7f4df0157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 --2- 172.21.15.96:0/2199390415 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4df006fa00 0x7f4df014fdd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 >> 172.21.15.96:0/2199390415 conn(0x7f4df00c7f60 msgr2=0x7f4df0151640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 shutdown_connections 2023-12-01T23:19:02.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.169+0000 7f4df6bd7640 1 -- 172.21.15.96:0/2199390415 wait complete. 2023-12-01T23:19:02.181 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-01T23:19:02.182 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:19:02.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.282+0000 7fe4691be640 1 Processor -- start 2023-12-01T23:19:02.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.282+0000 7fe4691be640 1 -- start start 2023-12-01T23:19:02.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.283+0000 7fe4691be640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.283+0000 7fe4691be640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4640ceef0 0x7fe4640cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.283+0000 7fe4691be640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46415a700 con 0x7fe464153890 2023-12-01T23:19:02.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.283+0000 7fe4691be640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640ca870 con 0x7fe4640ceef0 2023-12-01T23:19:02.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.283+0000 7fe4691be640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe464159af0 con 0x7fe464153c70 2023-12-01T23:19:02.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.284+0000 7fe46359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4640ceef0 0x7fe4640cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.284+0000 7fe46259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.284+0000 7fe46259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55674/0 (socket says 172.21.15.96:55674) 2023-12-01T23:19:02.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.284+0000 7fe46259c640 1 -- 172.21.15.96:0/2456508148 learned_addr learned my addr 172.21.15.96:0/2456508148 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.287+0000 7fe46259c640 1 -- 172.21.15.96:0/2456508148 >> v2:172.21.15.102:3300/0 conn(0x7fe4640ceef0 msgr2=0x7fe4640cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.287+0000 7fe46259c640 1 --2- 172.21.15.96:0/2456508148 >> v2:172.21.15.102:3300/0 conn(0x7fe4640ceef0 0x7fe4640cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.287+0000 7fe46259c640 1 -- 172.21.15.96:0/2456508148 >> v1:172.21.15.102:6789/0 conn(0x7fe464153890 legacy=0x7fe4640c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.287+0000 7fe46259c640 1 -- 172.21.15.96:0/2456508148 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464159dd0 con 0x7fe464153c70 2023-12-01T23:19:02.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.289+0000 7fe46259c640 1 --2- 172.21.15.96:0/2456508148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe458009870 tx=0x7fe45802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81848a9ec3417db6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.292+0000 7fe461d9b640 1 -- 172.21.15.96:0/2456508148 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45802f840 con 0x7fe464153c70 2023-12-01T23:19:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.292+0000 7fe461d9b640 1 -- 172.21.15.96:0/2456508148 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45802f9a0 con 0x7fe464153c70 2023-12-01T23:19:02.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.292+0000 7fe461d9b640 1 -- 172.21.15.96:0/2456508148 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45802fd30 con 0x7fe464153c70 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 -- 172.21.15.96:0/2456508148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 msgr2=0x7fe46415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 --2- 172.21.15.96:0/2456508148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe458009870 tx=0x7fe45802ba20 comp rx=0 tx=0).stop 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 -- 172.21.15.96:0/2456508148 shutdown_connections 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 --2- 172.21.15.96:0/2456508148 >> v2:172.21.15.102:3300/0 conn(0x7fe4640ceef0 0x7fe4640cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 --2- 172.21.15.96:0/2456508148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe46415d950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 -- 172.21.15.96:0/2456508148 >> 172.21.15.96:0/2456508148 conn(0x7fe46406ba00 msgr2=0x7fe46406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:02.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 -- 172.21.15.96:0/2456508148 shutdown_connections 2023-12-01T23:19:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.293+0000 7fe4691be640 1 -- 172.21.15.96:0/2456508148 wait complete. 2023-12-01T23:19:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.294+0000 7fe4691be640 1 Processor -- start 2023-12-01T23:19:02.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 -- start start 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe464153890 0x7fe464147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe4641efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641f3b90 con 0x7fe4640ceef0 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641ef680 con 0x7fe464153890 2023-12-01T23:19:02.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.295+0000 7fe4691be640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4641f3010 con 0x7fe464153c70 2023-12-01T23:19:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.296+0000 7fe462d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.296+0000 7fe46259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe464153890 0x7fe464147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.296+0000 7fe46359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe4641efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.296+0000 7fe462d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36234/0 (socket says 172.21.15.96:36234) 2023-12-01T23:19:02.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.296+0000 7fe462d9d640 1 -- 172.21.15.96:0/714265573 learned_addr learned my addr 172.21.15.96:0/714265573 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.299+0000 7fe462d9d640 1 -- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 msgr2=0x7fe4641efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.299+0000 7fe462d9d640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe4641efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.299+0000 7fe462d9d640 1 -- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe464153890 msgr2=0x7fe464147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.299+0000 7fe462d9d640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe464153890 0x7fe464147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.299+0000 7fe462d9d640 1 -- 172.21.15.96:0/714265573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580094d0 con 0x7fe4640ceef0 2023-12-01T23:19:02.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.302+0000 7fe462d9d640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe45400c790 tx=0x7fe45400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.306+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45400cea0 con 0x7fe4640ceef0 2023-12-01T23:19:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.306+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe454006d50 con 0x7fe4640ceef0 2023-12-01T23:19:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.306+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4641f32f0 con 0x7fe4640ceef0 2023-12-01T23:19:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.306+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe454003bb0 con 0x7fe4640ceef0 2023-12-01T23:19:02.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.306+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4641f38b0 con 0x7fe4640ceef0 2023-12-01T23:19:02.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.307+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe464067500 con 0x7fe4640ceef0 2023-12-01T23:19:02.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.547+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe454003d10 con 0x7fe4640ceef0 2023-12-01T23:19:02.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.547+0000 7fe44b7fe640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 0x7fe45006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.547+0000 7fe46259c640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 0x7fe45006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.548+0000 7fe46259c640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 0x7fe45006d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe458036000 tx=0x7fe458008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.561+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe454058d60 con 0x7fe4640ceef0 2023-12-01T23:19:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.561+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe454058b30 con 0x7fe4640ceef0 2023-12-01T23:19:02.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.728+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4640cb6d0 con 0x7fe4640ceef0 2023-12-01T23:19:02.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.764+0000 7fe44b7fe640 1 -- 172.21.15.96:0/714265573 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fe4540586c0 con 0x7fe4640ceef0 2023-12-01T23:19:02.765 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:02.765 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:18:35.488763+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:19:02.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 msgr2=0x7fe45006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 0x7fe45006d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe458036000 tx=0x7fe458008030 comp rx=0 tx=0).stop 2023-12-01T23:19:02.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 msgr2=0x7fe4640b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe45400c790 tx=0x7fe45400cc50 comp rx=0 tx=0).stop 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 shutdown_connections 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe45006ae90 0x7fe45006d350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe464153c70 0x7fe4641efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe464153890 0x7fe464147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 --2- 172.21.15.96:0/714265573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4640ceef0 0x7fe4640b3a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 >> 172.21.15.96:0/714265573 conn(0x7fe46406ba00 msgr2=0x7fe46415d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 shutdown_connections 2023-12-01T23:19:02.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.766+0000 7fe4691be640 1 -- 172.21.15.96:0/714265573 wait complete. 2023-12-01T23:19:02.779 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-01T23:19:02.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-01T23:19:02.780 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-01T23:19:02.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-01T23:19:02.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-01T23:19:02.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-01T23:19:02.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-01T23:19:02.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-01T23:19:02.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.952+0000 7f9ab54ef640 1 Processor -- start 2023-12-01T23:19:02.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.953+0000 7f9ab54ef640 1 -- start start 2023-12-01T23:19:02.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.953+0000 7fcfe9b9e640 1 Processor -- start 2023-12-01T23:19:02.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7fcfe9b9e640 1 -- start start 2023-12-01T23:19:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f3d9d0bb640 1 Processor -- start 2023-12-01T23:19:02.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f3d9d0bb640 1 -- start start 2023-12-01T23:19:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f9ab54ef640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ab015e4f0 0x7f9ab00c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f9ab54ef640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9ab00c8160 0x7f9ab015f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f9ab54ef640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00c90f0 con 0x7f9ab00c6050 2023-12-01T23:19:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f9ab54ef640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab00c8e80 con 0x7f9ab00c8160 2023-12-01T23:19:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f9ab54ef640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab00cd590 con 0x7f9ab015e4f0 2023-12-01T23:19:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f7abec9b640 1 Processor -- start 2023-12-01T23:19:02.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f7abec9b640 1 -- start start 2023-12-01T23:19:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f036537c640 1 Processor -- start 2023-12-01T23:19:02.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.954+0000 7f036537c640 1 -- start start 2023-12-01T23:19:02.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fe0c953c640 1 Processor -- start 2023-12-01T23:19:02.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fe0c953c640 1 -- start start 2023-12-01T23:19:02.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fcfe9b9e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcfe40c4210 0x7fcfe4153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fcfe9b9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcfe40c4810 0x7fcfe40c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fcfe9b9e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe406bba0 con 0x7fcfe4153640 2023-12-01T23:19:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fcfe9b9e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe406be60 con 0x7fcfe40c4210 2023-12-01T23:19:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7fcfe9b9e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe406c140 con 0x7fcfe40c4810 2023-12-01T23:19:02.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7efe5a671640 1 Processor -- start 2023-12-01T23:19:02.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7efe5a671640 1 -- start start 2023-12-01T23:19:02.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f3d9d0bb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d90006f00 0x7f3d900e3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f7abec9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7ab00e65f0 0x7f7ab004f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f7abec9b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab00506b0 con 0x7f7ab00387c0 2023-12-01T23:19:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f7abec9b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab0006c70 con 0x7f7ab0038c00 2023-12-01T23:19:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f7abec9b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab0006f50 con 0x7f7ab00e65f0 2023-12-01T23:19:02.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f3d9d0bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.955+0000 7f036537c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f9aaffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ab015e4f0 0x7f9ab00c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f3d9d0bb640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9004bcb0 con 0x7f3d900e68f0 2023-12-01T23:19:02.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f036537c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03600c6bb0 0x7f0360071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f9aaffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ab015e4f0 0x7f9ab00c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50170/0 (socket says 172.21.15.96:50170) 2023-12-01T23:19:02.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f9aaffff640 1 -- 172.21.15.96:0/710687515 learned_addr learned my addr 172.21.15.96:0/710687515 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f036537c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036015df50 con 0x7f03600c67d0 2023-12-01T23:19:02.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f036537c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600c1480 con 0x7f03600c6bb0 2023-12-01T23:19:02.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f036537c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03600c1720 con 0x7f03600c1dd0 2023-12-01T23:19:02.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f3d9d0bb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9004caf0 con 0x7f3d90006f00 2023-12-01T23:19:02.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f3d9d0bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9004b980 con 0x7f3d9004c140 2023-12-01T23:19:02.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fcfe2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcfe40c4210 0x7fcfe4153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7efe5a671640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7efe5a671640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7efe4c0464e0 0x7efe4c046970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fcfe2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fcfe40c4210 0x7fcfe4153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36250/0 (socket says 172.21.15.96:36250) 2023-12-01T23:19:02.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fcfe2ffd640 1 -- 172.21.15.96:0/3096585401 learned_addr learned my addr 172.21.15.96:0/3096585401 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fe0c953c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0c40cb0a0 0x7fe0c4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7efe5a671640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c0e4020 con 0x7efe4c0dd4a0 2023-12-01T23:19:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7efe5a671640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c046eb0 con 0x7efe4c0464e0 2023-12-01T23:19:02.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7efe5a671640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0dd880 con 0x7efe4c04be70 2023-12-01T23:19:02.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fe0c953c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb480 0x7fe0c40c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7f3d9c8ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fe0c953c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40c0af0 con 0x7fe0c4071280 2023-12-01T23:19:02.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fe0c953c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c406f8a0 con 0x7fe0c40cb0a0 2023-12-01T23:19:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.956+0000 7fe0c953c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40c5cf0 con 0x7fe0c40cb480 2023-12-01T23:19:02.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.957+0000 7f9ab4cee640 1 --2- 172.21.15.96:0/710687515 >> v2:172.21.15.96:3300/0 conn(0x7f9ab00c8160 0x7f9ab015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.957+0000 7f3d97fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3d90006f00 0x7f3d900e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.957+0000 7f3d9c8ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55690/0 (socket says 172.21.15.96:55690) 2023-12-01T23:19:02.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.957+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/2476893185 learned_addr learned my addr 172.21.15.96:0/2476893185 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.957+0000 7efe58e6e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.958+0000 7f3f09ca3640 1 Processor -- start 2023-12-01T23:19:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.958+0000 7f3f09ca3640 1 -- start start 2023-12-01T23:19:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.958+0000 7f035e7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7efe58e6e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55720/0 (socket says 172.21.15.96:55720) 2023-12-01T23:19:02.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7efe58e6e640 1 -- 172.21.15.96:0/3804155205 learned_addr learned my addr 172.21.15.96:0/3804155205 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7f3f09ca3640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3f041503d0 0x7f3f04156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7f3f09ca3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c4df0 0x7f3f040c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7f3f09ca3640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f040615e0 con 0x7f3f040c61c0 2023-12-01T23:19:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7f3f09ca3640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0415a5c0 con 0x7f3f041503d0 2023-12-01T23:19:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.959+0000 7f3f09ca3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04157070 con 0x7f3f040c4df0 2023-12-01T23:19:02.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7f9aaffff640 1 -- 172.21.15.96:0/710687515 >> v2:172.21.15.96:3300/0 conn(0x7f9ab00c8160 msgr2=0x7f9ab015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7f9aaffff640 1 --2- 172.21.15.96:0/710687515 >> v2:172.21.15.96:3300/0 conn(0x7f9ab00c8160 0x7f9ab015f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7f9aaffff640 1 -- 172.21.15.96:0/710687515 >> v1:172.21.15.96:6789/0 conn(0x7f9ab00c6050 legacy=0x7f9ab00c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7f9aaffff640 1 -- 172.21.15.96:0/710687515 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00cd870 con 0x7f9ab015e4f0 2023-12-01T23:19:02.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7fcfe2ffd640 1 -- 172.21.15.96:0/3096585401 >> v2:172.21.15.102:3300/0 conn(0x7fcfe40c4810 msgr2=0x7fcfe40c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7fcfe2ffd640 1 --2- 172.21.15.96:0/3096585401 >> v2:172.21.15.102:3300/0 conn(0x7fcfe40c4810 0x7fcfe40c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7fcfe2ffd640 1 -- 172.21.15.96:0/3096585401 >> v1:172.21.15.96:6789/0 conn(0x7fcfe4153640 legacy=0x7fcfe415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.960+0000 7fcfe2ffd640 1 -- 172.21.15.96:0/3096585401 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe406c420 con 0x7fcfe40c4210 2023-12-01T23:19:02.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/2476893185 >> v2:172.21.15.102:3300/0 conn(0x7f3d90006f00 msgr2=0x7f3d900e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f3d9c8ba640 1 --2- 172.21.15.96:0/2476893185 >> v2:172.21.15.102:3300/0 conn(0x7f3d90006f00 0x7f3d900e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/2476893185 >> v1:172.21.15.96:6789/0 conn(0x7f3d900e68f0 legacy=0x7f3d900072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/2476893185 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900079f0 con 0x7f3d9004c140 2023-12-01T23:19:02.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f035e7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55706/0 (socket says 172.21.15.96:55706) 2023-12-01T23:19:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.961+0000 7f035e7fc640 1 -- 172.21.15.96:0/3852797384 learned_addr learned my addr 172.21.15.96:0/3852797384 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f035e7fc640 1 -- 172.21.15.96:0/3852797384 >> v2:172.21.15.102:3300/0 conn(0x7f03600c6bb0 msgr2=0x7f0360071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f035e7fc640 1 --2- 172.21.15.96:0/3852797384 >> v2:172.21.15.102:3300/0 conn(0x7f03600c6bb0 0x7f0360071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f035e7fc640 1 -- 172.21.15.96:0/3852797384 >> v1:172.21.15.102:6789/0 conn(0x7f03600c67d0 legacy=0x7f03600c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f035e7fc640 1 -- 172.21.15.96:0/3852797384 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600c1a00 con 0x7f03600c1dd0 2023-12-01T23:19:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f7abd238640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7ab0038c00 0x7f7ab00ed980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:42574/0 (socket says 172.21.15.96:42574) 2023-12-01T23:19:02.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.965+0000 7f7abd238640 1 -- 172.21.15.96:0/1750472437 learned_addr learned my addr 172.21.15.96:0/1750472437 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.966+0000 7efe58e6e640 1 -- 172.21.15.96:0/3804155205 >> v2:172.21.15.96:3300/0 conn(0x7efe4c0464e0 msgr2=0x7efe4c046970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.966+0000 7efe58e6e640 1 --2- 172.21.15.96:0/3804155205 >> v2:172.21.15.96:3300/0 conn(0x7efe4c0464e0 0x7efe4c046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.966+0000 7efe58e6e640 1 -- 172.21.15.96:0/3804155205 >> v1:172.21.15.96:6789/0 conn(0x7efe4c0dd4a0 legacy=0x7efe4c045530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.966+0000 7efe58e6e640 1 -- 172.21.15.96:0/3804155205 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0e34a0 con 0x7efe4c04be70 2023-12-01T23:19:02.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.968+0000 7f9aaffff640 1 --2- 172.21.15.96:0/710687515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00c8940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ab008c370 tx=0x7f9aa002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b51923fe3a6c1d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.970+0000 7fe0c2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0c40cb0a0 0x7fe0c4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.970+0000 7fe0c2ffd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fe0c40cb0a0 0x7fe0c4071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36254/0 (socket says 172.21.15.96:36254) 2023-12-01T23:19:02.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.970+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2386163987 learned_addr learned my addr 172.21.15.96:0/2386163987 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.971+0000 7f3d9c8ba640 1 --2- 172.21.15.96:0/2476893185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802cee0 tx=0x7f3d980a63d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e56d2dd332dcf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.972+0000 7efe58e6e640 1 --2- 172.21.15.96:0/3804155205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe5002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1518ec5fe1216 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.972+0000 7f035e7fc640 1 --2- 172.21.15.96:0/3852797384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0350009870 tx=0x7f035002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ecc0c7bf160c9bd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.972+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2386163987 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb480 msgr2=0x7fe0c40c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.972+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2386163987 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb480 0x7fe0c40c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.973+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2386163987 >> v1:172.21.15.96:6789/0 conn(0x7fe0c4071280 legacy=0x7fe0c406f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:02.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.973+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2386163987 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40c6ff0 con 0x7fe0c40cb0a0 2023-12-01T23:19:02.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.974+0000 7f7abca37640 1 --2- 172.21.15.96:0/1750472437 >> v2:172.21.15.102:3300/0 conn(0x7f7ab00e65f0 0x7f7ab004f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.974+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531847147 0 0) 0x7f7ab0006c70 con 0x7f7ab0038c00 2023-12-01T23:19:02.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.974+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa8003520 con 0x7f7ab0038c00 2023-12-01T23:19:02.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.977+0000 7fcfe2ffd640 1 --2- 172.21.15.96:0/3096585401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe40c4210 0x7fcfe4153a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b2450 tx=0x7fcfd402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615e0332c0d17037 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.977+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2386163987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c40cb0a0 0x7fe0c4071d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007360 tx=0x7fe0b402caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f9b2ab389c1ea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:02.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.979+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448602477 0 0) 0x7f7ab00506b0 con 0x7f7ab00387c0 2023-12-01T23:19:02.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.979+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab0006c70 con 0x7f7ab00387c0 2023-12-01T23:19:02.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.981+0000 7f3f03fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f3f040c61c0 0x7f3f040c6ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54090/0 (socket says 172.21.15.96:54090) 2023-12-01T23:19:02.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.981+0000 7f3f03fff640 1 -- 172.21.15.96:0/3261409565 learned_addr learned my addr 172.21.15.96:0/3261409565 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:02.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.981+0000 7f3f08ca1640 1 --2- 172.21.15.96:0/3261409565 >> v2:172.21.15.96:3300/0 conn(0x7f3f041503d0 0x7f3f04156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.982+0000 7f3f094a2640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c4df0 0x7f3f040c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:02.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.982+0000 7f7abca37640 1 -- 172.21.15.96:0/1750472437 >> v1:172.21.15.102:6789/0 conn(0x7f7ab0038c00 legacy=0x7f7ab00ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.982+0000 7f7abca37640 1 -- 172.21.15.96:0/1750472437 >> v1:172.21.15.96:6789/0 conn(0x7f7ab00387c0 legacy=0x7f7ab00e69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:02.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.982+0000 7f7abca37640 1 -- 172.21.15.96:0/1750472437 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0007230 con 0x7f7ab00e65f0 2023-12-01T23:19:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.983+0000 7fcfe27fc640 1 -- 172.21.15.96:0/3096585401 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004230 con 0x7fcfe40c4210 2023-12-01T23:19:03.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.983+0000 7efe4bfff640 1 -- 172.21.15.96:0/3804155205 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50030840 con 0x7efe4c04be70 2023-12-01T23:19:03.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.983+0000 7efe4bfff640 1 -- 172.21.15.96:0/3804155205 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500309a0 con 0x7efe4c04be70 2023-12-01T23:19:03.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.983+0000 7efe4bfff640 1 -- 172.21.15.96:0/3804155205 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50030d30 con 0x7efe4c04be70 2023-12-01T23:19:03.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 -- 172.21.15.96:0/3804155205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 msgr2=0x7efe4c04c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 --2- 172.21.15.96:0/3804155205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe5002b980 comp rx=0 tx=0).stop 2023-12-01T23:19:03.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 -- 172.21.15.96:0/3804155205 shutdown_connections 2023-12-01T23:19:03.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 --2- 172.21.15.96:0/3804155205 >> v2:172.21.15.96:3300/0 conn(0x7efe4c0464e0 0x7efe4c046970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 --2- 172.21.15.96:0/3804155205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c04be70 0x7efe4c04c2b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 -- 172.21.15.96:0/3804155205 >> 172.21.15.96:0/3804155205 conn(0x7efe4c050590 msgr2=0x7efe4c0509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 -- 172.21.15.96:0/3804155205 shutdown_connections 2023-12-01T23:19:03.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.984+0000 7efe5a671640 1 -- 172.21.15.96:0/3804155205 wait complete. 2023-12-01T23:19:03.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.985+0000 7efe5a671640 1 Processor -- start 2023-12-01T23:19:03.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.985+0000 7efe5a671640 1 -- start start 2023-12-01T23:19:03.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7f3d96ffd640 1 -- 172.21.15.96:0/2476893185 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980ab7d0 con 0x7f3d9004c140 2023-12-01T23:19:03.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7f3d96ffd640 1 -- 172.21.15.96:0/2476893185 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d980a9050 con 0x7f3d9004c140 2023-12-01T23:19:03.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7f3d96ffd640 1 -- 172.21.15.96:0/2476893185 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980ab7d0 con 0x7f3d9004c140 2023-12-01T23:19:03.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c0464e0 0x7efe4c04cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 0x7efe4c16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe4c0dd4a0 0x7efe4c16a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c16c480 con 0x7efe4c0dd4a0 2023-12-01T23:19:03.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c1695f0 con 0x7efe4c04be70 2023-12-01T23:19:03.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7efe5a671640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0df980 con 0x7efe4c0464e0 2023-12-01T23:19:03.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/2476893185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 msgr2=0x7f3d9004c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.986+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/2476893185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3d9802cee0 tx=0x7f3d980a63d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/2476893185 shutdown_connections 2023-12-01T23:19:03.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/2476893185 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d9004c140 0x7f3d9004c5b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/2476893185 >> v2:172.21.15.102:3300/0 conn(0x7f3d90006f00 0x7f3d900e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/2476893185 >> 172.21.15.96:0/2476893185 conn(0x7f3d90006170 msgr2=0x7f3d90006580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/2476893185 shutdown_connections 2023-12-01T23:19:03.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/2476893185 wait complete. 2023-12-01T23:19:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7f7abca37640 1 --2- 172.21.15.96:0/1750472437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab00e65f0 0x7f7ab004f650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0b9b467fd10af server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.987+0000 7efe58e6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 0x7efe4c16a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3d9d0bb640 1 Processor -- start 2023-12-01T23:19:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3d9d0bb640 1 -- start start 2023-12-01T23:19:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7efe58e6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 0x7efe4c16a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50218/0 (socket says 172.21.15.96:50218) 2023-12-01T23:19:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7efe58e6e640 1 -- 172.21.15.96:0/2190128044 learned_addr learned my addr 172.21.15.96:0/2190128044 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3f08ca1640 1 -- 172.21.15.96:0/3261409565 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c4df0 msgr2=0x7f3f040c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3f08ca1640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c4df0 0x7f3f040c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3f08ca1640 1 -- 172.21.15.96:0/3261409565 >> v1:172.21.15.96:6789/0 conn(0x7f3f040c61c0 legacy=0x7f3f040c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.988+0000 7f3f08ca1640 1 -- 172.21.15.96:0/3261409565 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f041507b0 con 0x7f3f041503d0 2023-12-01T23:19:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d90006f00 0x7f3d900d6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7fcfe27fc640 1 -- 172.21.15.96:0/3096585401 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4004390 con 0x7fcfe40c4210 2023-12-01T23:19:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9004c140 0x7f3d900d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 0x7f3d9017c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d900d8980 con 0x7f3d90006f00 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9004fe20 con 0x7f3d9004c140 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f3d9d0bb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d90050100 con 0x7f3d900e68f0 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7fcfe27fc640 1 -- 172.21.15.96:0/3096585401 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4030840 con 0x7fcfe40c4210 2023-12-01T23:19:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f035dffb640 1 -- 172.21.15.96:0/3852797384 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350030840 con 0x7f03600c1dd0 2023-12-01T23:19:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f035dffb640 1 -- 172.21.15.96:0/3852797384 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500309a0 con 0x7f03600c1dd0 2023-12-01T23:19:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7f035dffb640 1 -- 172.21.15.96:0/3852797384 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350030d30 con 0x7f03600c1dd0 2023-12-01T23:19:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/3096585401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe40c4210 msgr2=0x7fcfe4153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.989+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/3096585401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe40c4210 0x7fcfe4153a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b2450 tx=0x7fcfd402b980 comp rx=0 tx=0).stop 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/3096585401 shutdown_connections 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/3096585401 >> v2:172.21.15.102:3300/0 conn(0x7fcfe40c4810 0x7fcfe40c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/3096585401 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe40c4210 0x7fcfe4153a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/3096585401 >> 172.21.15.96:0/3096585401 conn(0x7fcfe408b610 msgr2=0x7fcfe4060f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/3096585401 shutdown_connections 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/3096585401 wait complete. 2023-12-01T23:19:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 -- 172.21.15.96:0/3852797384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 msgr2=0x7f03600c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 --2- 172.21.15.96:0/3852797384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0350009870 tx=0x7f035002b980 comp rx=0 tx=0).stop 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 -- 172.21.15.96:0/3852797384 shutdown_connections 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 --2- 172.21.15.96:0/3852797384 >> v2:172.21.15.102:3300/0 conn(0x7f03600c6bb0 0x7f0360071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 --2- 172.21.15.96:0/3852797384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f03600c8540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 -- 172.21.15.96:0/3852797384 >> 172.21.15.96:0/3852797384 conn(0x7f03600c79e0 msgr2=0x7f03600c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 -- 172.21.15.96:0/3852797384 shutdown_connections 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.990+0000 7f036537c640 1 -- 172.21.15.96:0/3852797384 wait complete. 2023-12-01T23:19:03.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.991+0000 7fcfe9b9e640 1 Processor -- start 2023-12-01T23:19:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.991+0000 7fcfe9b9e640 1 -- start start 2023-12-01T23:19:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.991+0000 7f036537c640 1 Processor -- start 2023-12-01T23:19:03.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 -- start start 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 0x7fcfe41ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfe40c4810 0x7fcfe414e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe4153640 0x7fcfe40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4157b30 con 0x7fcfe4153640 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40ca1c0 con 0x7fcfe40c4810 2023-12-01T23:19:03.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7fcfe9b9e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe41ef950 con 0x7fcfe40c4210 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f036015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600c67d0 0x7f03600c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 0x7f03600ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036014f6d0 con 0x7f03600c67d0 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0360150740 con 0x7f03600c6bb0 2023-12-01T23:19:03.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.992+0000 7f036537c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036014f450 con 0x7f03600c1dd0 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe5966f640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c0464e0 0x7efe4c04cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe58e6e640 1 -- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c0464e0 msgr2=0x7efe4c04cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe58e6e640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe4c0464e0 0x7efe4c04cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe58e6e640 1 -- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe4c0dd4a0 msgr2=0x7efe4c16a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe58e6e640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe4c0dd4a0 0x7efe4c16a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.994+0000 7efe58e6e640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500094d0 con 0x7efe4c04be70 2023-12-01T23:19:03.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.995+0000 7f3d9c8ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 0x7f3d9017c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.995+0000 7f3f08ca1640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f041503d0 0x7f3f04156b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80097a0 tx=0x7f3ef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adbb238efb675be server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.996+0000 7f3d9c8ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 0x7f3d9017c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55756/0 (socket says 172.21.15.96:55756) 2023-12-01T23:19:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.996+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/3877002104 learned_addr learned my addr 172.21.15.96:0/3877002104 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.996+0000 7f3d97fff640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d90006f00 0x7f3d900d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:02.997+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 0x7fcfe41ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9aaf7fe640 1 -- 172.21.15.96:0/710687515 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0031870 con 0x7f9ab015e4f0 2023-12-01T23:19:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9aaf7fe640 1 -- 172.21.15.96:0/710687515 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00319d0 con 0x7f9ab015e4f0 2023-12-01T23:19:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9aaf7fe640 1 -- 172.21.15.96:0/710687515 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0031d60 con 0x7f9ab015e4f0 2023-12-01T23:19:03.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f3d977fe640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9004c140 0x7f3d900d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 -- 172.21.15.96:0/710687515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab015e4f0 msgr2=0x7f9ab00c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/710687515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00c8940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9ab008c370 tx=0x7f9aa002b910 comp rx=0 tx=0).stop 2023-12-01T23:19:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 -- 172.21.15.96:0/710687515 shutdown_connections 2023-12-01T23:19:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/710687515 >> v2:172.21.15.96:3300/0 conn(0x7f9ab00c8160 0x7f9ab015f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/710687515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00c8940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 -- 172.21.15.96:0/710687515 >> 172.21.15.96:0/710687515 conn(0x7f9ab00cee30 msgr2=0x7f9ab00cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 -- 172.21.15.96:0/710687515 shutdown_connections 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.000+0000 7f9ab54ef640 1 -- 172.21.15.96:0/710687515 wait complete. 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f9ab54ef640 1 Processor -- start 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f9ab54ef640 1 -- start start 2023-12-01T23:19:03.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9004c140 msgr2=0x7f3d900d7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f3d9c8ba640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d9004c140 0x7f3d900d7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d90006f00 msgr2=0x7f3d900d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f3d9c8ba640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3d90006f00 0x7f3d900d6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90050590 con 0x7f3d900e68f0 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa402f810 con 0x7f7ab00e65f0 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa402f970 con 0x7f7ab00e65f0 2023-12-01T23:19:03.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f7ab77fe640 1 -- 172.21.15.96:0/1750472437 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa402fd00 con 0x7f7ab00e65f0 2023-12-01T23:19:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7fcfe37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 0x7fcfe41ef410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55768/0 (socket says 172.21.15.96:55768) 2023-12-01T23:19:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7fcfe37fe640 1 -- 172.21.15.96:0/2396227805 learned_addr learned my addr 172.21.15.96:0/2396227805 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f9ab54ef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab00c6050 0x7f9ab00b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f9ab54ef640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ab00c8160 0x7f9ab00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.002+0000 7f9ab54ef640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f9ab54ef640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00b4a20 con 0x7f9ab015e4f0 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f9ab54ef640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab0160a40 con 0x7f9ab00c6050 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f9ab54ef640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab015b110 con 0x7f9ab00c8160 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 -- 172.21.15.96:0/1750472437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab00e65f0 msgr2=0x7f7ab004f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 --2- 172.21.15.96:0/1750472437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab00e65f0 0x7f7ab004f650 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40097a0 tx=0x7f7aa402b9f0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7fe0c1ffb640 1 -- 172.21.15.96:0/2386163987 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4008df0 con 0x7fe0c40cb0a0 2023-12-01T23:19:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 -- 172.21.15.96:0/1750472437 shutdown_connections 2023-12-01T23:19:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 --2- 172.21.15.96:0/1750472437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab00e65f0 0x7f7ab004f650 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 -- 172.21.15.96:0/1750472437 >> 172.21.15.96:0/1750472437 conn(0x7f7ab00544e0 msgr2=0x7f7ab00548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7fe0c1ffb640 1 -- 172.21.15.96:0/2386163987 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b400a0d0 con 0x7fe0c40cb0a0 2023-12-01T23:19:03.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7fe0c1ffb640 1 -- 172.21.15.96:0/2386163987 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4008df0 con 0x7fe0c40cb0a0 2023-12-01T23:19:03.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 -- 172.21.15.96:0/1750472437 shutdown_connections 2023-12-01T23:19:03.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.003+0000 7f7abec9b640 1 -- 172.21.15.96:0/1750472437 wait complete. 2023-12-01T23:19:03.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 -- 172.21.15.96:0/2386163987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c40cb0a0 msgr2=0x7fe0c4071d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2386163987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c40cb0a0 0x7fe0c4071d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4007360 tx=0x7fe0b402caa0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 -- 172.21.15.96:0/2386163987 shutdown_connections 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2386163987 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb480 0x7fe0c40c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2386163987 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c40cb0a0 0x7fe0c4071d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 -- 172.21.15.96:0/2386163987 >> 172.21.15.96:0/2386163987 conn(0x7fe0c406cd60 msgr2=0x7fe0c406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 -- 172.21.15.96:0/2386163987 shutdown_connections 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7fe0c953c640 1 -- 172.21.15.96:0/2386163987 wait complete. 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7f7abec9b640 1 Processor -- start 2023-12-01T23:19:03.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.004+0000 7f7abec9b640 1 -- start start 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7efe58e6e640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 0x7efe4c16a040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe50004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 0x7f7ab004a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab0038c00 0x7f7ab00536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ab00e65f0 0x7f7ab01794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab017ca40 con 0x7f7ab00387c0 2023-12-01T23:19:03.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab017d5c0 con 0x7f7ab0038c00 2023-12-01T23:19:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f7abec9b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0036e10 con 0x7f7ab00e65f0 2023-12-01T23:19:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f3f037fe640 1 -- 172.21.15.96:0/3261409565 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8031830 con 0x7f3f041503d0 2023-12-01T23:19:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f3f037fe640 1 -- 172.21.15.96:0/3261409565 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8031990 con 0x7f3f041503d0 2023-12-01T23:19:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f3f037fe640 1 -- 172.21.15.96:0/3261409565 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8031d20 con 0x7f3f041503d0 2023-12-01T23:19:03.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.005+0000 7f035ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 0x7f03600ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7fe0c953c640 1 Processor -- start 2023-12-01T23:19:03.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7fe0c953c640 1 -- start start 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 -- 172.21.15.96:0/3261409565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f041503d0 msgr2=0x7f3f04156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f041503d0 0x7f3f04156b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80097a0 tx=0x7f3ef802b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 -- 172.21.15.96:0/3261409565 shutdown_connections 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c4df0 0x7f3f040c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/3261409565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f041503d0 0x7f3f04156b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 -- 172.21.15.96:0/3261409565 >> 172.21.15.96:0/3261409565 conn(0x7f3f040cb3f0 msgr2=0x7f3f040cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 -- 172.21.15.96:0/3261409565 shutdown_connections 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7f3f09ca3640 1 -- 172.21.15.96:0/3261409565 wait complete. 2023-12-01T23:19:03.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.006+0000 7fcfe3fff640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe4153640 0x7fcfe40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c4071280 0x7fe0c41eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb0a0 0x7fe0c4145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40cb480 0x7fe0c4143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7f9ab4cee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c4145270 con 0x7fe0c4071280 2023-12-01T23:19:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c4146940 con 0x7fe0c40cb480 2023-12-01T23:19:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fe0c953c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c4153520 con 0x7fe0c40cb0a0 2023-12-01T23:19:03.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7fcfe2ffd640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfe40c4810 0x7fcfe414e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7f3f09ca3640 1 Processor -- start 2023-12-01T23:19:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7f3f09ca3640 1 -- start start 2023-12-01T23:19:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7f9ab4cee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36328/0 (socket says 172.21.15.96:36328) 2023-12-01T23:19:03.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.007+0000 7f9ab4cee640 1 -- 172.21.15.96:0/2652065945 learned_addr learned my addr 172.21.15.96:0/2652065945 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f040c4df0 0x7f3f04151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c61c0 0x7f3f04155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f041503d0 0x7f3f0413dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3d9c8ba640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 0x7f3d9017c0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d98064180 tx=0x7f3d98069710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04155400 con 0x7f3f040c4df0 2023-12-01T23:19:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0414cfe0 con 0x7f3f041503d0 2023-12-01T23:19:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.008+0000 7f3f09ca3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04155980 con 0x7f3f040c61c0 2023-12-01T23:19:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.009+0000 7f035ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 0x7f03600ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50258/0 (socket says 172.21.15.96:50258) 2023-12-01T23:19:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.009+0000 7f035ffff640 1 -- 172.21.15.96:0/1432543115 learned_addr learned my addr 172.21.15.96:0/1432543115 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.012+0000 7fcfe37fe640 1 -- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfe40c4810 msgr2=0x7fcfe414e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.012+0000 7fcfe37fe640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfe40c4810 0x7fcfe414e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.012+0000 7fcfe37fe640 1 -- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe4153640 msgr2=0x7fcfe40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.012+0000 7fcfe37fe640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfe4153640 0x7fcfe40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.012+0000 7fcfe37fe640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009460 con 0x7fcfe40c4210 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.013+0000 7f9ab4cee640 1 -- 172.21.15.96:0/2652065945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ab00c8160 msgr2=0x7f9ab00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.013+0000 7f9ab4cee640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ab00c8160 0x7f9ab00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.013+0000 7f9ab4cee640 1 -- 172.21.15.96:0/2652065945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab00c6050 msgr2=0x7f9ab00b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.013+0000 7f9ab4cee640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ab00c6050 0x7f9ab00b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.013+0000 7f9ab4cee640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00094d0 con 0x7f9ab015e4f0 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7f035ffff640 1 -- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 msgr2=0x7f036015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7f035ffff640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03600c1dd0 0x7f036015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7f035ffff640 1 -- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600c67d0 msgr2=0x7f03600c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7f035ffff640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03600c67d0 0x7f03600c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7f035ffff640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500094d0 con 0x7f03600c6bb0 2023-12-01T23:19:03.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.017+0000 7fcfe37fe640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 0x7fcfe41ef410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c410 tx=0x7fcfd800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.018+0000 7fe0c27fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb0a0 0x7fe0c4145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.021+0000 7f9ab4cee640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00b4330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800efc0 tx=0x7f9aa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.025+0000 7f7abd238640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ab00e65f0 0x7f7ab01794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.025+0000 7f7abca37640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 0x7f7ab004a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.025+0000 7fe0c27fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb0a0 0x7fe0c4145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55802/0 (socket says 172.21.15.96:55802) 2023-12-01T23:19:03.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.025+0000 7fe0c27fc640 1 -- 172.21.15.96:0/2400102720 learned_addr learned my addr 172.21.15.96:0/2400102720 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.026+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c4071280 0x7fe0c41eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.026+0000 7f7abca37640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 0x7f7ab004a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36342/0 (socket says 172.21.15.96:36342) 2023-12-01T23:19:03.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.026+0000 7f7abca37640 1 -- 172.21.15.96:0/947580292 learned_addr learned my addr 172.21.15.96:0/947580292 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.027+0000 7f035ffff640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 0x7f03600ca4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f035800ba40 tx=0x7f035800bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.027+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c61c0 0x7f3f04155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.028+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8009ba0 con 0x7f9ab015e4f0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.028+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa800f040 con 0x7f9ab015e4f0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.028+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00b1e30 con 0x7f9ab015e4f0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.028+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80146c0 con 0x7f9ab015e4f0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.028+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab0160760 con 0x7f9ab015e4f0 2023-12-01T23:19:03.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.029+0000 7f3f03fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c61c0 0x7f3f04155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55816/0 (socket says 172.21.15.96:55816) 2023-12-01T23:19:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.029+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ab00cc410 con 0x7f9ab015e4f0 2023-12-01T23:19:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.029+0000 7f3f03fff640 1 -- 172.21.15.96:0/4042747304 learned_addr learned my addr 172.21.15.96:0/4042747304 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.030+0000 7f7ab7fff640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab0038c00 0x7f7ab00536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.031+0000 7f7abca37640 1 -- 172.21.15.96:0/947580292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ab00e65f0 msgr2=0x7f7ab01794d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.031+0000 7f7abca37640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ab00e65f0 0x7f7ab01794d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.031+0000 7f7abca37640 1 -- 172.21.15.96:0/947580292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab0038c00 msgr2=0x7f7ab00536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.031+0000 7f7abca37640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ab0038c00 0x7f7ab00536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.031+0000 7f7abca37640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa4009400 con 0x7f7ab00387c0 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.033+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500307f0 con 0x7efe4c04be70 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.033+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe50043400 con 0x7efe4c04be70 2023-12-01T23:19:03.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.033+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500437b0 con 0x7efe4c04be70 2023-12-01T23:19:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.033+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0dfc00 con 0x7efe4c04be70 2023-12-01T23:19:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c37fe640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40cb480 0x7fe0c4143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c0e01c0 con 0x7efe4c04be70 2023-12-01T23:19:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2400102720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb0a0 msgr2=0x7fe0c4145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0c40cb0a0 0x7fe0c4145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2400102720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40cb480 msgr2=0x7fe0c4143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0c40cb480 0x7fe0c4143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7fe0c2ffd640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4007040 con 0x7fe0c4071280 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.034+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe4c0e3d40 con 0x7efe4c04be70 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.035+0000 7f3f094a2640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f041503d0 0x7f3f0413dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.037+0000 7f7abca37640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 0x7f7ab004a890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402c000 tx=0x7f7aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.043+0000 7f3f094a2640 1 -- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c61c0 msgr2=0x7f3f04155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.043+0000 7f3f094a2640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f040c61c0 0x7f3f04155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.043+0000 7f3f094a2640 1 -- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f040c4df0 msgr2=0x7f3f04151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.043+0000 7f3f094a2640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3f040c4df0 0x7f3f04151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.043+0000 7f3f094a2640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8009400 con 0x7f3f041503d0 2023-12-01T23:19:03.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.045+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80035f0 con 0x7fcfe40c4210 2023-12-01T23:19:03.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.045+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8003750 con 0x7fcfe40c4210 2023-12-01T23:19:03.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.045+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8003b40 con 0x7fcfe40c4210 2023-12-01T23:19:03.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.045+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe41efbe0 con 0x7fcfe40c4210 2023-12-01T23:19:03.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.045+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe41f01a0 con 0x7fcfe40c4210 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980b7670 con 0x7f3d900e68f0 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d980b77d0 con 0x7f3d900e68f0 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980b7b40 con 0x7f3d900e68f0 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d90050d00 con 0x7f3d900e68f0 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9017cc00 con 0x7f3d900e68f0 2023-12-01T23:19:03.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.046+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfe406c9e0 con 0x7fcfe40c4210 2023-12-01T23:19:03.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.048+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d900e3f80 con 0x7f3d900e68f0 2023-12-01T23:19:03.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.048+0000 7fe0c2ffd640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c4071280 0x7fe0c41eacf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4033000 tx=0x7fe0b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.064+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9aa8014820 con 0x7f9ab015e4f0 2023-12-01T23:19:03.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.065+0000 7f9aad7fa640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9a9006ae40 0x7f9a9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.065+0000 7f9aaffff640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9a9006ae40 0x7f9a9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.065+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe50043910 con 0x7efe4c04be70 2023-12-01T23:19:03.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.066+0000 7f9aaffff640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9a9006ae40 0x7f9a9006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0036000 tx=0x7f9aa0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.066+0000 7efe49ffb640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efe3806ae90 0x7efe3806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.066+0000 7efe5966f640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efe3806ae90 0x7efe3806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.066+0000 7efe5966f640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efe3806ae90 0x7efe3806d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe5406a160 tx=0x7efe5406e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.070+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe5003e070 con 0x7efe4c04be70 2023-12-01T23:19:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.070+0000 7efe49ffb640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7efe380743d0 0x7efe38076810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.070+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe38076ee0 con 0x7efe380743d0 2023-12-01T23:19:03.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.071+0000 7efe59e70640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7efe380743d0 0x7efe38076810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.071+0000 7efe59e70640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7efe380743d0 0x7efe38076810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe50078320 con 0x7efe4c04be70 2023-12-01T23:19:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== osd.5 v2:172.21.15.102:6809/3442167732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efe38076ee0 con 0x7efe380743d0 2023-12-01T23:19:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9aa8059cc0 con 0x7f9ab015e4f0 2023-12-01T23:19:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7f9aad7fa640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9a90074380 0x7f9a900767c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a90076e90 con 0x7f9a90074380 2023-12-01T23:19:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.072+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa8055900 con 0x7f9ab015e4f0 2023-12-01T23:19:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f9aa7fff640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9a90074380 0x7f9a900767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f9aa7fff640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9a90074380 0x7f9a900767c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035800cac0 con 0x7f03600c6bb0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035800cc20 con 0x7f03600c6bb0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03601f3d00 con 0x7f03600c6bb0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358014440 con 0x7f03600c6bb0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.073+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03601503d0 con 0x7f03600c6bb0 2023-12-01T23:19:03.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.074+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== osd.1 v2:172.21.15.96:6802/3966350993 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9a90076e90 con 0x7f9a90074380 2023-12-01T23:19:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.074+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b403e070 con 0x7fe0c4071280 2023-12-01T23:19:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.074+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b402ea10 con 0x7fe0c4071280 2023-12-01T23:19:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.074+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b403e070 con 0x7fe0c4071280 2023-12-01T23:19:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.075+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c4153800 con 0x7fe0c4071280 2023-12-01T23:19:03.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.075+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f036015d890 con 0x7f03600c6bb0 2023-12-01T23:19:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.075+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c4143c70 con 0x7fe0c4071280 2023-12-01T23:19:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0c40c1000 con 0x7fe0c4071280 2023-12-01T23:19:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa403b040 con 0x7f7ab00387c0 2023-12-01T23:19:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab0054140 con 0x7f7ab00387c0 2023-12-01T23:19:03.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab017cf70 con 0x7f7ab00387c0 2023-12-01T23:19:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4037810 con 0x7f7ab00387c0 2023-12-01T23:19:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.076+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4037bc0 con 0x7f7ab00387c0 2023-12-01T23:19:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.077+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a98000fc0 con 0x7f7ab00387c0 2023-12-01T23:19:03.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.077+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfd8003ca0 con 0x7fcfe40c4210 2023-12-01T23:19:03.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.077+0000 7fcfcbfff640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcfd006aec0 0x7fcfd006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.078+0000 7fcfe2ffd640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcfd006aec0 0x7fcfd006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.078+0000 7fcfe2ffd640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcfd006aec0 0x7fcfd006d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4035000 tx=0x7fcfd403a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.085+0000 7f3f094a2640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f041503d0 0x7f3f0413dbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00eba0 tx=0x7f3efc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfd80010c0 con 0x7fcfe40c4210 2023-12-01T23:19:03.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 --> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe4c045fc0 con 0x7efe380743d0 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7fcfcbfff640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7fcfd0074400 0x7fcfd0076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfd0076f10 con 0x7fcfd0074400 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd8054430 con 0x7fcfe40c4210 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.088+0000 7fcfe3fff640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7fcfd0074400 0x7fcfd0076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7fcfe3fff640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7fcfd0074400 0x7fcfd0076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7efe49ffb640 1 -- 172.21.15.96:0/2190128044 <== osd.5 v2:172.21.15.102:6809/3442167732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe440092a0 con 0x7efe380743d0 2023-12-01T23:19:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 --> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ab01f3f30 con 0x7f9a90074380 2023-12-01T23:19:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7efe380743d0 msgr2=0x7efe38076810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7efe5a671640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7efe380743d0 0x7efe38076810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.089+0000 7f9aad7fa640 1 -- 172.21.15.96:0/2652065945 <== osd.1 v2:172.21.15.96:6802/3966350993 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ab01f3f30 con 0x7f9a90074380 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== osd.2 v2:172.21.15.96:6811/3916123530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcfd0076f10 con 0x7fcfd0074400 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efe3806ae90 msgr2=0x7efe3806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efe3806ae90 0x7efe3806d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe5406a160 tx=0x7efe5406e040 comp rx=0 tx=0).stop 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 msgr2=0x7efe4c16a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 --2- 172.21.15.96:0/2190128044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe4c04be70 0x7efe4c16a040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe50009870 tx=0x7efe50004730 comp rx=0 tx=0).stop 2023-12-01T23:19:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe59e70640 1 -- 172.21.15.96:0/2190128044 reap_dead start 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 shutdown_connections 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 >> 172.21.15.96:0/2190128044 conn(0x7efe4c050590 msgr2=0x7efe4c050970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9a90074380 msgr2=0x7f9a900767c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9a90074380 0x7f9a900767c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9a9006ae40 msgr2=0x7f9a9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9a9006ae40 0x7f9a9006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0036000 tx=0x7f9aa0030000 comp rx=0 tx=0).stop 2023-12-01T23:19:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 msgr2=0x7f9ab00b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 --2- 172.21.15.96:0/2652065945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ab015e4f0 0x7f9ab00b4330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800efc0 tx=0x7f9aa800c490 comp rx=0 tx=0).stop 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab4cee640 1 -- 172.21.15.96:0/2652065945 reap_dead start 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 shutdown_connections 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 >> 172.21.15.96:0/2652065945 conn(0x7f9ab00cee30 msgr2=0x7f9ab015cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 shutdown_connections 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 shutdown_connections 2023-12-01T23:19:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7f9ab54ef640 1 -- 172.21.15.96:0/2652065945 wait complete. 2023-12-01T23:19:03.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.090+0000 7efe5a671640 1 -- 172.21.15.96:0/2190128044 wait complete. 2023-12-01T23:19:03.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.100+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f035801d3b0 con 0x7f03600c6bb0 2023-12-01T23:19:03.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.100+0000 7f03477fe640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f034c06ae40 0x7f034c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.100+0000 7f035effd640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f034c06ae40 0x7f034c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.101+0000 7f035effd640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f034c06ae40 0x7f034c06d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0354001560 tx=0x7f0354007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.103 INFO:teuthology.orchestra.run.smithi096.stdout:55834574862 2023-12-01T23:19:03.103 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-01T23:19:03.104 INFO:teuthology.orchestra.run.smithi096.stdout:64424509454 2023-12-01T23:19:03.104 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-01T23:19:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.103+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d980b4040 con 0x7f3d900e68f0 2023-12-01T23:19:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.103+0000 7f3d94ff9640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3d7c06ae40 0x7f3d7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.103+0000 7f3d97fff640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3d7c06ae40 0x7f3d7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.103+0000 7f3d97fff640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3d7c06ae40 0x7f3d7c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009a30 tx=0x7f3d8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.106+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 --> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfe40b25f0 con 0x7fcfd0074400 2023-12-01T23:19:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.106+0000 7fcfcbfff640 1 -- 172.21.15.96:0/2396227805 <== osd.2 v2:172.21.15.96:6811/3916123530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfdc009bb0 con 0x7fcfd0074400 2023-12-01T23:19:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7fcfd0074400 msgr2=0x7fcfd0076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7fcfd0074400 0x7fcfd0076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.106+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f03580590b0 con 0x7f03600c6bb0 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.106+0000 7f03477fe640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f034c0742f0 0x7f034c076730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.106+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f034c076e00 con 0x7f034c0742f0 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7f035e7fc640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f034c0742f0 0x7f034c076730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcfd006aec0 msgr2=0x7fcfd006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcfd006aec0 0x7fcfd006d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4035000 tx=0x7fcfd403a040 comp rx=0 tx=0).stop 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 msgr2=0x7fcfe41ef410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 --2- 172.21.15.96:0/2396227805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcfe40c4210 0x7fcfe41ef410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c410 tx=0x7fcfd800c8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe3fff640 1 -- 172.21.15.96:0/2396227805 reap_dead start 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 shutdown_connections 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 >> 172.21.15.96:0/2396227805 conn(0x7fcfe408b610 msgr2=0x7fcfe40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 shutdown_connections 2023-12-01T23:19:03.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7fcfe9b9e640 1 -- 172.21.15.96:0/2396227805 wait complete. 2023-12-01T23:19:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.107+0000 7f035e7fc640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f034c0742f0 0x7f034c076730 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.108+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== osd.4 v2:172.21.15.102:6800/1035724866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f034c076e00 con 0x7f034c0742f0 2023-12-01T23:19:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.111+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00cd20 con 0x7f3f041503d0 2023-12-01T23:19:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.111+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00f040 con 0x7f3f041503d0 2023-12-01T23:19:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.111+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0146c0 con 0x7f3f041503d0 2023-12-01T23:19:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.111+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f04154490 con 0x7f3f041503d0 2023-12-01T23:19:03.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.111+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f04154a30 con 0x7f3f041503d0 2023-12-01T23:19:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.112+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3f04067dd0 con 0x7f3f041503d0 2023-12-01T23:19:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.113+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7aa4037d20 con 0x7f7ab00387c0 2023-12-01T23:19:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d980f5380 con 0x7f3d900e68f0 2023-12-01T23:19:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f3d94ff9640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7f3d7c074300 0x7f3d7c076740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d7c076e10 con 0x7f3d7c074300 2023-12-01T23:19:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f7ab57fa640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7a9c06ae90 0x7f7a9c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f3d977fe640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7f3d7c074300 0x7f3d7c076740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.114+0000 7f7ab7fff640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7a9c06ae90 0x7f7a9c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.115+0000 7f3d977fe640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7f3d7c074300 0x7f3d7c076740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.115+0000 7f7ab7fff640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7a9c06ae90 0x7f7a9c06d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0010e0 tx=0x7f7aac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.115+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== osd.6 v2:172.21.15.102:6808/3935229295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3d7c076e10 con 0x7f3d7c074300 2023-12-01T23:19:03.122 INFO:teuthology.orchestra.run.smithi096.stdout:60129542159 2023-12-01T23:19:03.123 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-01T23:19:03.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.127+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 --> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f036015d890 con 0x7f034c0742f0 2023-12-01T23:19:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.127+0000 7f03477fe640 1 -- 172.21.15.96:0/1432543115 <== osd.4 v2:172.21.15.102:6800/1035724866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0350030b10 con 0x7f034c0742f0 2023-12-01T23:19:03.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f034c0742f0 msgr2=0x7f034c076730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f034c0742f0 0x7f034c076730 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f034c06ae40 msgr2=0x7f034c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f034c06ae40 0x7f034c06d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0354001560 tx=0x7f0354007990 comp rx=0 tx=0).stop 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 msgr2=0x7f03600ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 --2- 172.21.15.96:0/1432543115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03600c6bb0 0x7f03600ca4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f035800ba40 tx=0x7f035800bf00 comp rx=0 tx=0).stop 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f035ffff640 1 -- 172.21.15.96:0/1432543115 reap_dead start 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 shutdown_connections 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 >> 172.21.15.96:0/1432543115 conn(0x7f03600c79e0 msgr2=0x7f036015cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 shutdown_connections 2023-12-01T23:19:03.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.128+0000 7f036537c640 1 -- 172.21.15.96:0/1432543115 wait complete. 2023-12-01T23:19:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.133+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3efc014820 con 0x7f3f041503d0 2023-12-01T23:19:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.134+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0b402eb80 con 0x7fe0c4071280 2023-12-01T23:19:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.134+0000 7f3f017fa640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3ee806ae40 0x7f3ee806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.134+0000 7fe0ab7fe640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe0b006af00 0x7fe0b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.135+0000 7fe0c27fc640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe0b006af00 0x7fe0b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.135+0000 7f3f08ca1640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3ee806ae40 0x7f3ee806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7fe0c27fc640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe0b006af00 0x7fe0b006d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0c41532a0 tx=0x7fe0b8009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3efc05a090 con 0x7f3f041503d0 2023-12-01T23:19:03.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7f3f017fa640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f3ee8074380 0x7f3ee80767c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ee8076e90 con 0x7f3ee8074380 2023-12-01T23:19:03.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7f3f08ca1640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3ee806ae40 0x7f3ee806d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8036000 tx=0x7f3ef8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.136+0000 7f3f03fff640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f3ee8074380 0x7f3ee80767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.137+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 --> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d900e3ca0 con 0x7f3d7c074300 2023-12-01T23:19:03.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.137+0000 7f3f03fff640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f3ee8074380 0x7f3ee80767c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.137+0000 7f3d94ff9640 1 -- 172.21.15.96:0/3877002104 <== osd.6 v2:172.21.15.102:6808/3935229295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d840012c0 con 0x7f3d7c074300 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7f3d7c074300 msgr2=0x7f3d7c076740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7f3d7c074300 0x7f3d7c076740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3d7c06ae40 msgr2=0x7f3d7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3d7c06ae40 0x7f3d7c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009a30 tx=0x7f3d8c008040 comp rx=0 tx=0).stop 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 msgr2=0x7f3d9017c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9d0bb640 1 --2- 172.21.15.96:0/3877002104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3d900e68f0 0x7f3d9017c0d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d98064180 tx=0x7f3d98069710 comp rx=0 tx=0).stop 2023-12-01T23:19:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3d9c8ba640 1 -- 172.21.15.96:0/3877002104 reap_dead start 2023-12-01T23:19:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.138+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== osd.7 v2:172.21.15.102:6824/725358453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3ee8076e90 con 0x7f3ee8074380 2023-12-01T23:19:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.139+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 shutdown_connections 2023-12-01T23:19:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.139+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 >> 172.21.15.96:0/3877002104 conn(0x7f3d90006170 msgr2=0x7f3d9004a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.139+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 shutdown_connections 2023-12-01T23:19:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.139+0000 7f3d9d0bb640 1 -- 172.21.15.96:0/3877002104 wait complete. 2023-12-01T23:19:03.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.141+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7aa407b290 con 0x7f7ab00387c0 2023-12-01T23:19:03.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.141+0000 7f7ab57fa640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f7a9c074450 0x7f7a9c076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.141+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a9c076f60 con 0x7f7a9c074450 2023-12-01T23:19:03.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.141+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa40775d0 con 0x7f7ab00387c0 2023-12-01T23:19:03.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.141+0000 7f7abd238640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f7a9c074450 0x7f7a9c076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.142+0000 7f7abd238640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f7a9c074450 0x7f7a9c076890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.143+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== osd.3 v2:172.21.15.96:6826/4247342649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7a9c076f60 con 0x7f7a9c074450 2023-12-01T23:19:03.145 INFO:teuthology.orchestra.run.smithi096.stdout:60129542158 2023-12-01T23:19:03.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-01T23:19:03.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.153+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0b4033030 con 0x7fe0c4071280 2023-12-01T23:19:03.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.154+0000 7fe0ab7fe640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7fe0b00743c0 0x7fe0b0076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.154+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0b0076ed0 con 0x7fe0b00743c0 2023-12-01T23:19:03.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.154+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0b403e070 con 0x7fe0c4071280 2023-12-01T23:19:03.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.154+0000 7fe0c37fe640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7fe0b00743c0 0x7fe0b0076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.154+0000 7fe0c37fe640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7fe0b00743c0 0x7fe0b0076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.156+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== osd.0 v2:172.21.15.96:6810/904588792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe0b0076ed0 con 0x7fe0b00743c0 2023-12-01T23:19:03.161 INFO:teuthology.orchestra.run.smithi096.stdout:60129542158 2023-12-01T23:19:03.161 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-01T23:19:03.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.168+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 --> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3f04159ae0 con 0x7f3ee8074380 2023-12-01T23:19:03.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.171+0000 7f3f017fa640 1 -- 172.21.15.96:0/4042747304 <== osd.7 v2:172.21.15.102:6824/725358453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ef0001520 con 0x7f3ee8074380 2023-12-01T23:19:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.175+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 --> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a98002ce0 con 0x7f7a9c074450 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.175+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f3ee8074380 msgr2=0x7f3ee80767c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.175+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f3ee8074380 0x7f3ee80767c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3ee806ae40 msgr2=0x7f3ee806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3ee806ae40 0x7f3ee806d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8036000 tx=0x7f3ef8030000 comp rx=0 tx=0).stop 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f041503d0 msgr2=0x7f3f0413dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 --2- 172.21.15.96:0/4042747304 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f041503d0 0x7f3f0413dbc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00eba0 tx=0x7f3efc00c490 comp rx=0 tx=0).stop 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f094a2640 1 -- 172.21.15.96:0/4042747304 reap_dead start 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 shutdown_connections 2023-12-01T23:19:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 >> 172.21.15.96:0/4042747304 conn(0x7f3f040cb3f0 msgr2=0x7f3f040c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f7ab57fa640 1 -- 172.21.15.96:0/947580292 <== osd.3 v2:172.21.15.96:6826/4247342649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a98002ce0 con 0x7f7a9c074450 2023-12-01T23:19:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 shutdown_connections 2023-12-01T23:19:03.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.176+0000 7f3f09ca3640 1 -- 172.21.15.96:0/4042747304 wait complete. 2023-12-01T23:19:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.182+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f7a9c074450 msgr2=0x7f7a9c076890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.182+0000 7f7abec9b640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f7a9c074450 0x7f7a9c076890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7a9c06ae90 msgr2=0x7f7a9c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7a9c06ae90 0x7f7a9c06d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0010e0 tx=0x7f7aac009040 comp rx=0 tx=0).stop 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 msgr2=0x7f7ab004a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 --2- 172.21.15.96:0/947580292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ab00387c0 0x7f7ab004a890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7aa402c000 tx=0x7f7aa40046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abd238640 1 -- 172.21.15.96:0/947580292 reap_dead start 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 shutdown_connections 2023-12-01T23:19:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.185+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 >> 172.21.15.96:0/947580292 conn(0x7f7ab00544e0 msgr2=0x7f7ab003a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.187+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 --> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0c40c62f0 con 0x7fe0b00743c0 2023-12-01T23:19:03.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.188+0000 7fe0ab7fe640 1 -- 172.21.15.96:0/2400102720 <== osd.0 v2:172.21.15.96:6810/904588792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe0bc001850 con 0x7fe0b00743c0 2023-12-01T23:19:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.188+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 shutdown_connections 2023-12-01T23:19:03.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.189+0000 7f7abec9b640 1 -- 172.21.15.96:0/947580292 wait complete. 2023-12-01T23:19:03.196 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:03.197 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-01T23:19:03.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.199+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7fe0b00743c0 msgr2=0x7fe0b0076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.199+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7fe0b00743c0 0x7fe0b0076800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.202+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe0b006af00 msgr2=0x7fe0b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.202+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fe0b006af00 0x7fe0b006d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0c41532a0 tx=0x7fe0b8009110 comp rx=0 tx=0).stop 2023-12-01T23:19:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.202+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c4071280 msgr2=0x7fe0c41eacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.202+0000 7fe0c953c640 1 --2- 172.21.15.96:0/2400102720 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0c4071280 0x7fe0c41eacf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4033000 tx=0x7fe0b40046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.202+0000 7fe0c37fe640 1 -- 172.21.15.96:0/2400102720 reap_dead start 2023-12-01T23:19:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.203+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 shutdown_connections 2023-12-01T23:19:03.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.203+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 >> 172.21.15.96:0/2400102720 conn(0x7fe0c406cd60 msgr2=0x7fe0c414e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.207+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 shutdown_connections 2023-12-01T23:19:03.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.208+0000 7fe0c953c640 1 -- 172.21.15.96:0/2400102720 wait complete. 2023-12-01T23:19:03.209 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:03.210 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-01T23:19:03.230 INFO:teuthology.orchestra.run.smithi096.stdout:64424509454 2023-12-01T23:19:03.231 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-01T23:19:03.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.256+0000 7fb634153640 1 Processor -- start 2023-12-01T23:19:03.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.257+0000 7fb634153640 1 -- start start 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fb62c1504e0 0x7fb62c06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb62c0c7190 0x7fb62c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7700 0x7fb62c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0c5f60 con 0x7fb62c1504e0 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0c2c60 con 0x7fb62c0c7190 2023-12-01T23:19:03.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.258+0000 7fb634153640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0c2f20 con 0x7fb62c0c7700 2023-12-01T23:19:03.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.259+0000 7fb6316ee640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb62c0c7190 0x7fb62c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.259+0000 7fb6316ee640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb62c0c7190 0x7fb62c06e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50318/0 (socket says 172.21.15.96:50318) 2023-12-01T23:19:03.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.259+0000 7fb6316ee640 1 -- 172.21.15.96:0/3473832453 learned_addr learned my addr 172.21.15.96:0/3473832453 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.261+0000 7fb6326f0640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7700 0x7fb62c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.262+0000 7fb6316ee640 1 -- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7700 msgr2=0x7fb62c0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.262+0000 7fb6316ee640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7700 0x7fb62c0c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.262+0000 7fb6316ee640 1 -- 172.21.15.96:0/3473832453 >> v2:172.21.15.96:3300/0 conn(0x7fb62c1504e0 msgr2=0x7fb62c06e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.262+0000 7fb6316ee640 1 --2- 172.21.15.96:0/3473832453 >> v2:172.21.15.96:3300/0 conn(0x7fb62c1504e0 0x7fb62c06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.262+0000 7fb6316ee640 1 -- 172.21.15.96:0/3473832453 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0c61b0 con 0x7fb62c0c7190 2023-12-01T23:19:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.264+0000 7fb6316ee640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c0c7190 0x7fb62c06e6e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0708c0 tx=0x7fb61c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d771e1ef8dd8f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.264+0000 7f61e1953640 1 Processor -- start 2023-12-01T23:19:03.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.265+0000 7f61e1953640 1 -- start start 2023-12-01T23:19:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.266+0000 7f61e1953640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61dc1619d0 0x7f61dc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.266+0000 7f61e1953640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f61dc071830 0x7f61dc157670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.267+0000 7f61e1953640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc161ea0 con 0x7f61dc071450 2023-12-01T23:19:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.267+0000 7f61e1953640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc06f860 con 0x7f61dc071830 2023-12-01T23:19:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.267+0000 7f61e1953640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0cb800 con 0x7f61dc1619d0 2023-12-01T23:19:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.268+0000 7f61daffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f61dc071450 0x7f61dc15e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54092/0 (socket says 172.21.15.96:54092) 2023-12-01T23:19:03.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.268+0000 7f61daffd640 1 -- 172.21.15.96:0/3789640209 learned_addr learned my addr 172.21.15.96:0/3789640209 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:03.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.268+0000 7f61db7fe640 1 --2- 172.21.15.96:0/3789640209 >> v2:172.21.15.96:3300/0 conn(0x7f61dc071830 0x7f61dc157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.268+0000 7fb630eed640 1 -- 172.21.15.96:0/3473832453 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c031830 con 0x7fb62c0c7190 2023-12-01T23:19:03.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.269+0000 7fb630eed640 1 -- 172.21.15.96:0/3473832453 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c031990 con 0x7fb62c0c7190 2023-12-01T23:19:03.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.269+0000 7fb630eed640 1 -- 172.21.15.96:0/3473832453 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c031d60 con 0x7fb62c0c7190 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 -- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c0c7190 msgr2=0x7fb62c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c0c7190 0x7fb62c06e6e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0708c0 tx=0x7fb61c02b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 -- 172.21.15.96:0/3473832453 shutdown_connections 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7700 0x7fb62c0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 --2- 172.21.15.96:0/3473832453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c0c7190 0x7fb62c06e6e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 --2- 172.21.15.96:0/3473832453 >> v2:172.21.15.96:3300/0 conn(0x7fb62c1504e0 0x7fb62c06e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7fb634153640 1 -- 172.21.15.96:0/3473832453 >> 172.21.15.96:0/3473832453 conn(0x7fb62c0cbef0 msgr2=0x7fb62c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.270+0000 7f61da7fc640 1 --2- 172.21.15.96:0/3789640209 >> v2:172.21.15.102:3300/0 conn(0x7f61dc1619d0 0x7f61dc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.271+0000 7fb634153640 1 -- 172.21.15.96:0/3473832453 shutdown_connections 2023-12-01T23:19:03.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.271+0000 7fb634153640 1 -- 172.21.15.96:0/3473832453 wait complete. 2023-12-01T23:19:03.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.273+0000 7fb634153640 1 Processor -- start 2023-12-01T23:19:03.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.273+0000 7fb634153640 1 -- start start 2023-12-01T23:19:03.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.275+0000 7fb634153640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 0x7fb62c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.274+0000 7f61d9ffb640 1 -- 172.21.15.96:0/3789640209 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335844124 0 0) 0x7f61dc161ea0 con 0x7f61dc071450 2023-12-01T23:19:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.274+0000 7f61d9ffb640 1 -- 172.21.15.96:0/3789640209 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c4003520 con 0x7f61dc071450 2023-12-01T23:19:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7f61da7fc640 1 -- 172.21.15.96:0/3789640209 >> v2:172.21.15.96:3300/0 conn(0x7f61dc071830 msgr2=0x7f61dc157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7f61da7fc640 1 --2- 172.21.15.96:0/3789640209 >> v2:172.21.15.96:3300/0 conn(0x7f61dc071830 0x7f61dc157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7f61da7fc640 1 -- 172.21.15.96:0/3789640209 >> v1:172.21.15.96:6789/0 conn(0x7f61dc071450 legacy=0x7f61dc15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7f61da7fc640 1 -- 172.21.15.96:0/3789640209 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0caf60 con 0x7f61dc1619d0 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7fb634153640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0c7700 0x7fb62c141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7fb634153640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 0x7fb62c141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7fb634153640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0caf70 con 0x7fb62c0c7700 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.276+0000 7fb631eef640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 0x7fb62c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.277+0000 7fb634153640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c13c400 con 0x7fb62c1504e0 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.277+0000 7fb634153640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c142d50 con 0x7fb62c0c7190 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.277+0000 7fb6326f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 0x7fb62c141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.277+0000 7fb6326f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 0x7fb62c141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50348/0 (socket says 172.21.15.96:50348) 2023-12-01T23:19:03.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.277+0000 7fb6326f0640 1 -- 172.21.15.96:0/691818543 learned_addr learned my addr 172.21.15.96:0/691818543 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.279+0000 7f61da7fc640 1 --2- 172.21.15.96:0/3789640209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc1619d0 0x7f61dc06f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61dc06eeb0 tx=0x7f61cc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ea9c1841b1ada09 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.280+0000 7fb6316ee640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0c7700 0x7fb62c141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.281+0000 7fb631eef640 1 -- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 msgr2=0x7fb62c141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.281+0000 7fb631eef640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 0x7fb62c141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.281+0000 7fb631eef640 1 -- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0c7700 msgr2=0x7fb62c141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.281+0000 7fb631eef640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0c7700 0x7fb62c141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.281+0000 7fb631eef640 1 -- 172.21.15.96:0/691818543 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0094d0 con 0x7fb62c0c7190 2023-12-01T23:19:03.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.285+0000 7fb631eef640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 0x7fb62c14c080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f30 tx=0x7fb62800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.288+0000 7f61d9ffb640 1 -- 172.21.15.96:0/3789640209 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031830 con 0x7f61dc1619d0 2023-12-01T23:19:03.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.288+0000 7f61d9ffb640 1 -- 172.21.15.96:0/3789640209 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc031990 con 0x7f61dc1619d0 2023-12-01T23:19:03.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.288+0000 7f61d9ffb640 1 -- 172.21.15.96:0/3789640209 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031d20 con 0x7f61dc1619d0 2023-12-01T23:19:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.289+0000 7f61e1953640 1 -- 172.21.15.96:0/3789640209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc1619d0 msgr2=0x7f61dc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.289+0000 7f61e1953640 1 --2- 172.21.15.96:0/3789640209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc1619d0 0x7f61dc06f320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61dc06eeb0 tx=0x7f61cc02b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628010a30 con 0x7fb62c0c7190 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628010b90 con 0x7fb62c0c7190 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0ca9b0 con 0x7fb62c0c7190 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0cb5e0 con 0x7fb62c0c7190 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.291+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628018440 con 0x7fb62c0c7190 2023-12-01T23:19:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 -- 172.21.15.96:0/3789640209 shutdown_connections 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 --2- 172.21.15.96:0/3789640209 >> v2:172.21.15.96:3300/0 conn(0x7f61dc071830 0x7f61dc157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 --2- 172.21.15.96:0/3789640209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc1619d0 0x7f61dc06f320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 -- 172.21.15.96:0/3789640209 >> 172.21.15.96:0/3789640209 conn(0x7f61dc06cd60 msgr2=0x7f61dc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 -- 172.21.15.96:0/3789640209 shutdown_connections 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.290+0000 7f61e1953640 1 -- 172.21.15.96:0/3789640209 wait complete. 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.292+0000 7f61e1953640 1 Processor -- start 2023-12-01T23:19:03.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.293+0000 7f61e1953640 1 -- start start 2023-12-01T23:19:03.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61dc071450 0x7f61dc0c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61dc1619d0 0x7f61dc0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0740e0 con 0x7fb62c0c7190 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c2860 con 0x7f61dc1619d0 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1f3680 con 0x7f61dc071830 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61e1953640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1f4650 con 0x7f61dc071450 2023-12-01T23:19:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.294+0000 7f61da7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.295+0000 7f61da7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50354/0 (socket says 172.21.15.96:50354) 2023-12-01T23:19:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.295+0000 7f61da7fc640 1 -- 172.21.15.96:0/123338996 learned_addr learned my addr 172.21.15.96:0/123338996 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.295+0000 7f61db7fe640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61dc1619d0 0x7f61dc0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.300+0000 7f61da7fc640 1 -- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61dc071450 msgr2=0x7f61dc0c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.300+0000 7f61da7fc640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61dc071450 0x7f61dc0c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.300+0000 7f61da7fc640 1 -- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61dc1619d0 msgr2=0x7f61dc0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.300+0000 7f61da7fc640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61dc1619d0 0x7f61dc0c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.300+0000 7f61da7fc640 1 -- 172.21.15.96:0/123338996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009400 con 0x7f61dc071830 2023-12-01T23:19:03.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.302+0000 7f61da7fc640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009890 tx=0x7f61cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.303+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03a960 con 0x7f61dc071830 2023-12-01T23:19:03.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.303+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc1f41c0 con 0x7f61dc071830 2023-12-01T23:19:03.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.304+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0c16a0 con 0x7f61dc071830 2023-12-01T23:19:03.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.305+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc03aac0 con 0x7f61dc071830 2023-12-01T23:19:03.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.305+0000 7f2213a4f640 1 Processor -- start 2023-12-01T23:19:03.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.306+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03ae30 con 0x7f61dc071830 2023-12-01T23:19:03.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.306+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc005250 con 0x7f61dc071830 2023-12-01T23:19:03.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.305+0000 7f2213a4f640 1 -- start start 2023-12-01T23:19:03.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2213a4f640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f220c06f5b0 0x7f220c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2213a4f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2213a4f640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0c0f30 con 0x7f220c14f920 2023-12-01T23:19:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2213a4f640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c14fd00 con 0x7f220c06f5b0 2023-12-01T23:19:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2213a4f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c072400 con 0x7f220c0caee0 2023-12-01T23:19:03.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.307+0000 7f2210fea640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f220c06f5b0 0x7f220c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.308+0000 7f2210fea640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f220c06f5b0 0x7f220c0c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36400/0 (socket says 172.21.15.96:36400) 2023-12-01T23:19:03.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.308+0000 7f2210fea640 1 -- 172.21.15.96:0/2893322703 learned_addr learned my addr 172.21.15.96:0/2893322703 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb628022440 con 0x7fb62c0c7190 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7f2210fea640 1 -- 172.21.15.96:0/2893322703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 msgr2=0x7f220c15fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7f2210fea640 1 --2- 172.21.15.96:0/2893322703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7f2210fea640 1 -- 172.21.15.96:0/2893322703 >> v1:172.21.15.96:6789/0 conn(0x7f220c14f920 legacy=0x7f220c071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7f2210fea640 1 -- 172.21.15.96:0/2893322703 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c0c1210 con 0x7f220c06f5b0 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.311+0000 7fb6227fc640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 0x7fb61006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.312+0000 7fb6316ee640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 0x7fb61006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.313+0000 7fb6316ee640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 0x7fb61006d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb61c036000 tx=0x7fb61c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.315+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb62805bfe0 con 0x7fb62c0c7190 2023-12-01T23:19:03.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.317+0000 7f2210fea640 1 --2- 172.21.15.96:0/2893322703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c06f5b0 0x7f220c0c58e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e80 tx=0x7f220402bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e1210c5cfd5a98 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.317+0000 7f08bc2ee640 1 Processor -- start 2023-12-01T23:19:03.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.317+0000 7f08bc2ee640 1 -- start start 2023-12-01T23:19:03.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.318+0000 7f08bc2ee640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08b4157cf0 0x7f08b4070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.318+0000 7f08bc2ee640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b4070540 con 0x7f08b40c7970 2023-12-01T23:19:03.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.318+0000 7f08bc2ee640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b415d9c0 con 0x7f08b40c7d50 2023-12-01T23:19:03.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.318+0000 7f08bc2ee640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b415e890 con 0x7f08b4157cf0 2023-12-01T23:19:03.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.320+0000 7f08ba08a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f08b40c7970 0x7f08b415e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54110/0 (socket says 172.21.15.96:54110) 2023-12-01T23:19:03.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.320+0000 7f08ba08a640 1 -- 172.21.15.96:0/2530241575 learned_addr learned my addr 172.21.15.96:0/2530241575 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:03.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.323+0000 7f2203fff640 1 -- 172.21.15.96:0/2893322703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220402cae0 con 0x7f220c06f5b0 2023-12-01T23:19:03.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.323+0000 7f2203fff640 1 -- 172.21.15.96:0/2893322703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220402cc40 con 0x7f220c06f5b0 2023-12-01T23:19:03.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.323+0000 7f2203fff640 1 -- 172.21.15.96:0/2893322703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040343f0 con 0x7f220c06f5b0 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 -- 172.21.15.96:0/2893322703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c06f5b0 msgr2=0x7f220c0c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 --2- 172.21.15.96:0/2893322703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c06f5b0 0x7f220c0c58e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e80 tx=0x7f220402bf40 comp rx=0 tx=0).stop 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 -- 172.21.15.96:0/2893322703 shutdown_connections 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 --2- 172.21.15.96:0/2893322703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c15fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 --2- 172.21.15.96:0/2893322703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c06f5b0 0x7f220c0c58e0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2204009e80 tx=0x7f220402bf40 comp rx=0 tx=0).stop 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 -- 172.21.15.96:0/2893322703 >> 172.21.15.96:0/2893322703 conn(0x7f220c06cd60 msgr2=0x7f220c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 -- 172.21.15.96:0/2893322703 shutdown_connections 2023-12-01T23:19:03.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.324+0000 7f2213a4f640 1 -- 172.21.15.96:0/2893322703 wait complete. 2023-12-01T23:19:03.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.326+0000 7f2213a4f640 1 Processor -- start 2023-12-01T23:19:03.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.326+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61cc0423f0 con 0x7f61dc071830 2023-12-01T23:19:03.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.326+0000 7f2213a4f640 1 -- start start 2023-12-01T23:19:03.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.326+0000 7f61c3fff640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 0x7f61c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f61daffd640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 0x7f61c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f220c14f920 0x7f220c1f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c156c70 con 0x7f220c073850 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c137550 con 0x7f220c14f920 2023-12-01T23:19:03.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f2213a4f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c1568e0 con 0x7f220c0caee0 2023-12-01T23:19:03.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f61daffd640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 0x7f61c806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000f60 tx=0x7f61d00078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.327+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909911174 0 0) 0x7f08a4001110 con 0x7f08b40c7970 2023-12-01T23:19:03.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.328+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a0003520 con 0x7f08b40c7970 2023-12-01T23:19:03.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.329+0000 7f2211fec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f2211fec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36404/0 (socket says 172.21.15.96:36404) 2023-12-01T23:19:03.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f2211fec640 1 -- 172.21.15.96:0/4182661348 learned_addr learned my addr 172.21.15.96:0/4182661348 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1419903792 0 0) 0x7f08a0003520 con 0x7f08b40c7970 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 >> v2:172.21.15.102:3300/0 conn(0x7f08b4157cf0 msgr2=0x7f08b4070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 --2- 172.21.15.96:0/2530241575 >> v2:172.21.15.102:3300/0 conn(0x7f08b4157cf0 0x7f08b4070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 >> v1:172.21.15.102:6789/0 conn(0x7f08b40c7d50 legacy=0x7f08b41575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40c9770 con 0x7f08b40c7970 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.333+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f08a4001800 con 0x7f08b40c7970 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 >> v1:172.21.15.96:6789/0 conn(0x7f08b40c7970 legacy=0x7f08b415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08a00047c0 0x7f08a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08a00052a0 0x7f08a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b415e890 con 0x7f08a00039c0 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000c1e0 con 0x7f08a00052a0 2023-12-01T23:19:03.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.334+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a000c3a0 con 0x7f08a00047c0 2023-12-01T23:19:03.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.337+0000 7faaad026640 1 Processor -- start 2023-12-01T23:19:03.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.337+0000 7faaad026640 1 -- start start 2023-12-01T23:19:03.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.338+0000 7faaad026640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faaa8151130 0x7faaa806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.338+0000 7faaad026640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa8157350 con 0x7faaa80b2060 2023-12-01T23:19:03.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.338+0000 7faaad026640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa80c8a20 con 0x7faaa8151510 2023-12-01T23:19:03.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.338+0000 7faaad026640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa81576a0 con 0x7faaa8151130 2023-12-01T23:19:03.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.341+0000 7f2211fec640 1 -- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 msgr2=0x7f220c1f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.341+0000 7f2211fec640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.341+0000 7f2211fec640 1 -- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f220c14f920 msgr2=0x7f220c1f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.341+0000 7f2211fec640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f220c14f920 0x7f220c1f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.341+0000 7f2211fec640 1 -- 172.21.15.96:0/4182661348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2204009b30 con 0x7f220c073850 2023-12-01T23:19:03.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.346+0000 7f2211fec640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b450 tx=0x7f21fc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.346+0000 7f08ba08a640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.350+0000 7f08ba08a640 1 -- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08a00047c0 msgr2=0x7f08a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.350+0000 7f08ba08a640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08a00047c0 0x7f08a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.350+0000 7f08ba08a640 1 -- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08a00052a0 msgr2=0x7f08a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.350+0000 7f08ba08a640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08a00052a0 0x7f08a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.351+0000 7f08ba08a640 1 -- 172.21.15.96:0/2530241575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a0003520 con 0x7f08a00039c0 2023-12-01T23:19:03.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.351+0000 7f08ba88b640 1 -- 172.21.15.96:0/2530241575 reap_dead start 2023-12-01T23:19:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.352+0000 7faaa659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7faaa80b2060 0x7faaa8157ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54114/0 (socket says 172.21.15.96:54114) 2023-12-01T23:19:03.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.352+0000 7faaa659c640 1 -- 172.21.15.96:0/4222366167 learned_addr learned my addr 172.21.15.96:0/4222366167 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:03.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.353+0000 7fc485368640 1 Processor -- start 2023-12-01T23:19:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.354+0000 7fc485368640 1 -- start start 2023-12-01T23:19:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.354+0000 7fc485368640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc48015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.354+0000 7fc485368640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48015a700 con 0x7fc480153890 2023-12-01T23:19:03.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.354+0000 7fc485368640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800ca870 con 0x7fc4800ceef0 2023-12-01T23:19:03.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.354+0000 7fc485368640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc480159af0 con 0x7fc480153c70 2023-12-01T23:19:03.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.357+0000 7f08ba08a640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08a0003dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08a4007fc0 tx=0x7f08a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2214155a20be70d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011890 con 0x7f220c073850 2023-12-01T23:19:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc0119f0 con 0x7f220c073850 2023-12-01T23:19:03.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c150d80 con 0x7f220c073850 2023-12-01T23:19:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011d80 con 0x7f220c073850 2023-12-01T23:19:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c151040 con 0x7f220c073850 2023-12-01T23:19:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7faaa5d9b640 1 -- 172.21.15.96:0/4222366167 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331281835 0 0) 0x7faaa8157350 con 0x7faaa80b2060 2023-12-01T23:19:03.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.363+0000 7faaa5d9b640 1 -- 172.21.15.96:0/4222366167 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa90003520 con 0x7faaa80b2060 2023-12-01T23:19:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.364+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4005ad0 con 0x7f08a00039c0 2023-12-01T23:19:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.364+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4005c30 con 0x7f08a00039c0 2023-12-01T23:19:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.364+0000 7f08b9088640 1 -- 172.21.15.96:0/2530241575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a402ca00 con 0x7f08a00039c0 2023-12-01T23:19:03.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c067500 con 0x7f220c073850 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 -- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 msgr2=0x7f08a0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08a0003dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08a4007fc0 tx=0x7f08a00057f0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 -- 172.21.15.96:0/2530241575 shutdown_connections 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/2530241575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08a0003dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 -- 172.21.15.96:0/2530241575 >> 172.21.15.96:0/2530241575 conn(0x7f08b4070bb0 msgr2=0x7f08b4070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 -- 172.21.15.96:0/2530241575 shutdown_connections 2023-12-01T23:19:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.365+0000 7f08bc2ee640 1 -- 172.21.15.96:0/2530241575 wait complete. 2023-12-01T23:19:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.367+0000 7fc47effd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fc480153890 0x7fc4800c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54130/0 (socket says 172.21.15.96:54130) 2023-12-01T23:19:03.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.367+0000 7fc47effd640 1 -- 172.21.15.96:0/1338005487 learned_addr learned my addr 172.21.15.96:0/1338005487 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.367+0000 7f08bc2ee640 1 Processor -- start 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.367+0000 7f08bc2ee640 1 -- start start 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08b41f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b4150ce0 0x7f08b4151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b415aa00 con 0x7f08a00039c0 2023-12-01T23:19:03.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b41591c0 con 0x7f08b4150ce0 2023-12-01T23:19:03.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.368+0000 7f08bc2ee640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b4159480 con 0x7f08b40cc060 2023-12-01T23:19:03.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.385+0000 7f9f8e168640 1 Processor -- start 2023-12-01T23:19:03.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.385+0000 7f9f8e168640 1 -- start start 2023-12-01T23:19:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.386+0000 7f9f8e168640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9f88153890 0x7f9f8815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.386+0000 7f9f8e168640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.386+0000 7f9f8e168640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8815a700 con 0x7f9f880ceef0 2023-12-01T23:19:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.386+0000 7f9f8e168640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f880ca870 con 0x7f9f88153890 2023-12-01T23:19:03.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.386+0000 7f9f8e168640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f88159af0 con 0x7f9f88153c70 2023-12-01T23:19:03.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.393+0000 7f94b7e9b640 1 Processor -- start 2023-12-01T23:19:03.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.393+0000 7f94b7e9b640 1 -- start start 2023-12-01T23:19:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.394+0000 7f94b7e9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f94b01504e0 0x7f94b006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.394+0000 7f94b7e9b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b00c5f60 con 0x7f94b00c7190 2023-12-01T23:19:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.394+0000 7f94b7e9b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b00c2c60 con 0x7f94b00c83f0 2023-12-01T23:19:03.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.394+0000 7f94b7e9b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00c2f20 con 0x7f94b01504e0 2023-12-01T23:19:03.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.563+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb628058320 con 0x7fb62c0c7190 2023-12-01T23:19:03.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.565+0000 7fc477fff640 1 --2- 172.21.15.96:0/1338005487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc48015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.566+0000 7f9f86ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.566+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61cc07abd0 con 0x7f61dc071830 2023-12-01T23:19:03.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.567+0000 7f9f86ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55902/0 (socket says 172.21.15.96:55902) 2023-12-01T23:19:03.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.567+0000 7f9f86ffd640 1 -- 172.21.15.96:0/2142537651 learned_addr learned my addr 172.21.15.96:0/2142537651 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.571+0000 7fc477fff640 1 -- 172.21.15.96:0/1338005487 >> v1:172.21.15.102:6789/0 conn(0x7fc4800ceef0 legacy=0x7fc48015aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.571+0000 7fc477fff640 1 -- 172.21.15.96:0/1338005487 >> v1:172.21.15.96:6789/0 conn(0x7fc480153890 legacy=0x7fc4800c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.571+0000 7fc477fff640 1 -- 172.21.15.96:0/1338005487 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480159dd0 con 0x7fc480153c70 2023-12-01T23:19:03.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.576+0000 7f9f86ffd640 1 -- 172.21.15.96:0/2142537651 >> v2:172.21.15.96:3300/0 conn(0x7f9f88153890 msgr2=0x7f9f8815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.576+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/2142537651 >> v2:172.21.15.96:3300/0 conn(0x7f9f88153890 0x7f9f8815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.576+0000 7f9f86ffd640 1 -- 172.21.15.96:0/2142537651 >> v1:172.21.15.102:6789/0 conn(0x7f9f880ceef0 legacy=0x7f9f8815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.576+0000 7f9f86ffd640 1 -- 172.21.15.96:0/2142537651 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88159dd0 con 0x7f9f88153c70 2023-12-01T23:19:03.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.576+0000 7fc477fff640 1 --2- 172.21.15.96:0/1338005487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc48015d950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097d0 tx=0x7fc46802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc92c6bebe2450e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.578+0000 7f08b9889640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.579+0000 7f08b9889640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55890/0 (socket says 172.21.15.96:55890) 2023-12-01T23:19:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.579+0000 7f08b9889640 1 -- 172.21.15.96:0/1225125687 learned_addr learned my addr 172.21.15.96:0/1225125687 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.580+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61cc076f10 con 0x7f61dc071830 2023-12-01T23:19:03.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.583+0000 7fc47e7fc640 1 -- 172.21.15.96:0/1338005487 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031800 con 0x7fc480153c70 2023-12-01T23:19:03.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.583+0000 7fc47e7fc640 1 -- 172.21.15.96:0/1338005487 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468031960 con 0x7fc480153c70 2023-12-01T23:19:03.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.583+0000 7fc47e7fc640 1 -- 172.21.15.96:0/1338005487 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468031cf0 con 0x7fc480153c70 2023-12-01T23:19:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 -- 172.21.15.96:0/1338005487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 msgr2=0x7fc48015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 --2- 172.21.15.96:0/1338005487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc48015d950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097d0 tx=0x7fc46802b8a0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 -- 172.21.15.96:0/1338005487 shutdown_connections 2023-12-01T23:19:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 --2- 172.21.15.96:0/1338005487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc48015d950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 -- 172.21.15.96:0/1338005487 >> 172.21.15.96:0/1338005487 conn(0x7fc48006ba00 msgr2=0x7fc48006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 -- 172.21.15.96:0/1338005487 shutdown_connections 2023-12-01T23:19:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.584+0000 7fc485368640 1 -- 172.21.15.96:0/1338005487 wait complete. 2023-12-01T23:19:03.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.585+0000 7f08ba88b640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b4150ce0 0x7f08b4151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7f08b9889640 1 -- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b4150ce0 msgr2=0x7f08b4151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7f08b9889640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b4150ce0 0x7f08b4151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7f08b9889640 1 -- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 msgr2=0x7f08b41f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7f08b9889640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08b41f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7f08b9889640 1 -- 172.21.15.96:0/1225125687 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b4159760 con 0x7f08b40cc060 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7fc485368640 1 Processor -- start 2023-12-01T23:19:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.586+0000 7fc485368640 1 -- start start 2023-12-01T23:19:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.587+0000 7fc485368640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4800ceef0 0x7fc4801e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.587+0000 7fc485368640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc480153890 0x7fc480149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.587+0000 7fc485368640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7fc485368640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4801f3240 con 0x7fc4800ceef0 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7fc485368640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480152e10 con 0x7fc480153890 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7fc485368640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800ce230 con 0x7fc480153c70 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/2142537651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009870 tx=0x7f9f7c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56a3b616d1b69ac server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7f94b6438640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f94b00c83f0 0x7f94b0160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:42620/0 (socket says 172.21.15.96:42620) 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.588+0000 7f94b6438640 1 -- 172.21.15.96:0/2785762913 learned_addr learned my addr 172.21.15.96:0/2785762913 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:03.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.589+0000 7faaa6d9d640 1 --2- 172.21.15.96:0/4222366167 >> v2:172.21.15.102:3300/0 conn(0x7faaa8151130 0x7faaa806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.589+0000 7f08b9889640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c440 tx=0x7f08b000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.595+0000 7faaa6d9d640 1 -- 172.21.15.96:0/4222366167 >> v1:172.21.15.102:6789/0 conn(0x7faaa8151510 legacy=0x7faaa80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.595+0000 7faaa6d9d640 1 -- 172.21.15.96:0/4222366167 >> v1:172.21.15.96:6789/0 conn(0x7faaa80b2060 legacy=0x7faaa8157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.595+0000 7faaa6d9d640 1 -- 172.21.15.96:0/4222366167 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa80c8ce0 con 0x7faaa8151130 2023-12-01T23:19:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.596+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967682157 0 0) 0x7f94b00c2c60 con 0x7f94b00c83f0 2023-12-01T23:19:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.596+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f949c003520 con 0x7f94b00c83f0 2023-12-01T23:19:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.596+0000 7f9f867fc640 1 -- 172.21.15.96:0/2142537651 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c030840 con 0x7f9f88153c70 2023-12-01T23:19:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.596+0000 7f9f867fc640 1 -- 172.21.15.96:0/2142537651 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c0309a0 con 0x7f9f88153c70 2023-12-01T23:19:03.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.596+0000 7f9f867fc640 1 -- 172.21.15.96:0/2142537651 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c030d30 con 0x7f9f88153c70 2023-12-01T23:19:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.597+0000 7f9f8e168640 1 -- 172.21.15.96:0/2142537651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 msgr2=0x7f9f880c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.597+0000 7f9f8e168640 1 --2- 172.21.15.96:0/2142537651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009870 tx=0x7f9f7c02b980 comp rx=0 tx=0).stop 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 -- 172.21.15.96:0/2142537651 shutdown_connections 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 --2- 172.21.15.96:0/2142537651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f880c9fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 --2- 172.21.15.96:0/2142537651 >> v2:172.21.15.96:3300/0 conn(0x7f9f88153890 0x7f9f8815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 -- 172.21.15.96:0/2142537651 >> 172.21.15.96:0/2142537651 conn(0x7f9f8806ba00 msgr2=0x7f9f8806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 -- 172.21.15.96:0/2142537651 shutdown_connections 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.598+0000 7f9f8e168640 1 -- 172.21.15.96:0/2142537651 wait complete. 2023-12-01T23:19:03.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.599+0000 7fc47f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.599+0000 7f9f8e168640 1 Processor -- start 2023-12-01T23:19:03.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.600+0000 7f9f8e168640 1 -- start start 2023-12-01T23:19:03.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.600+0000 7fc47f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55914/0 (socket says 172.21.15.96:55914) 2023-12-01T23:19:03.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.600+0000 7fc47f7fe640 1 -- 172.21.15.96:0/2749827381 learned_addr learned my addr 172.21.15.96:0/2749827381 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880ceef0 0x7f9f8814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 0x7f9f88151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f88151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881530a0 con 0x7f9f880ceef0 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f880ccd60 con 0x7f9f88153890 2023-12-01T23:19:03.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f9f8e168640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f881f37e0 con 0x7f9f88153c70 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0005480 con 0x7f08b40cc060 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00035f0 con 0x7f08b40cc060 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00039a0 con 0x7f08b40cc060 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.601+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b4159a40 con 0x7f08b40cc060 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b41f4ff0 con 0x7f08b40cc060 2023-12-01T23:19:03.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7faaa6d9d640 1 --2- 172.21.15.96:0/4222366167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa806f4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa980097a0 tx=0x7faa9802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7db728ff1129e00 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771226409 0 0) 0x7f949c003520 con 0x7f94b00c83f0 2023-12-01T23:19:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 >> v2:172.21.15.96:3300/0 conn(0x7f94b01504e0 msgr2=0x7f94b006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 --2- 172.21.15.96:0/2785762913 >> v2:172.21.15.96:3300/0 conn(0x7f94b01504e0 0x7f94b006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 >> v1:172.21.15.96:6789/0 conn(0x7f94b00c7190 legacy=0x7f94b00c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b00c61b0 con 0x7f94b00c83f0 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f94ac001670 con 0x7f94b00c83f0 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 >> v1:172.21.15.102:6789/0 conn(0x7f94b00c83f0 legacy=0x7f94b0160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f949c003970 0x7f949c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f949c0047c0 0x7f949c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f949c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00c2f20 con 0x7f949c0047c0 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949c014a30 con 0x7f949c005380 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.602+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949c014bf0 con 0x7f949c003970 2023-12-01T23:19:03.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.603+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b41f4e50 con 0x7f08b40cc060 2023-12-01T23:19:03.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7fc47f7fe640 1 -- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc480153890 msgr2=0x7fc480149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7fc47f7fe640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc480153890 0x7fc480149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7fc47f7fe640 1 -- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4800ceef0 msgr2=0x7fc4801e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7fc47f7fe640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4800ceef0 0x7fc4801e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7fc47f7fe640 1 -- 172.21.15.96:0/2749827381 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009400 con 0x7fc480153c70 2023-12-01T23:19:03.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.606+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f88151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.610+0000 7f9f87fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f88151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55926/0 (socket says 172.21.15.96:55926) 2023-12-01T23:19:03.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.610+0000 7f9f87fff640 1 -- 172.21.15.96:0/823173011 learned_addr learned my addr 172.21.15.96:0/823173011 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.611+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 0x7f9f88151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.616+0000 7faaa5d9b640 1 -- 172.21.15.96:0/4222366167 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98031830 con 0x7faaa8151130 2023-12-01T23:19:03.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.616+0000 7faaa5d9b640 1 -- 172.21.15.96:0/4222366167 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98031990 con 0x7faaa8151130 2023-12-01T23:19:03.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.616+0000 7faaa5d9b640 1 -- 172.21.15.96:0/4222366167 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98031d20 con 0x7faaa8151130 2023-12-01T23:19:03.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7f94b6438640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f949c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 -- 172.21.15.96:0/4222366167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 msgr2=0x7faaa806f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 --2- 172.21.15.96:0/4222366167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa806f4d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faa980097a0 tx=0x7faa9802b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 -- 172.21.15.96:0/4222366167 shutdown_connections 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 --2- 172.21.15.96:0/4222366167 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa806f4d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 -- 172.21.15.96:0/4222366167 >> 172.21.15.96:0/4222366167 conn(0x7faaa8061100 msgr2=0x7faaa80614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 -- 172.21.15.96:0/4222366167 shutdown_connections 2023-12-01T23:19:03.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.617+0000 7faaad026640 1 -- 172.21.15.96:0/4222366167 wait complete. 2023-12-01T23:19:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.619+0000 7faaad026640 1 Processor -- start 2023-12-01T23:19:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.619+0000 7faaad026640 1 -- start start 2023-12-01T23:19:03.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7f9f86ffd640 1 -- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 msgr2=0x7f9f88151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f88151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7f9f86ffd640 1 -- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880ceef0 msgr2=0x7f9f8814eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880ceef0 0x7f9f8814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7f9f86ffd640 1 -- 172.21.15.96:0/823173011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0094d0 con 0x7f9f88153890 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faaa80b2060 0x7faaa81ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa8156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8159e60 con 0x7faaa8151510 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa815a910 con 0x7faaa8151130 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.620+0000 7faaad026640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa8155a80 con 0x7faaa80b2060 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.621+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21fc01a400 con 0x7f220c073850 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.622+0000 7f2201ffb640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 0x7f21f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.622+0000 7f22117eb640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 0x7f21f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.622+0000 7f22117eb640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 0x7f21f006d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2208009650 tx=0x7f2208006ba0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.623+0000 7f9f86ffd640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 0x7f9f88151900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c033000 tx=0x7f9f7c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.625+0000 7f94b6438640 1 -- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f949c003970 msgr2=0x7f949c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.625+0000 7f94b6438640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f949c003970 0x7f949c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.625+0000 7f94b6438640 1 -- 172.21.15.96:0/2785762913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f949c0047c0 msgr2=0x7f949c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.625+0000 7f94b6438640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f949c0047c0 0x7f949c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.625+0000 7f94b6438640 1 -- 172.21.15.96:0/2785762913 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c003520 con 0x7f949c005380 2023-12-01T23:19:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.626+0000 7f94b6438640 1 -- 172.21.15.96:0/2785762913 reap_dead start 2023-12-01T23:19:03.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.629+0000 7f94b6438640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f949c014190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00c210 tx=0x7f949c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed29d45a75c57711 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.631+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c039b60 con 0x7f9f88153890 2023-12-01T23:19:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.631+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c039cc0 con 0x7f9f88153890 2023-12-01T23:19:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.631+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c043630 con 0x7f9f88153890 2023-12-01T23:19:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.631+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8814dd80 con 0x7f9f88153890 2023-12-01T23:19:03.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.631+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8814e340 con 0x7f9f88153890 2023-12-01T23:19:03.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.632+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f88067500 con 0x7f9f88153890 2023-12-01T23:19:03.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.634+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21fc0594b0 con 0x7f220c073850 2023-12-01T23:19:03.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.635+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21fc0550f0 con 0x7f220c073850 2023-12-01T23:19:03.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.641+0000 7faaa659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa8156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.649+0000 7faaa759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.651+0000 7faaa759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36464/0 (socket says 172.21.15.96:36464) 2023-12-01T23:19:03.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.651+0000 7faaa759e640 1 -- 172.21.15.96:0/590043341 learned_addr learned my addr 172.21.15.96:0/590043341 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.656+0000 7faaa759e640 1 -- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faaa80b2060 msgr2=0x7faaa81ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.656+0000 7faaa759e640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faaa80b2060 0x7faaa81ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.656+0000 7faaa759e640 1 -- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 msgr2=0x7faaa8156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.656+0000 7faaa759e640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa8156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.656+0000 7faaa759e640 1 -- 172.21.15.96:0/590043341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009400 con 0x7faaa8151510 2023-12-01T23:19:03.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.660+0000 7faaa759e640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c780 tx=0x7faaa000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.662+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0003d80 con 0x7faaa8151510 2023-12-01T23:19:03.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.662+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa815ab60 con 0x7faaa8151510 2023-12-01T23:19:03.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.662+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa8159af0 con 0x7faaa8151510 2023-12-01T23:19:03.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.663+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa8159cd0 con 0x7faaa8151510 2023-12-01T23:19:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.770+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61bc0057d0 con 0x7f61dc071830 2023-12-01T23:19:03.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.797+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb62c06ecc0 con 0x7fb62c0c7190 2023-12-01T23:19:03.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.848+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac02cae0 con 0x7f949c005380 2023-12-01T23:19:03.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.849+0000 7fc47f7fe640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c780 tx=0x7fc47800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.861+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f220c152f80 con 0x7f220c073850 2023-12-01T23:19:03.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.865+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08b0003b00 con 0x7f08b40cc060 2023-12-01T23:19:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.866+0000 7f08aaffd640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.866+0000 7f08ba08a640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.866+0000 7f08ba08a640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 0x7f089806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08a4034000 tx=0x7f08a4007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.875+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08b0057ff0 con 0x7f08b40cc060 2023-12-01T23:19:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.878+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac02cc60 con 0x7f949c005380 2023-12-01T23:19:03.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.878+0000 7f94b4c35640 1 -- 172.21.15.96:0/2785762913 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0058d0 con 0x7f949c005380 2023-12-01T23:19:03.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.878+0000 7f94b7e9b640 1 -- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 msgr2=0x7f949c014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.878+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f949c014190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00c210 tx=0x7f949c0057f0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.879+0000 7f94b7e9b640 1 -- 172.21.15.96:0/2785762913 shutdown_connections 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.879+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/2785762913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f949c014190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.879+0000 7f94b7e9b640 1 -- 172.21.15.96:0/2785762913 >> 172.21.15.96:0/2785762913 conn(0x7f94b00cbef0 msgr2=0x7f94b00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.879+0000 7f94b7e9b640 1 -- 172.21.15.96:0/2785762913 shutdown_connections 2023-12-01T23:19:03.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.879+0000 7f94b7e9b640 1 -- 172.21.15.96:0/2785762913 wait complete. 2023-12-01T23:19:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.880+0000 7f94b7e9b640 1 Processor -- start 2023-12-01T23:19:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.880+0000 7f94b7e9b640 1 -- start start 2023-12-01T23:19:03.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.880+0000 7f94b7e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.880+0000 7f94b7e9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b014dfa0 0x7f94b014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.881+0000 7f94b7e9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94b0158650 0x7f94b0142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.881+0000 7f94b7e9b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01ee880 con 0x7f94b014dfa0 2023-12-01T23:19:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.881+0000 7f94b7e9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01ee3f0 con 0x7f949c005380 2023-12-01T23:19:03.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.881+0000 7f94b7e9b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b01577d0 con 0x7f94b0158650 2023-12-01T23:19:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478003d80 con 0x7fc480153c70 2023-12-01T23:19:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800ce90 con 0x7fc480153c70 2023-12-01T23:19:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780052b0 con 0x7fc480153c70 2023-12-01T23:19:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4800ce510 con 0x7fc480153c70 2023-12-01T23:19:03.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4801f2bf0 con 0x7fc480153c70 2023-12-01T23:19:03.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.886+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08b0053c30 con 0x7f08b40cc060 2023-12-01T23:19:03.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.887+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc480067500 con 0x7fc480153c70 2023-12-01T23:19:03.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.891+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f7c042390 con 0x7f9f88153890 2023-12-01T23:19:03.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.892+0000 7f9f6ffff640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 0x7f9f7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.892+0000 7f9f877fe640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 0x7f9f7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.892+0000 7f9f877fe640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 0x7f9f7406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009710 tx=0x7f9f78006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.896+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f7c039e30 con 0x7f9f88153890 2023-12-01T23:19:03.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.898+0000 7fb6227fc640 1 -- 172.21.15.96:0/691818543 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb62801d090 con 0x7fb62c0c7190 2023-12-01T23:19:03.899 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 msgr2=0x7fb61006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 0x7fb61006d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb61c036000 tx=0x7fb61c03c040 comp rx=0 tx=0).stop 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 msgr2=0x7fb62c14c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 0x7fb62c14c080 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb628009f30 tx=0x7fb62800b8a0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 shutdown_connections 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb61006ae90 0x7fb61006d350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb62c1504e0 0x7fb62c141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb62c0c7700 0x7fb62c141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 --2- 172.21.15.96:0/691818543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb62c0c7190 0x7fb62c14c080 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 >> 172.21.15.96:0/691818543 conn(0x7fb62c0cbef0 msgr2=0x7fb62c0c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 shutdown_connections 2023-12-01T23:19:03.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.900+0000 7fb634153640 1 -- 172.21.15.96:0/691818543 wait complete. 2023-12-01T23:19:03.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.907+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f7c076dd0 con 0x7f9f88153890 2023-12-01T23:19:03.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.5 2023-12-01T23:19:03.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.911+0000 7f94b5c37640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.918+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000ce30 con 0x7faaa8151510 2023-12-01T23:19:03.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.918+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0005270 con 0x7faaa8151510 2023-12-01T23:19:03.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.918+0000 7f94b5c37640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50416/0 (socket says 172.21.15.96:50416) 2023-12-01T23:19:03.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.918+0000 7f94b5c37640 1 -- 172.21.15.96:0/1669285412 learned_addr learned my addr 172.21.15.96:0/1669285412 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:03.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.919+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faaa0005490 con 0x7faaa8151510 2023-12-01T23:19:03.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.919+0000 7faa8f7fe640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 0x7faa9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.919+0000 7faaa6d9d640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 0x7faa9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.920+0000 7faaa6d9d640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 0x7faa9406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.920+0000 7f61c3fff640 1 -- 172.21.15.96:0/123338996 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61cc047020 con 0x7f61dc071830 2023-12-01T23:19:03.921 INFO:teuthology.orchestra.run.smithi096.stdout:55834574860 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 msgr2=0x7f61c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 0x7f61c806d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000f60 tx=0x7f61d00078f0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 msgr2=0x7f61dc15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009890 tx=0x7f61cc0046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 shutdown_connections 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f61c806ae40 0x7f61c806d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61dc1619d0 0x7f61dc0c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61dc071830 0x7f61dc15eb90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 --2- 172.21.15.96:0/123338996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61dc071450 0x7f61dc0c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 >> 172.21.15.96:0/123338996 conn(0x7f61dc06cd60 msgr2=0x7f61dc073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 shutdown_connections 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.923+0000 7f61e1953640 1 -- 172.21.15.96:0/123338996 wait complete. 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.924+0000 7f94b5c37640 1 -- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94b0158650 msgr2=0x7f94b0142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.924+0000 7f94b5c37640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94b0158650 0x7f94b0142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.924+0000 7f94b5c37640 1 -- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b014dfa0 msgr2=0x7f94b014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.924+0000 7f94b5c37640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b014dfa0 0x7f94b014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.924+0000 7f94b5c37640 1 -- 172.21.15.96:0/1669285412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b01edac0 con 0x7f949c005380 2023-12-01T23:19:03.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.927+0000 7f94b5c37640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94a800b9a0 tx=0x7f94a800be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.931+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800cba0 con 0x7f949c005380 2023-12-01T23:19:03.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.931+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a8006e90 con 0x7f949c005380 2023-12-01T23:19:03.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.931+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b01edda0 con 0x7f949c005380 2023-12-01T23:19:03.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.931+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8014440 con 0x7f949c005380 2023-12-01T23:19:03.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.932+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b014a780 con 0x7f949c005380 2023-12-01T23:19:03.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.932+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b00740e0 con 0x7f949c005380 2023-12-01T23:19:03.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574860 for osd.1 2023-12-01T23:19:03.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.939+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faaa0058420 con 0x7faaa8151510 2023-12-01T23:19:03.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.939+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faaa0054760 con 0x7faaa8151510 2023-12-01T23:19:03.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.950+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94a801d3b0 con 0x7f949c005380 2023-12-01T23:19:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.951+0000 7f94a67fc640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 0x7f949406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.951+0000 7f94b5436640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 0x7f949406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:03.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.952+0000 7f94b5436640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 0x7f949406d380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94b01455d0 tx=0x7f94a0007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.984+0000 7f2201ffb640 1 -- 172.21.15.96:0/4182661348 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21fc015090 con 0x7f220c073850 2023-12-01T23:19:03.985 INFO:teuthology.orchestra.run.smithi096.stdout:60129542157 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 msgr2=0x7f21f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 0x7f21f006d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2208009650 tx=0x7f2208006ba0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 msgr2=0x7f220c157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b450 tx=0x7f21fc00b910 comp rx=0 tx=0).stop 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 shutdown_connections 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f21f006ae40 0x7f21f006d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220c073850 0x7f220c157e70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f220c14f920 0x7f220c1f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 --2- 172.21.15.96:0/4182661348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f220c0caee0 0x7f220c1f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:03.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 >> 172.21.15.96:0/4182661348 conn(0x7f220c06cd60 msgr2=0x7f220c14cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:03.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 shutdown_connections 2023-12-01T23:19:03.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:03.986+0000 7f2213a4f640 1 -- 172.21.15.96:0/4182661348 wait complete. 2023-12-01T23:19:03.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542157 for osd.2 2023-12-01T23:19:04.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.099+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f08b41f4e50 con 0x7f08b40cc060 2023-12-01T23:19:04.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.114+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f881516e0 con 0x7f9f88153890 2023-12-01T23:19:04.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.119+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faaa80740e0 con 0x7faaa8151510 2023-12-01T23:19:04.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.124+0000 7faa8f7fe640 1 -- 172.21.15.96:0/590043341 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faaa0021090 con 0x7faaa8151510 2023-12-01T23:19:04.125 INFO:teuthology.orchestra.run.smithi096.stdout:60129542156 2023-12-01T23:19:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 msgr2=0x7faa9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 0x7faa9406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98030000 comp rx=0 tx=0).stop 2023-12-01T23:19:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 msgr2=0x7faaa815a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c780 tx=0x7faaa000cc40 comp rx=0 tx=0).stop 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 shutdown_connections 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7faa9406ae40 0x7faa9406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faaa8151510 0x7faaa815a2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faaa8151130 0x7faaa8156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 --2- 172.21.15.96:0/590043341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faaa80b2060 0x7faaa81ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 >> 172.21.15.96:0/590043341 conn(0x7faaa8061100 msgr2=0x7faaa80cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 shutdown_connections 2023-12-01T23:19:04.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.126+0000 7faaad026640 1 -- 172.21.15.96:0/590043341 wait complete. 2023-12-01T23:19:04.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542156 for osd.6 2023-12-01T23:19:04.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.154+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc478005410 con 0x7fc480153c70 2023-12-01T23:19:04.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.155+0000 7fc4777fe640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 0x7fc46006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:04.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.155+0000 7fc47effd640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 0x7fc46006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:04.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.155+0000 7fc47effd640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 0x7fc46006d350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc470007fd0 tx=0x7fc470007aa0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:04.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.158+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc478058800 con 0x7fc480153c70 2023-12-01T23:19:04.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.168+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc478054440 con 0x7fc480153c70 2023-12-01T23:19:04.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.176+0000 7f08aaffd640 1 -- 172.21.15.96:0/1225125687 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08b41f4e50 con 0x7f08b40cc060 2023-12-01T23:19:04.177 INFO:teuthology.orchestra.run.smithi096.stdout:60129542156 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 msgr2=0x7f089806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 0x7f089806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f08a4034000 tx=0x7f08a4007000 comp rx=0 tx=0).stop 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 msgr2=0x7f08b41f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08b000c440 tx=0x7f08b000c900 comp rx=0 tx=0).stop 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 shutdown_connections 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f089806ae70 0x7f089806d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08b4150ce0 0x7f08b4151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08b40cc060 0x7f08b41f5d30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 --2- 172.21.15.96:0/1225125687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f08a00039c0 0x7f08b41f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 >> 172.21.15.96:0/1225125687 conn(0x7f08b4070bb0 msgr2=0x7f08b41574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:04.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 shutdown_connections 2023-12-01T23:19:04.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.178+0000 7f08bc2ee640 1 -- 172.21.15.96:0/1225125687 wait complete. 2023-12-01T23:19:04.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.186+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f94a8058d00 con 0x7f949c005380 2023-12-01T23:19:04.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542156 for osd.4 2023-12-01T23:19:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.198+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f94a8054940 con 0x7f949c005380 2023-12-01T23:19:04.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.203+0000 7f9f6ffff640 1 -- 172.21.15.96:0/823173011 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f7c048070 con 0x7f9f88153890 2023-12-01T23:19:04.205 INFO:teuthology.orchestra.run.smithi096.stdout:64424509452 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.205+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 msgr2=0x7f9f7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.205+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 0x7f9f7406d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009710 tx=0x7f9f78006c90 comp rx=0 tx=0).stop 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.205+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 msgr2=0x7f9f88151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.205+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 0x7f9f88151900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c033000 tx=0x7f9f7c004730 comp rx=0 tx=0).stop 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 shutdown_connections 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9f7406ae70 0x7f9f7406d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9f88153c70 0x7f9f88151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f88153890 0x7f9f88151900 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 --2- 172.21.15.96:0/823173011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f880ceef0 0x7f9f8814eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 >> 172.21.15.96:0/823173011 conn(0x7f9f8806ba00 msgr2=0x7f9f8815b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:04.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 shutdown_connections 2023-12-01T23:19:04.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.206+0000 7f9f8e168640 1 -- 172.21.15.96:0/823173011 wait complete. 2023-12-01T23:19:04.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509452 for osd.3 2023-12-01T23:19:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.367+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc4801f33b0 con 0x7fc480153c70 2023-12-01T23:19:04.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.397+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f94b014e560 con 0x7f949c005380 2023-12-01T23:19:04.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.403+0000 7f94a67fc640 1 -- 172.21.15.96:0/1669285412 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94a8019020 con 0x7f949c005380 2023-12-01T23:19:04.404 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.405+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 msgr2=0x7f949406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.405+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 0x7f949406d380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f94b01455d0 tx=0x7f94a0007990 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.405+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 msgr2=0x7f94b0144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.405+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94a800b9a0 tx=0x7f94a800be60 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 shutdown_connections 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f949406aec0 0x7f949406d380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94b0158650 0x7f94b0142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b014dfa0 0x7f94b014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 --2- 172.21.15.96:0/1669285412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f949c005380 0x7f94b0144a90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 >> 172.21.15.96:0/1669285412 conn(0x7f94b00cbef0 msgr2=0x7f94b00c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:04.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 shutdown_connections 2023-12-01T23:19:04.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.406+0000 7f94b7e9b640 1 -- 172.21.15.96:0/1669285412 wait complete. 2023-12-01T23:19:04.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509453 for osd.0 2023-12-01T23:19:04.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.430+0000 7fc4777fe640 1 -- 172.21.15.96:0/2749827381 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc478017020 con 0x7fc480153c70 2023-12-01T23:19:04.431 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:04.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 msgr2=0x7fc46006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 0x7fc46006d350 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc470007fd0 tx=0x7fc470007aa0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 msgr2=0x7fc4801f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc47800c780 tx=0x7fc47800cc40 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 shutdown_connections 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc46006ae90 0x7fc46006d350 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc480153c70 0x7fc4801f36d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc480153890 0x7fc480149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 --2- 172.21.15.96:0/2749827381 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc4800ceef0 0x7fc4801e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 >> 172.21.15.96:0/2749827381 conn(0x7fc48006ba00 msgr2=0x7fc480158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.432+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 shutdown_connections 2023-12-01T23:19:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:04.433+0000 7fc485368640 1 -- 172.21.15.96:0/2749827381 wait complete. 2023-12-01T23:19:04.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.7 2023-12-01T23:19:04.446 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:04.913 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-01T23:19:04.940 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-01T23:19:05.000 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-01T23:19:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.018+0000 7f17fc73e640 1 Processor -- start 2023-12-01T23:19:05.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.018+0000 7f17fc73e640 1 -- start start 2023-12-01T23:19:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17fc73e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17f40c82b0 0x7f17f40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17fc73e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f17f415d600 0x7f17f406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17fc73e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f4159ba0 con 0x7f17f406f720 2023-12-01T23:19:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17fc73e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f415da90 con 0x7f17f40c82b0 2023-12-01T23:19:05.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17fc73e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f4070040 con 0x7f17f415d600 2023-12-01T23:19:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.019+0000 7f17f9cd9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17f40c82b0 0x7f17f40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.020+0000 7f17facdb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f17f415d600 0x7f17f406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.020+0000 7f17fa4da640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f17f406f720 0x7f17f4159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:42628/0 (socket says 172.21.15.96:42628) 2023-12-01T23:19:05.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.020+0000 7f17fa4da640 1 -- 172.21.15.96:0/2922424842 learned_addr learned my addr 172.21.15.96:0/2922424842 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.022+0000 7f17f9cd9640 1 -- 172.21.15.96:0/2922424842 >> v2:172.21.15.102:3300/0 conn(0x7f17f415d600 msgr2=0x7f17f406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.022+0000 7f17f9cd9640 1 --2- 172.21.15.96:0/2922424842 >> v2:172.21.15.102:3300/0 conn(0x7f17f415d600 0x7f17f406fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.022+0000 7f17f9cd9640 1 -- 172.21.15.96:0/2922424842 >> v1:172.21.15.102:6789/0 conn(0x7f17f406f720 legacy=0x7f17f4159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.022+0000 7f17f9cd9640 1 -- 172.21.15.96:0/2922424842 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f415a3e0 con 0x7f17f40c82b0 2023-12-01T23:19:05.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.024+0000 7f17f9cd9640 1 --2- 172.21.15.96:0/2922424842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f40c82b0 0x7f17f40c7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17f40ccf40 tx=0x7f17e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37f76f51cbb8db9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.028+0000 7f17f94d8640 1 -- 172.21.15.96:0/2922424842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4031830 con 0x7f17f40c82b0 2023-12-01T23:19:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.028+0000 7f17f94d8640 1 -- 172.21.15.96:0/2922424842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4031990 con 0x7f17f40c82b0 2023-12-01T23:19:05.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.028+0000 7f17f94d8640 1 -- 172.21.15.96:0/2922424842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4031d20 con 0x7f17f40c82b0 2023-12-01T23:19:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 -- 172.21.15.96:0/2922424842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f40c82b0 msgr2=0x7f17f40c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 --2- 172.21.15.96:0/2922424842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f40c82b0 0x7f17f40c7040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17f40ccf40 tx=0x7f17e402b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 -- 172.21.15.96:0/2922424842 shutdown_connections 2023-12-01T23:19:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 --2- 172.21.15.96:0/2922424842 >> v2:172.21.15.102:3300/0 conn(0x7f17f415d600 0x7f17f406fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 --2- 172.21.15.96:0/2922424842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f40c82b0 0x7f17f40c7040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 -- 172.21.15.96:0/2922424842 >> 172.21.15.96:0/2922424842 conn(0x7f17f40cbef0 msgr2=0x7f17f40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 -- 172.21.15.96:0/2922424842 shutdown_connections 2023-12-01T23:19:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.029+0000 7f17fc73e640 1 -- 172.21.15.96:0/2922424842 wait complete. 2023-12-01T23:19:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 Processor -- start 2023-12-01T23:19:05.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 -- start start 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40c82b0 0x7f17f40cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17f415d600 0x7f17f41ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4159260 con 0x7f17f406f720 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4159800 con 0x7f17f415d600 2023-12-01T23:19:05.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.031+0000 7f17fc73e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4159520 con 0x7f17f40c82b0 2023-12-01T23:19:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.032+0000 7f17fa4da640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.032+0000 7f17facdb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17f415d600 0x7f17f41ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.032+0000 7f17fa4da640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36484/0 (socket says 172.21.15.96:36484) 2023-12-01T23:19:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.032+0000 7f17fa4da640 1 -- 172.21.15.96:0/564606107 learned_addr learned my addr 172.21.15.96:0/564606107 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.033+0000 7f17f9cd9640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40c82b0 0x7f17f40cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.036+0000 7f17fa4da640 1 -- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40c82b0 msgr2=0x7f17f40cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.036+0000 7f17fa4da640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40c82b0 0x7f17f40cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.036+0000 7f17fa4da640 1 -- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17f415d600 msgr2=0x7f17f41ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.036+0000 7f17fa4da640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17f415d600 0x7f17f41ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.036+0000 7f17fa4da640 1 -- 172.21.15.96:0/564606107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009400 con 0x7f17f406f720 2023-12-01T23:19:05.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.039+0000 7f17fa4da640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c480 tx=0x7f17f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.043+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0005ce0 con 0x7f17f406f720 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.043+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0005e40 con 0x7f17f406f720 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.043+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00072f0 con 0x7f17f406f720 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.043+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f41f29f0 con 0x7f17f406f720 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.043+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f41f2fb0 con 0x7f17f406f720 2023-12-01T23:19:05.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.044+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4156f60 con 0x7f17f406f720 2023-12-01T23:19:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.065+0000 7f8933d53640 1 Processor -- start 2023-12-01T23:19:05.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.065+0000 7f8933d53640 1 -- start start 2023-12-01T23:19:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.066+0000 7f8933d53640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f892c0c64a0 0x7f892c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.066+0000 7f8933d53640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f892c15ca80 0x7f892c15ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.066+0000 7f8933d53640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892c06b470 con 0x7f892c14fda0 2023-12-01T23:19:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.066+0000 7f8933d53640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c06be40 con 0x7f892c0c64a0 2023-12-01T23:19:05.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.066+0000 7f8933d53640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c0615b0 con 0x7f892c15ca80 2023-12-01T23:19:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17f0007510 con 0x7f17f406f720 2023-12-01T23:19:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f89322f0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f892c15ca80 0x7f892c15ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f17eaffd640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 0x7f17d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f17f9cd9640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 0x7f17d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f89322f0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f892c15ca80 0x7f892c15ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50436/0 (socket says 172.21.15.96:50436) 2023-12-01T23:19:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f89322f0640 1 -- 172.21.15.96:0/1270629063 learned_addr learned my addr 172.21.15.96:0/1270629063 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.067+0000 7f17f9cd9640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 0x7f17d806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036000 tx=0x7f17e403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.070+0000 7f89322f0640 1 -- 172.21.15.96:0/1270629063 >> v2:172.21.15.96:3300/0 conn(0x7f892c0c64a0 msgr2=0x7f892c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.070+0000 7f89322f0640 1 --2- 172.21.15.96:0/1270629063 >> v2:172.21.15.96:3300/0 conn(0x7f892c0c64a0 0x7f892c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.070+0000 7f89322f0640 1 -- 172.21.15.96:0/1270629063 >> v1:172.21.15.102:6789/0 conn(0x7f892c14fda0 legacy=0x7f892c0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.070+0000 7f89322f0640 1 -- 172.21.15.96:0/1270629063 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c06a5a0 con 0x7f892c15ca80 2023-12-01T23:19:05.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.075+0000 7f89322f0640 1 --2- 172.21.15.96:0/1270629063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c15ca80 0x7f892c15ceb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f892c0c5b70 tx=0x7f892402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24760b9ef21261a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.079+0000 7f8930aed640 1 -- 172.21.15.96:0/1270629063 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892402cbb0 con 0x7f892c15ca80 2023-12-01T23:19:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.079+0000 7f8930aed640 1 -- 172.21.15.96:0/1270629063 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892402cd10 con 0x7f892c15ca80 2023-12-01T23:19:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.079+0000 7f8930aed640 1 -- 172.21.15.96:0/1270629063 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924034610 con 0x7f892c15ca80 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 -- 172.21.15.96:0/1270629063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c15ca80 msgr2=0x7f892c15ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 --2- 172.21.15.96:0/1270629063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c15ca80 0x7f892c15ceb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f892c0c5b70 tx=0x7f892402c010 comp rx=0 tx=0).stop 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 -- 172.21.15.96:0/1270629063 shutdown_connections 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 --2- 172.21.15.96:0/1270629063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c15ca80 0x7f892c15ceb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 --2- 172.21.15.96:0/1270629063 >> v2:172.21.15.96:3300/0 conn(0x7f892c0c64a0 0x7f892c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 -- 172.21.15.96:0/1270629063 >> 172.21.15.96:0/1270629063 conn(0x7f892c0c7fd0 msgr2=0x7f892c0c83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 -- 172.21.15.96:0/1270629063 shutdown_connections 2023-12-01T23:19:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.080+0000 7f8933d53640 1 -- 172.21.15.96:0/1270629063 wait complete. 2023-12-01T23:19:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.081+0000 7f8933d53640 1 Processor -- start 2023-12-01T23:19:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.081+0000 7f8933d53640 1 -- start start 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f892c14fda0 0x7f892c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f892c15ca80 0x7f892c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c0c7cc0 con 0x7f892c14fda0 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c150700 con 0x7f892c0c64a0 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8933d53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c1efca0 con 0x7f892c15ca80 2023-12-01T23:19:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.082+0000 7f8931aef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.083+0000 7f89322f0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f892c15ca80 0x7f892c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.083+0000 7f8931aef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50452/0 (socket says 172.21.15.96:50452) 2023-12-01T23:19:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.083+0000 7f8931aef640 1 -- 172.21.15.96:0/2442317215 learned_addr learned my addr 172.21.15.96:0/2442317215 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.086+0000 7f8931aef640 1 -- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f892c15ca80 msgr2=0x7f892c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.086+0000 7f8931aef640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f892c15ca80 0x7f892c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.086+0000 7f8931aef640 1 -- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f892c14fda0 msgr2=0x7f892c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.086+0000 7f8931aef640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f892c14fda0 0x7f892c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.086+0000 7f8931aef640 1 -- 172.21.15.96:0/2442317215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924009b30 con 0x7f892c0c64a0 2023-12-01T23:19:05.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.089+0000 7f8931aef640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f892800c400 tx=0x7f892800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.093+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89280052d0 con 0x7f892c0c64a0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.093+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928005450 con 0x7f892c0c64a0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.093+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928007260 con 0x7f892c0c64a0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.093+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c14b080 con 0x7f892c0c64a0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.093+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c14a7e0 con 0x7f892c0c64a0 2023-12-01T23:19:05.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.094+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c0740e0 con 0x7f892c0c64a0 2023-12-01T23:19:05.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.105+0000 7fbe6c17d640 1 Processor -- start 2023-12-01T23:19:05.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.106+0000 7fbe6c17d640 1 -- start start 2023-12-01T23:19:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.106+0000 7fbe6c17d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbe64153c70 0x7fbe6415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.107+0000 7fbe6c17d640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6415a700 con 0x7fbe640ceef0 2023-12-01T23:19:05.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.107+0000 7fbe6c17d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640ca870 con 0x7fbe64153890 2023-12-01T23:19:05.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.107+0000 7fbe6c17d640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe64159af0 con 0x7fbe64153c70 2023-12-01T23:19:05.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.114+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89280073c0 con 0x7f892c0c64a0 2023-12-01T23:19:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.114+0000 7f89227fc640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 0x7f891006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.114+0000 7f89312ee640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 0x7f891006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.114+0000 7f89312ee640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 0x7f891006d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f892c0c6220 tx=0x7f891c006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-01T23:19:05.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.168+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17f0057e30 con 0x7f17f406f720 2023-12-01T23:19:05.190 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-01T23:19:05.218 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-01T23:19:05.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.242+0000 7fb375f90640 1 Processor -- start 2023-12-01T23:19:05.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.242+0000 7fb375f90640 1 -- start start 2023-12-01T23:19:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.243+0000 7fb375f90640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.243+0000 7fb375f90640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37015dac0 con 0x7fb370153910 2023-12-01T23:19:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.243+0000 7fb375f90640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37015a420 con 0x7fb37006a500 2023-12-01T23:19:05.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.243+0000 7fb375f90640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb370159600 con 0x7fb37015d580 2023-12-01T23:19:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.244+0000 7fb36effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.244+0000 7fb36effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55968/0 (socket says 172.21.15.96:55968) 2023-12-01T23:19:05.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.244+0000 7fb36effd640 1 -- 172.21.15.96:0/1856695706 learned_addr learned my addr 172.21.15.96:0/1856695706 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.246+0000 7fb36effd640 1 -- 172.21.15.96:0/1856695706 >> v1:172.21.15.102:6789/0 conn(0x7fb37006a500 legacy=0x7fb3700c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.246+0000 7fb36effd640 1 -- 172.21.15.96:0/1856695706 >> v1:172.21.15.96:6789/0 conn(0x7fb370153910 legacy=0x7fb37006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.246+0000 7fb36effd640 1 -- 172.21.15.96:0/1856695706 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370159810 con 0x7fb37015d580 2023-12-01T23:19:05.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.248+0000 7fb36effd640 1 --2- 172.21.15.96:0/1856695706 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3640098a0 tx=0x7fb36402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a83d94a424f62e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.252+0000 7fb36e7fc640 1 -- 172.21.15.96:0/1856695706 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364031640 con 0x7fb37015d580 2023-12-01T23:19:05.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.252+0000 7fb36e7fc640 1 -- 172.21.15.96:0/1856695706 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3640317a0 con 0x7fb37015d580 2023-12-01T23:19:05.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.252+0000 7fb36e7fc640 1 -- 172.21.15.96:0/1856695706 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364031b30 con 0x7fb37015d580 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 -- 172.21.15.96:0/1856695706 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 msgr2=0x7fb37006edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 --2- 172.21.15.96:0/1856695706 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3640098a0 tx=0x7fb36402b8f0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 -- 172.21.15.96:0/1856695706 shutdown_connections 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 --2- 172.21.15.96:0/1856695706 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb37015d580 0x7fb37006edd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 -- 172.21.15.96:0/1856695706 >> 172.21.15.96:0/1856695706 conn(0x7fb3700c89f0 msgr2=0x7fb3700c8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 -- 172.21.15.96:0/1856695706 shutdown_connections 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.253+0000 7fb375f90640 1 -- 172.21.15.96:0/1856695706 wait complete. 2023-12-01T23:19:05.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.254+0000 7fb375f90640 1 Processor -- start 2023-12-01T23:19:05.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.254+0000 7fb375f90640 1 -- start start 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb37006a500 0x7fb3700cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb37015d580 0x7fb37014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3701f00a0 con 0x7fb37015d580 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3701f3550 con 0x7fb37006a500 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.255+0000 7fb375f90640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3701efdc0 con 0x7fb370153910 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.256+0000 7fb36effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.256+0000 7fb36effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55978/0 (socket says 172.21.15.96:55978) 2023-12-01T23:19:05.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.256+0000 7fb36effd640 1 -- 172.21.15.96:0/3948376638 learned_addr learned my addr 172.21.15.96:0/3948376638 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.259+0000 7fb36effd640 1 -- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb37006a500 msgr2=0x7fb3700cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.259+0000 7fb36effd640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb37006a500 0x7fb3700cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.259+0000 7fb36effd640 1 -- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb37015d580 msgr2=0x7fb37014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.259+0000 7fb36effd640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb37015d580 0x7fb37014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.259+0000 7fb36effd640 1 -- 172.21.15.96:0/3948376638 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640094d0 con 0x7fb370153910 2023-12-01T23:19:05.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.262+0000 7fb36effd640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3640097f0 tx=0x7fb3640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.265+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36403ac60 con 0x7fb370153910 2023-12-01T23:19:05.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.265+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36403adc0 con 0x7fb370153910 2023-12-01T23:19:05.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.265+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3701f2790 con 0x7fb370153910 2023-12-01T23:19:05.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.265+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364044630 con 0x7fb370153910 2023-12-01T23:19:05.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.265+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3701f2d50 con 0x7fb370153910 2023-12-01T23:19:05.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.267+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370067710 con 0x7fb370153910 2023-12-01T23:19:05.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.285+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb36402f050 con 0x7fb370153910 2023-12-01T23:19:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.286+0000 7fb357fff640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 0x7fb35c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.286+0000 7fb36f7fe640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 0x7fb35c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.287+0000 7fb36f7fe640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 0x7fb35c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb360001560 tx=0x7fb360007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.301+0000 7f0bd2264640 1 Processor -- start 2023-12-01T23:19:05.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.301+0000 7f0bd2264640 1 -- start start 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bcc071800 0x7f0bcc15e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0bcc0c3fd0 0x7f0bcc071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc072120 0x7f0bcc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc15e990 con 0x7f0bcc071800 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc06a890 con 0x7f0bcc0c3fd0 2023-12-01T23:19:05.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.302+0000 7f0bd2264640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc06ab70 con 0x7f0bcc072120 2023-12-01T23:19:05.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.328+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17f0054170 con 0x7f17f406f720 2023-12-01T23:19:05.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.334+0000 7fbe69718640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbe64153c70 0x7fbe6415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.343+0000 7fbe69718640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbe64153c70 0x7fbe6415d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36502/0 (socket says 172.21.15.96:36502) 2023-12-01T23:19:05.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.343+0000 7fbe69718640 1 -- 172.21.15.96:0/3124342944 learned_addr learned my addr 172.21.15.96:0/3124342944 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.344+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8928057c50 con 0x7f892c0c64a0 2023-12-01T23:19:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.347+0000 7fc32eb00640 1 Processor -- start 2023-12-01T23:19:05.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.347+0000 7fc32eb00640 1 -- start start 2023-12-01T23:19:05.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.348+0000 7fc32eb00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc328153c70 0x7fc32815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.348+0000 7fc32eb00640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fc3280ceef0 0x7fc3280cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.348+0000 7fc32eb00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32815a700 con 0x7fc328153890 2023-12-01T23:19:05.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.348+0000 7fc32eb00640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280cf840 con 0x7fc3280ceef0 2023-12-01T23:19:05.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.348+0000 7fc32eb00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280ca870 con 0x7fc328153c70 2023-12-01T23:19:05.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.349+0000 7fbe69718640 1 -- 172.21.15.96:0/3124342944 >> v1:172.21.15.102:6789/0 conn(0x7fbe64153890 legacy=0x7fbe640c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.349+0000 7fbe69718640 1 -- 172.21.15.96:0/3124342944 >> v1:172.21.15.96:6789/0 conn(0x7fbe640ceef0 legacy=0x7fbe6415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.349+0000 7fbe69718640 1 -- 172.21.15.96:0/3124342944 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe64159dd0 con 0x7fbe64153c70 2023-12-01T23:19:05.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:19:05.353 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:19:05.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.352+0000 7f0bcbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bcc071800 0x7f0bcc15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.354+0000 7fbe69718640 1 --2- 172.21.15.96:0/3124342944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe64153c70 0x7fbe6415d950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009870 tx=0x7fbe5402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e71d0436a86e78 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.354+0000 7f0bcbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f0bcc071800 0x7f0bcc15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36518/0 (socket says 172.21.15.96:36518) 2023-12-01T23:19:05.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.354+0000 7f0bcbfff640 1 -- 172.21.15.96:0/3268058474 learned_addr learned my addr 172.21.15.96:0/3268058474 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.354+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8928053f90 con 0x7f892c0c64a0 2023-12-01T23:19:05.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.355+0000 7f0bcb7fe640 1 --2- 172.21.15.96:0/3268058474 >> v2:172.21.15.102:3300/0 conn(0x7f0bcc0c3fd0 0x7f0bcc071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.358+0000 7fc327fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc328153c70 0x7fc32815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.359+0000 7fc327fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc328153c70 0x7fc32815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50474/0 (socket says 172.21.15.96:50474) 2023-12-01T23:19:05.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.359+0000 7fc327fff640 1 -- 172.21.15.96:0/454525710 learned_addr learned my addr 172.21.15.96:0/454525710 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.361+0000 7f0bcbfff640 1 -- 172.21.15.96:0/3268058474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc072120 msgr2=0x7f0bcc1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.361+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/3268058474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc072120 0x7f0bcc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.361+0000 7f0bcbfff640 1 -- 172.21.15.96:0/3268058474 >> v2:172.21.15.102:3300/0 conn(0x7f0bcc0c3fd0 msgr2=0x7f0bcc071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.361+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/3268058474 >> v2:172.21.15.102:3300/0 conn(0x7f0bcc0c3fd0 0x7f0bcc071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.361+0000 7f0bcbfff640 1 -- 172.21.15.96:0/3268058474 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc06ae50 con 0x7f0bcc071800 2023-12-01T23:19:05.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.364+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/3268058474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc071800 0x7f0bcc15e450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc06fe50 tx=0x7f0bbc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca609e63f1135c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.365+0000 7fbe68f17640 1 -- 172.21.15.96:0/3124342944 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030860 con 0x7fbe64153c70 2023-12-01T23:19:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.365+0000 7fbe68f17640 1 -- 172.21.15.96:0/3124342944 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540309c0 con 0x7fbe64153c70 2023-12-01T23:19:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.366+0000 7fbe68f17640 1 -- 172.21.15.96:0/3124342944 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe54030860 con 0x7fbe64153c70 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.366+0000 7fbe6c17d640 1 -- 172.21.15.96:0/3124342944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe64153c70 msgr2=0x7fbe6415d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.366+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/3124342944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe64153c70 0x7fbe6415d950 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe54009870 tx=0x7fbe5402b9a0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fbe6c17d640 1 -- 172.21.15.96:0/3124342944 shutdown_connections 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/3124342944 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe64153c70 0x7fbe6415d950 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fbe6c17d640 1 -- 172.21.15.96:0/3124342944 >> 172.21.15.96:0/3124342944 conn(0x7fbe6406ba00 msgr2=0x7fbe6406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fbe6c17d640 1 -- 172.21.15.96:0/3124342944 shutdown_connections 2023-12-01T23:19:05.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fbe6c17d640 1 -- 172.21.15.96:0/3124342944 wait complete. 2023-12-01T23:19:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.367+0000 7fc32d09d640 1 --2- 172.21.15.96:0/454525710 >> v2:172.21.15.96:3300/0 conn(0x7fc3280ceef0 0x7fc3280cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.368+0000 7fc327fff640 1 -- 172.21.15.96:0/454525710 >> v2:172.21.15.96:3300/0 conn(0x7fc3280ceef0 msgr2=0x7fc3280cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.368+0000 7fc327fff640 1 --2- 172.21.15.96:0/454525710 >> v2:172.21.15.96:3300/0 conn(0x7fc3280ceef0 0x7fc3280cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.368+0000 7fc327fff640 1 -- 172.21.15.96:0/454525710 >> v1:172.21.15.102:6789/0 conn(0x7fc328153890 legacy=0x7fc3280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.368+0000 7fc327fff640 1 -- 172.21.15.96:0/454525710 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328159af0 con 0x7fc328153c70 2023-12-01T23:19:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.369+0000 7fbe6c17d640 1 Processor -- start 2023-12-01T23:19:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.369+0000 7fbe6c17d640 1 -- start start 2023-12-01T23:19:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.370+0000 7f0bcaffd640 1 -- 172.21.15.96:0/3268058474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc030860 con 0x7f0bcc071800 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe64153890 0x7fbe64151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe64153c70 0x7fbe640b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6414e670 con 0x7fbe640ceef0 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64151a90 con 0x7fbe64153c70 2023-12-01T23:19:05.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.371+0000 7fbe6c17d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640b3120 con 0x7fbe64153890 2023-12-01T23:19:05.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7f0bcaffd640 1 -- 172.21.15.96:0/3268058474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0309c0 con 0x7f0bcc071800 2023-12-01T23:19:05.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7f0bcaffd640 1 -- 172.21.15.96:0/3268058474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc030d50 con 0x7f0bcc071800 2023-12-01T23:19:05.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7fc327fff640 1 --2- 172.21.15.96:0/454525710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153c70 0x7fc32815d950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c6290 tx=0x7fc31402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4771ef8ff89657 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7fbe69f19640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7fbe69f19640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36532/0 (socket says 172.21.15.96:36532) 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.374+0000 7fbe69f19640 1 -- 172.21.15.96:0/677030143 learned_addr learned my addr 172.21.15.96:0/677030143 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 -- 172.21.15.96:0/3268058474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc071800 msgr2=0x7f0bcc15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 --2- 172.21.15.96:0/3268058474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc071800 0x7f0bcc15e450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc06fe50 tx=0x7f0bbc02b9a0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7fbe6a71a640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe64153c70 0x7fbe640b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 -- 172.21.15.96:0/3268058474 shutdown_connections 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 --2- 172.21.15.96:0/3268058474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc072120 0x7f0bcc1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 --2- 172.21.15.96:0/3268058474 >> v2:172.21.15.102:3300/0 conn(0x7f0bcc0c3fd0 0x7f0bcc071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 --2- 172.21.15.96:0/3268058474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc071800 0x7f0bcc15e450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 -- 172.21.15.96:0/3268058474 >> 172.21.15.96:0/3268058474 conn(0x7f0bcc0c8040 msgr2=0x7f0bcc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 -- 172.21.15.96:0/3268058474 shutdown_connections 2023-12-01T23:19:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.375+0000 7f0bd2264640 1 -- 172.21.15.96:0/3268058474 wait complete. 2023-12-01T23:19:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.377+0000 7f0bd2264640 1 Processor -- start 2023-12-01T23:19:05.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.377+0000 7f0bd2264640 1 -- start start 2023-12-01T23:19:05.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc072120 0x7f0bcc1f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc0c3fd0 0x7f0bcc1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f4e60 con 0x7f0bcc072120 2023-12-01T23:19:05.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1617e0 con 0x7f0bcc071800 2023-12-01T23:19:05.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.379+0000 7f0bd2264640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1f30e0 con 0x7f0bcc0c3fd0 2023-12-01T23:19:05.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.381+0000 7fbe69f19640 1 -- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe64153890 msgr2=0x7fbe64151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.381+0000 7fbe69f19640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe64153890 0x7fbe64151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.381+0000 7fbe69f19640 1 -- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe64153c70 msgr2=0x7fbe640b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.381+0000 7fbe69f19640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe64153c70 0x7fbe640b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.381+0000 7fbe69f19640 1 -- 172.21.15.96:0/677030143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540094d0 con 0x7fbe640ceef0 2023-12-01T23:19:05.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.384+0000 7fbe69f19640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c410 tx=0x7fbe6000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.385+0000 7fc3277fe640 1 -- 172.21.15.96:0/454525710 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314030860 con 0x7fc328153c70 2023-12-01T23:19:05.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7f0bcbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.385+0000 7fc3277fe640 1 -- 172.21.15.96:0/454525710 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140309c0 con 0x7fc328153c70 2023-12-01T23:19:05.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.385+0000 7fc3277fe640 1 -- 172.21.15.96:0/454525710 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314030d50 con 0x7fc328153c70 2023-12-01T23:19:05.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7f0bcbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:50496/0 (socket says 172.21.15.96:50496) 2023-12-01T23:19:05.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7f0bcbfff640 1 -- 172.21.15.96:0/1857356001 learned_addr learned my addr 172.21.15.96:0/1857356001 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 -- 172.21.15.96:0/454525710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153c70 msgr2=0x7fc32815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 --2- 172.21.15.96:0/454525710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153c70 0x7fc32815d950 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c6290 tx=0x7fc31402b9a0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 -- 172.21.15.96:0/454525710 shutdown_connections 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 --2- 172.21.15.96:0/454525710 >> v2:172.21.15.96:3300/0 conn(0x7fc3280ceef0 0x7fc3280cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 --2- 172.21.15.96:0/454525710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153c70 0x7fc32815d950 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 -- 172.21.15.96:0/454525710 >> 172.21.15.96:0/454525710 conn(0x7fc32806ba00 msgr2=0x7fc32806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 -- 172.21.15.96:0/454525710 shutdown_connections 2023-12-01T23:19:05.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.386+0000 7fc32eb00640 1 -- 172.21.15.96:0/454525710 wait complete. 2023-12-01T23:19:05.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.387+0000 7fc32eb00640 1 Processor -- start 2023-12-01T23:19:05.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.387+0000 7fc32eb00640 1 -- start start 2023-12-01T23:19:05.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.387+0000 7f0bcb7fe640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc072120 0x7f0bcc1f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 0x7fc3281fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 0x7fc328200130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc328153c70 0x7fc3280cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32814db90 con 0x7fc3280ceef0 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281ff670 con 0x7fc328153890 2023-12-01T23:19:05.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.388+0000 7fc32eb00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328150f50 con 0x7fc328153c70 2023-12-01T23:19:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.389+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600035f0 con 0x7fbe640ceef0 2023-12-01T23:19:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.389+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60003750 con 0x7fbe640ceef0 2023-12-01T23:19:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.389+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe64150e20 con 0x7fbe640ceef0 2023-12-01T23:19:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60003b00 con 0x7fbe640ceef0 2023-12-01T23:19:05.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64152ea0 con 0x7fbe640ceef0 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7f0bcbfff640 1 -- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc0c3fd0 msgr2=0x7f0bcc1f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc0c3fd0 0x7f0bcc1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7f0bcbfff640 1 -- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc072120 msgr2=0x7f0bcc1f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc072120 0x7f0bcc1f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7f0bcbfff640 1 -- 172.21.15.96:0/1857356001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0094d0 con 0x7f0bcc071800 2023-12-01T23:19:05.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.390+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64067500 con 0x7fbe640ceef0 2023-12-01T23:19:05.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.393+0000 7f0bcbfff640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc000c00 tx=0x7f0bbc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.394+0000 7fc32c89c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 0x7fc3281fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.395+0000 7fc32c89c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 0x7fc3281fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36556/0 (socket says 172.21.15.96:36556) 2023-12-01T23:19:05.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.395+0000 7fc32c89c640 1 -- 172.21.15.96:0/2708490093 learned_addr learned my addr 172.21.15.96:0/2708490093 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.396+0000 7fc327fff640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 0x7fc328200130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.397+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc039c90 con 0x7f0bcc071800 2023-12-01T23:19:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.397+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc039df0 con 0x7f0bcc071800 2023-12-01T23:19:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.397+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc043620 con 0x7f0bcc071800 2023-12-01T23:19:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.397+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc1f4550 con 0x7f0bcc071800 2023-12-01T23:19:05.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.397+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc1f47a0 con 0x7f0bcc071800 2023-12-01T23:19:05.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.398+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc1f50d0 con 0x7f0bcc071800 2023-12-01T23:19:05.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.401+0000 7fc327fff640 1 -- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc328153c70 msgr2=0x7fc3280cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.401+0000 7fc327fff640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc328153c70 0x7fc3280cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.401+0000 7fc327fff640 1 -- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 msgr2=0x7fc3281fc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.401+0000 7fc327fff640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 0x7fc3281fc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.401+0000 7fc327fff640 1 -- 172.21.15.96:0/2708490093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140094d0 con 0x7fc328153890 2023-12-01T23:19:05.420 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-01T23:19:05.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.470+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe60003c60 con 0x7fbe640ceef0 2023-12-01T23:19:05.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.470+0000 7fbe5a7fc640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 0x7fbe4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.471+0000 7fbe69718640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 0x7fbe4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.471+0000 7fbe69718640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 0x7fbe4806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe54036000 tx=0x7fbe54030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.476+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe60057ec0 con 0x7fbe640ceef0 2023-12-01T23:19:05.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.524+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb36407ac70 con 0x7fb370153910 2023-12-01T23:19:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.535+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3640768b0 con 0x7fb370153910 2023-12-01T23:19:05.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.568+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f17f40740e0 con 0x7f17f406f720 2023-12-01T23:19:05.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.572+0000 7f37444a6640 1 Processor -- start 2023-12-01T23:19:05.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.572+0000 7f37444a6640 1 -- start start 2023-12-01T23:19:05.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.573+0000 7f37444a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f373c153890 0x7f373c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.573+0000 7f37444a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c15a700 con 0x7f373c0ceef0 2023-12-01T23:19:05.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.573+0000 7f37444a6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c0ca870 con 0x7f373c153c70 2023-12-01T23:19:05.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.573+0000 7f37444a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c159af0 con 0x7f373c153890 2023-12-01T23:19:05.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.577+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f892c0c3a10 con 0x7f892c0c64a0 2023-12-01T23:19:05.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.640+0000 7fc327fff640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 0x7fc328200130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc314033000 tx=0x7fc314004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.658+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0bbc043780 con 0x7f0bcc071800 2023-12-01T23:19:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.659+0000 7f0bc8ff9640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 0x7f0bb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.659+0000 7f0bcb7fe640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 0x7f0bb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.659+0000 7f0bcb7fe640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 0x7f0bb806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc15d900 tx=0x7f0bc0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.663+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0bbc03e070 con 0x7f0bcc071800 2023-12-01T23:19:05.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.673+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0bbc078270 con 0x7f0bcc071800 2023-12-01T23:19:05.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.679+0000 7f89227fc640 1 -- 172.21.15.96:0/2442317215 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8928020020 con 0x7f892c0c64a0 2023-12-01T23:19:05.680 INFO:teuthology.orchestra.run.smithi096.stdout:55834574862 2023-12-01T23:19:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.680+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314039e20 con 0x7fc328153890 2023-12-01T23:19:05.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.681+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314043400 con 0x7fc328153890 2023-12-01T23:19:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.681+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140437b0 con 0x7fc328153890 2023-12-01T23:19:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.681+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc328151220 con 0x7fc328153890 2023-12-01T23:19:05.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.681+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281517e0 con 0x7fc328153890 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 msgr2=0x7f891006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 0x7f891006d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f892c0c6220 tx=0x7f891c006bf0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 msgr2=0x7f892c1ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f892800c400 tx=0x7f892800c8c0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3280b2110 con 0x7fc328153890 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 shutdown_connections 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f891006aec0 0x7f891006d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f892c15ca80 0x7f892c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f892c14fda0 0x7f892c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 --2- 172.21.15.96:0/2442317215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f892c0c64a0 0x7f892c1ef760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 >> 172.21.15.96:0/2442317215 conn(0x7f892c0c7fd0 msgr2=0x7f892c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 shutdown_connections 2023-12-01T23:19:05.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.682+0000 7f8933d53640 1 -- 172.21.15.96:0/2442317215 wait complete. 2023-12-01T23:19:05.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574862 got 55834574862 for osd.1 2023-12-01T23:19:05.699 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:05.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.723+0000 7f3742a43640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f373c0ceef0 0x7f373c15aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:54156/0 (socket says 172.21.15.96:54156) 2023-12-01T23:19:05.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.723+0000 7f3742a43640 1 -- 172.21.15.96:0/649436964 learned_addr learned my addr 172.21.15.96:0/649436964 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:05.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.737+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb37015dac0 con 0x7fb370153910 2023-12-01T23:19:05.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.738+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe60054200 con 0x7fbe640ceef0 2023-12-01T23:19:05.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.742+0000 7fb357fff640 1 -- 172.21.15.96:0/3948376638 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb37015dac0 con 0x7fb370153910 2023-12-01T23:19:05.743 INFO:teuthology.orchestra.run.smithi096.stdout:60129542158 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.745+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 msgr2=0x7fb35c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.745+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 0x7fb35c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb360001560 tx=0x7fb360007990 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.745+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 msgr2=0x7fb3700c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.745+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb3640097f0 tx=0x7fb3640046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 shutdown_connections 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb35c06ae70 0x7fb35c06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb37015d580 0x7fb37014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb370153910 0x7fb3700c43e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 --2- 172.21.15.96:0/3948376638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb37006a500 0x7fb3700cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 >> 172.21.15.96:0/3948376638 conn(0x7fb3700c89f0 msgr2=0x7fb370158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 shutdown_connections 2023-12-01T23:19:05.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.746+0000 7fb375f90640 1 -- 172.21.15.96:0/3948376638 wait complete. 2023-12-01T23:19:05.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.759+0000 7f17eaffd640 1 -- 172.21.15.96:0/564606107 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17f0021090 con 0x7f17f406f720 2023-12-01T23:19:05.760 INFO:teuthology.orchestra.run.smithi096.stdout:64424509454 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.761+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 msgr2=0x7f17d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.761+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 0x7f17d806d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036000 tx=0x7f17e403c040 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.761+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 msgr2=0x7f17f41e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.761+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c480 tx=0x7f17f000c940 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.761+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 shutdown_connections 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f17d806ae40 0x7f17d806d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17f415d600 0x7f17f41ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40c82b0 0x7f17f40cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 --2- 172.21.15.96:0/564606107 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17f406f720 0x7f17f41e3690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 >> 172.21.15.96:0/564606107 conn(0x7f17f40cbef0 msgr2=0x7f17f40c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 shutdown_connections 2023-12-01T23:19:05.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.762+0000 7f17fc73e640 1 -- 172.21.15.96:0/564606107 wait complete. 2023-12-01T23:19:05.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.6 2023-12-01T23:19:05.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.763+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527321733 0 0) 0x7f373c15a700 con 0x7f373c0ceef0 2023-12-01T23:19:05.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.763+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3728003520 con 0x7f373c0ceef0 2023-12-01T23:19:05.765 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:05.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.5 2023-12-01T23:19:05.775 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:05.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.883+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0bcc0740e0 con 0x7f0bcc071800 2023-12-01T23:19:05.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3459113804 0 0) 0x7f3728003520 con 0x7f373c0ceef0 2023-12-01T23:19:05.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 >> v2:172.21.15.102:3300/0 conn(0x7f373c153890 msgr2=0x7f373c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 --2- 172.21.15.96:0/649436964 >> v2:172.21.15.102:3300/0 conn(0x7f373c153890 0x7f373c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 >> v1:172.21.15.102:6789/0 conn(0x7f373c153c70 legacy=0x7f373c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c159dd0 con 0x7f373c0ceef0 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f37340019f0 con 0x7f373c0ceef0 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 >> v1:172.21.15.96:6789/0 conn(0x7f373c0ceef0 legacy=0x7f373c15aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f3728003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37280047c0 0x7f3728004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37280052a0 0x7f372800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c159af0 con 0x7f37280052a0 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372800c190 con 0x7f37280047c0 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.893+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372800c350 con 0x7f3728003970 2023-12-01T23:19:05.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.894+0000 7f3742242640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f3728003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742242640 1 -- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37280047c0 msgr2=0x7f3728004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742242640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37280047c0 0x7f3728004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742242640 1 -- 172.21.15.96:0/649436964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37280052a0 msgr2=0x7f372800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742242640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37280052a0 0x7f372800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742242640 1 -- 172.21.15.96:0/649436964 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728003520 con 0x7f3728003970 2023-12-01T23:19:05.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.897+0000 7f3742a43640 1 -- 172.21.15.96:0/649436964 reap_dead start 2023-12-01T23:19:05.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.899+0000 7f3742242640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f3728003d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3738006fd0 tx=0x7f37280057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2dcd28e13963b4b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.904+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373802bea0 con 0x7f3728003970 2023-12-01T23:19:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.904+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373802e050 con 0x7f3728003970 2023-12-01T23:19:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.904+0000 7f3741240640 1 -- 172.21.15.96:0/649436964 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738032860 con 0x7f3728003970 2023-12-01T23:19:05.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 -- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 msgr2=0x7f3728003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f3728003d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3738006fd0 tx=0x7f37280057f0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 -- 172.21.15.96:0/649436964 shutdown_connections 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 --2- 172.21.15.96:0/649436964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f3728003d70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 -- 172.21.15.96:0/649436964 >> 172.21.15.96:0/649436964 conn(0x7f373c06ba00 msgr2=0x7f373c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 -- 172.21.15.96:0/649436964 shutdown_connections 2023-12-01T23:19:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.905+0000 7f37444a6640 1 -- 172.21.15.96:0/649436964 wait complete. 2023-12-01T23:19:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.907+0000 7f37444a6640 1 Processor -- start 2023-12-01T23:19:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.907+0000 7f37444a6640 1 -- start start 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f373c152200 0x7f373c1f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f373c154630 0x7f373c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1f2cd0 con 0x7f373c152200 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1f29a0 con 0x7f373c154630 2023-12-01T23:19:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f37444a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1527d0 con 0x7f3728003970 2023-12-01T23:19:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.908+0000 7f3742242640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.909+0000 7f3742242640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:56040/0 (socket says 172.21.15.96:56040) 2023-12-01T23:19:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.909+0000 7f3742242640 1 -- 172.21.15.96:0/1300763078 learned_addr learned my addr 172.21.15.96:0/1300763078 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.912+0000 7f3742242640 1 -- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f373c154630 msgr2=0x7f373c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.912+0000 7f3742242640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f373c154630 0x7f373c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.912+0000 7f3742242640 1 -- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f373c152200 msgr2=0x7f373c1f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.912+0000 7f3742242640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f373c152200 0x7f373c1f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.912+0000 7f3742242640 1 -- 172.21.15.96:0/1300763078 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c152ab0 con 0x7f3728003970 2023-12-01T23:19:05.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.914+0000 7f3742242640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3738035040 tx=0x7f37380047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.918+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373803c880 con 0x7f3728003970 2023-12-01T23:19:05.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.918+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373803c9e0 con 0x7f3728003970 2023-12-01T23:19:05.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.918+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c152d90 con 0x7f3728003970 2023-12-01T23:19:05.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.918+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373803cd50 con 0x7f3728003970 2023-12-01T23:19:05.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.918+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c14ad30 con 0x7f3728003970 2023-12-01T23:19:05.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.919+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c1527d0 con 0x7f3728003970 2023-12-01T23:19:05.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.927+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe640b3bc0 con 0x7fbe640ceef0 2023-12-01T23:19:05.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.932+0000 7fbe5a7fc640 1 -- 172.21.15.96:0/677030143 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe60017090 con 0x7fbe640ceef0 2023-12-01T23:19:05.933 INFO:teuthology.orchestra.run.smithi096.stdout:60129542159 2023-12-01T23:19:05.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 msgr2=0x7fbe4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 0x7fbe4806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe54036000 tx=0x7fbe54030000 comp rx=0 tx=0).stop 2023-12-01T23:19:05.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 msgr2=0x7fbe6414e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:05.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c410 tx=0x7fbe6000c8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 shutdown_connections 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbe4806ae40 0x7fbe4806d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe64153c70 0x7fbe640b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe64153890 0x7fbe64151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 --2- 172.21.15.96:0/677030143 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbe640ceef0 0x7fbe6414e130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 >> 172.21.15.96:0/677030143 conn(0x7fbe6406ba00 msgr2=0x7fbe64150420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 shutdown_connections 2023-12-01T23:19:05.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.934+0000 7fbe6c17d640 1 -- 172.21.15.96:0/677030143 wait complete. 2023-12-01T23:19:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.936+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc314043910 con 0x7fc328153890 2023-12-01T23:19:05.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.937+0000 7fc3257fa640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 0x7fc30c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.937+0000 7fc32c89c640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 0x7fc30c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.937+0000 7fc32c89c640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 0x7fc30c06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0018b0 tx=0x7fc31c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.943+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc31403e070 con 0x7fc328153890 2023-12-01T23:19:05.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542159 got 60129542159 for osd.2 2023-12-01T23:19:05.946 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:05.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.946+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3738039040 con 0x7f3728003970 2023-12-01T23:19:05.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.947+0000 7f3732ffd640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 0x7f372006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:05.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.947+0000 7f3741a41640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 0x7f372006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:05.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.947+0000 7f3741a41640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 0x7f372006d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f373c15b3d0 tx=0x7f372c007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:05.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.950+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3738079f30 con 0x7f3728003970 2023-12-01T23:19:05.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:05.955+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc314078320 con 0x7fc328153890 2023-12-01T23:19:06.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.026+0000 7f0bc8ff9640 1 -- 172.21.15.96:0/1857356001 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bbc07b890 con 0x7f0bcc071800 2023-12-01T23:19:06.027 INFO:teuthology.orchestra.run.smithi096.stdout:60129542158 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 msgr2=0x7f0bb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 0x7f0bb806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc15d900 tx=0x7f0bc0009190 comp rx=0 tx=0).stop 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 msgr2=0x7f0bcc152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc000c00 tx=0x7f0bbc004730 comp rx=0 tx=0).stop 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 shutdown_connections 2023-12-01T23:19:06.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f0bb806ae70 0x7f0bb806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0bcc0c3fd0 0x7f0bcc1f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0bcc072120 0x7f0bcc1f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 --2- 172.21.15.96:0/1857356001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bcc071800 0x7f0bcc152110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 >> 172.21.15.96:0/1857356001 conn(0x7f0bcc0c8040 msgr2=0x7f0bcc0c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 shutdown_connections 2023-12-01T23:19:06.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.028+0000 7f0bd2264640 1 -- 172.21.15.96:0/1857356001 wait complete. 2023-12-01T23:19:06.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.4 2023-12-01T23:19:06.041 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.143+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc328067500 con 0x7fc328153890 2023-12-01T23:19:06.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.150+0000 7fc3257fa640 1 -- 172.21.15.96:0/2708490093 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc314034090 con 0x7fc328153890 2023-12-01T23:19:06.151 INFO:teuthology.orchestra.run.smithi096.stdout:64424509453 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 msgr2=0x7fc30c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 0x7fc30c06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0018b0 tx=0x7fc31c009040 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 msgr2=0x7fc328200130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 0x7fc328200130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc314033000 tx=0x7fc314004730 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 shutdown_connections 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fc30c06ae40 0x7fc30c06d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc328153c70 0x7fc3280cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc328153890 0x7fc328200130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 --2- 172.21.15.96:0/2708490093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc3280ceef0 0x7fc3281fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 >> 172.21.15.96:0/2708490093 conn(0x7fc32806ba00 msgr2=0x7fc32815c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:06.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 shutdown_connections 2023-12-01T23:19:06.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.152+0000 7fc32eb00640 1 -- 172.21.15.96:0/2708490093 wait complete. 2023-12-01T23:19:06.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509453 got 64424509453 for osd.3 2023-12-01T23:19:06.164 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:06.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.205+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3738076270 con 0x7f3728003970 2023-12-01T23:19:06.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.381+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f373c159770 con 0x7f3728003970 2023-12-01T23:19:06.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.385+0000 7f3732ffd640 1 -- 172.21.15.96:0/1300763078 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f373804d070 con 0x7f3728003970 2023-12-01T23:19:06.386 INFO:teuthology.orchestra.run.smithi096.stdout:64424509454 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 msgr2=0x7f372006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 0x7f372006d380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f373c15b3d0 tx=0x7f372c007990 comp rx=0 tx=0).stop 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 msgr2=0x7f373c14a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3738035040 tx=0x7f37380047d0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 shutdown_connections 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f372006aec0 0x7f372006d380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f373c154630 0x7f373c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f373c152200 0x7f373c1f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 --2- 172.21.15.96:0/1300763078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3728003970 0x7f373c14a7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 >> 172.21.15.96:0/1300763078 conn(0x7f373c06ba00 msgr2=0x7f373c15b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 shutdown_connections 2023-12-01T23:19:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.387+0000 7f37444a6640 1 -- 172.21.15.96:0/1300763078 wait complete. 2023-12-01T23:19:06.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509454 got 64424509454 for osd.0 2023-12-01T23:19:06.399 DEBUG:teuthology.parallel:result is None 2023-12-01T23:19:06.399 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-01T23:19:06.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:19:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 Processor -- start 2023-12-01T23:19:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 -- start start 2023-12-01T23:19:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 0x7fa3c0157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c006f9d0 con 0x7fa3c00c2000 2023-12-01T23:19:06.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c015b9c0 con 0x7fa3c0151630 2023-12-01T23:19:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.500+0000 7fa3c5748640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0158490 con 0x7fa3c006f590 2023-12-01T23:19:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.501+0000 7fa3b7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 0x7fa3c0157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.501+0000 7fa3beffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa3c0151630 0x7fa3c00c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:51644/0 (socket says 172.21.15.96:51644) 2023-12-01T23:19:06.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.501+0000 7fa3beffd640 1 -- 172.21.15.96:0/3365322113 learned_addr learned my addr 172.21.15.96:0/3365322113 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.504+0000 7fa3be7fc640 1 -- 172.21.15.96:0/3365322113 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955693903 0 0) 0x7fa3c015b9c0 con 0x7fa3c0151630 2023-12-01T23:19:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.504+0000 7fa3be7fc640 1 -- 172.21.15.96:0/3365322113 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3ac003520 con 0x7fa3c0151630 2023-12-01T23:19:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.504+0000 7fa3b7fff640 1 -- 172.21.15.96:0/3365322113 >> v1:172.21.15.102:6789/0 conn(0x7fa3c0151630 legacy=0x7fa3c00c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.504+0000 7fa3b7fff640 1 -- 172.21.15.96:0/3365322113 >> v1:172.21.15.96:6789/0 conn(0x7fa3c00c2000 legacy=0x7fa3c00c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.504+0000 7fa3b7fff640 1 -- 172.21.15.96:0/3365322113 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c015ab60 con 0x7fa3c006f590 2023-12-01T23:19:06.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.506+0000 7fa3b7fff640 1 --2- 172.21.15.96:0/3365322113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 0x7fa3c0157f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80097d0 tx=0x7fa3a802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9f388e15f8b9af server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:06.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.508+0000 7fa3be7fc640 1 -- 172.21.15.96:0/3365322113 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8030880 con 0x7fa3c006f590 2023-12-01T23:19:06.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.509+0000 7fa3be7fc640 1 -- 172.21.15.96:0/3365322113 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a80309e0 con 0x7fa3c006f590 2023-12-01T23:19:06.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.509+0000 7fa3be7fc640 1 -- 172.21.15.96:0/3365322113 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8030d50 con 0x7fa3c006f590 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 -- 172.21.15.96:0/3365322113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 msgr2=0x7fa3c0157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 --2- 172.21.15.96:0/3365322113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 0x7fa3c0157f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80097d0 tx=0x7fa3a802b9c0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 -- 172.21.15.96:0/3365322113 shutdown_connections 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 --2- 172.21.15.96:0/3365322113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c006f590 0x7fa3c0157f50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 -- 172.21.15.96:0/3365322113 >> 172.21.15.96:0/3365322113 conn(0x7fa3c0061100 msgr2=0x7fa3c00614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 -- 172.21.15.96:0/3365322113 shutdown_connections 2023-12-01T23:19:06.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.510+0000 7fa3c5748640 1 -- 172.21.15.96:0/3365322113 wait complete. 2023-12-01T23:19:06.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.511+0000 7fa3c5748640 1 Processor -- start 2023-12-01T23:19:06.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.511+0000 7fa3c5748640 1 -- start start 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3c006f590 0x7fa3c00b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00c2000 0x7fa3c00c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01efc30 con 0x7fa3c006f590 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c00b1650 con 0x7fa3c00c2000 2023-12-01T23:19:06.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.512+0000 7fa3c5748640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01eefb0 con 0x7fa3c0151630 2023-12-01T23:19:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.513+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.513+0000 7fa3beffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3c006f590 0x7fa3c00b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.513+0000 7fa3b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00c2000 0x7fa3c00c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.513+0000 7fa3bf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57732/0 (socket says 172.21.15.96:57732) 2023-12-01T23:19:06.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.513+0000 7fa3bf7fe640 1 -- 172.21.15.96:0/2758774236 learned_addr learned my addr 172.21.15.96:0/2758774236 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.516+0000 7fa3bf7fe640 1 -- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00c2000 msgr2=0x7fa3c00c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.516+0000 7fa3bf7fe640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00c2000 0x7fa3c00c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.516+0000 7fa3bf7fe640 1 -- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3c006f590 msgr2=0x7fa3c00b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.516+0000 7fa3bf7fe640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3c006f590 0x7fa3c00b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.516+0000 7fa3bf7fe640 1 -- 172.21.15.96:0/2758774236 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a8009400 con 0x7fa3c0151630 2023-12-01T23:19:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.518+0000 7fa3bf7fe640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c7a0 tx=0x7fa3b800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:06.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.524+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8003b70 con 0x7fa3c0151630 2023-12-01T23:19:06.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.524+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8003cf0 con 0x7fa3c0151630 2023-12-01T23:19:06.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.524+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8003ea0 con 0x7fa3c0151630 2023-12-01T23:19:06.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.524+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c01ef290 con 0x7fa3c0151630 2023-12-01T23:19:06.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.524+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c01ef850 con 0x7fa3c0151630 2023-12-01T23:19:06.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.525+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c01efd70 con 0x7fa3c0151630 2023-12-01T23:19:06.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.768+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3b800aa90 con 0x7fa3c0151630 2023-12-01T23:19:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.769+0000 7fa3b77fe640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 0x7fa3a006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.769+0000 7fa3beffd640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 0x7fa3a006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:06.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.769+0000 7fa3beffd640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 0x7fa3a006d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00011e0 tx=0x7fa3b0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:06.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.773+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3b8058a80 con 0x7fa3c0151630 2023-12-01T23:19:06.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.784+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3b8054dc0 con 0x7fa3c0151630 2023-12-01T23:19:06.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.956+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3c015b400 con 0x7fa3a006ae90 2023-12-01T23:19:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.964+0000 7fa3b77fe640 1 -- 172.21.15.96:0/2758774236 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7fa3b0005850 con 0x7fa3a006ae90 2023-12-01T23:19:06.968 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:06.970 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 msgr2=0x7fa3a006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 0x7fa3a006d350 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00011e0 tx=0x7fa3b0007d30 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 msgr2=0x7fa3c0158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c7a0 tx=0x7fa3b800cc60 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 shutdown_connections 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa3a006ae90 0x7fa3a006d350 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3c0151630 0x7fa3c0158720 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3c00c2000 0x7fa3c00c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 --2- 172.21.15.96:0/2758774236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3c006f590 0x7fa3c00b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 >> 172.21.15.96:0/2758774236 conn(0x7fa3c0061100 msgr2=0x7fa3c0150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 shutdown_connections 2023-12-01T23:19:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:06.967+0000 7fa3c5748640 1 -- 172.21.15.96:0/2758774236 wait complete. 2023-12-01T23:19:06.979 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-12-01T23:19:06.045388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218568,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756152,"statfs":{"total":773094113280,"available":772870299648,"internally_reserved":0,"allocated":2457600,"data_stored":2090854,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12737,"internal_metadata":221236799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.249999"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828324+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:18:34.828324+0000","last_peered":"2023-12-01T23:18:34.828324+0000","last_clean":"2023-12-01T23:18:34.828324+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:18:34.828324+0000","last_undegraded":"2023-12-01T23:18:34.828324+0000","last_fullsized":"2023-12-01T23:18:34.828324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784668+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:18:34.784668+0000","last_peered":"2023-12-01T23:18:34.784668+0000","last_clean":"2023-12-01T23:18:34.784668+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:18:34.784668+0000","last_undegraded":"2023-12-01T23:18:34.784668+0000","last_fullsized":"2023-12-01T23:18:34.784668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866489+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:18:35.866489+0000","last_peered":"2023-12-01T23:18:35.866489+0000","last_clean":"2023-12-01T23:18:35.866489+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:18:35.866489+0000","last_undegraded":"2023-12-01T23:18:35.866489+0000","last_fullsized":"2023-12-01T23:18:35.866489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784751+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:18:34.784751+0000","last_peered":"2023-12-01T23:18:34.784751+0000","last_clean":"2023-12-01T23:18:34.784751+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:18:34.784751+0000","last_undegraded":"2023-12-01T23:18:34.784751+0000","last_fullsized":"2023-12-01T23:18:34.784751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828043+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:18:34.828043+0000","last_peered":"2023-12-01T23:18:34.828043+0000","last_clean":"2023-12-01T23:18:34.828043+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:18:34.828043+0000","last_undegraded":"2023-12-01T23:18:34.828043+0000","last_fullsized":"2023-12-01T23:18:34.828043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245374+0000","last_change":"2023-12-01T23:18:34.787052+0000","last_active":"2023-12-01T23:18:36.245374+0000","last_peered":"2023-12-01T23:18:36.245374+0000","last_clean":"2023-12-01T23:18:36.245374+0000","last_became_active":"2023-12-01T23:18:34.786671+0000","last_became_peered":"2023-12-01T23:18:34.786671+0000","last_unstale":"2023-12-01T23:18:36.245374+0000","last_undegraded":"2023-12-01T23:18:36.245374+0000","last_fullsized":"2023-12-01T23:18:36.245374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:31.773956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759098+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:18:34.759098+0000","last_peered":"2023-12-01T23:18:34.759098+0000","last_clean":"2023-12-01T23:18:34.759098+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:18:34.759098+0000","last_undegraded":"2023-12-01T23:18:34.759098+0000","last_fullsized":"2023-12-01T23:18:34.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785886+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:18:34.785886+0000","last_peered":"2023-12-01T23:18:34.785886+0000","last_clean":"2023-12-01T23:18:34.785886+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:18:34.785886+0000","last_undegraded":"2023-12-01T23:18:34.785886+0000","last_fullsized":"2023-12-01T23:18:34.785886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245809+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:18:36.245809+0000","last_peered":"2023-12-01T23:18:36.245809+0000","last_clean":"2023-12-01T23:18:36.245809+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:18:36.245809+0000","last_undegraded":"2023-12-01T23:18:36.245809+0000","last_fullsized":"2023-12-01T23:18:36.245809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759053+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:18:34.759053+0000","last_peered":"2023-12-01T23:18:34.759053+0000","last_clean":"2023-12-01T23:18:34.759053+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:18:34.759053+0000","last_undegraded":"2023-12-01T23:18:34.759053+0000","last_fullsized":"2023-12-01T23:18:34.759053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786203+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:18:34.786203+0000","last_peered":"2023-12-01T23:18:34.786203+0000","last_clean":"2023-12-01T23:18:34.786203+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:18:34.786203+0000","last_undegraded":"2023-12-01T23:18:34.786203+0000","last_fullsized":"2023-12-01T23:18:34.786203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245949+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:18:36.245949+0000","last_peered":"2023-12-01T23:18:36.245949+0000","last_clean":"2023-12-01T23:18:36.245949+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:18:36.245949+0000","last_undegraded":"2023-12-01T23:18:36.245949+0000","last_fullsized":"2023-12-01T23:18:36.245949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759109+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:18:34.759109+0000","last_peered":"2023-12-01T23:18:34.759109+0000","last_clean":"2023-12-01T23:18:34.759109+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:18:34.759109+0000","last_undegraded":"2023-12-01T23:18:34.759109+0000","last_fullsized":"2023-12-01T23:18:34.759109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245916+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:18:36.245916+0000","last_peered":"2023-12-01T23:18:36.245916+0000","last_clean":"2023-12-01T23:18:36.245916+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:18:36.245916+0000","last_undegraded":"2023-12-01T23:18:36.245916+0000","last_fullsized":"2023-12-01T23:18:36.245916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784022+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:18:34.784022+0000","last_peered":"2023-12-01T23:18:34.784022+0000","last_clean":"2023-12-01T23:18:34.784022+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:18:34.784022+0000","last_undegraded":"2023-12-01T23:18:34.784022+0000","last_fullsized":"2023-12-01T23:18:34.784022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768545+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:18:34.768545+0000","last_peered":"2023-12-01T23:18:34.768545+0000","last_clean":"2023-12-01T23:18:34.768545+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:18:34.768545+0000","last_undegraded":"2023-12-01T23:18:34.768545+0000","last_fullsized":"2023-12-01T23:18:34.768545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246329+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:18:36.246329+0000","last_peered":"2023-12-01T23:18:36.246329+0000","last_clean":"2023-12-01T23:18:36.246329+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:18:36.246329+0000","last_undegraded":"2023-12-01T23:18:36.246329+0000","last_fullsized":"2023-12-01T23:18:36.246329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783932+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:18:34.783932+0000","last_peered":"2023-12-01T23:18:34.783932+0000","last_clean":"2023-12-01T23:18:34.783932+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:18:34.783932+0000","last_undegraded":"2023-12-01T23:18:34.783932+0000","last_fullsized":"2023-12-01T23:18:34.783932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767868+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:18:34.767868+0000","last_peered":"2023-12-01T23:18:34.767868+0000","last_clean":"2023-12-01T23:18:34.767868+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:18:34.767868+0000","last_undegraded":"2023-12-01T23:18:34.767868+0000","last_fullsized":"2023-12-01T23:18:34.767868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856617+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:18:35.856617+0000","last_peered":"2023-12-01T23:18:35.856617+0000","last_clean":"2023-12-01T23:18:35.856617+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:18:35.856617+0000","last_undegraded":"2023-12-01T23:18:35.856617+0000","last_fullsized":"2023-12-01T23:18:35.856617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777575+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:18:34.777575+0000","last_peered":"2023-12-01T23:18:34.777575+0000","last_clean":"2023-12-01T23:18:34.777575+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:18:34.777575+0000","last_undegraded":"2023-12-01T23:18:34.777575+0000","last_fullsized":"2023-12-01T23:18:34.777575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758714+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:18:34.758714+0000","last_peered":"2023-12-01T23:18:34.758714+0000","last_clean":"2023-12-01T23:18:34.758714+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:18:34.758714+0000","last_undegraded":"2023-12-01T23:18:34.758714+0000","last_fullsized":"2023-12-01T23:18:34.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245493+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:18:36.245493+0000","last_peered":"2023-12-01T23:18:36.245493+0000","last_clean":"2023-12-01T23:18:36.245493+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:18:36.245493+0000","last_undegraded":"2023-12-01T23:18:36.245493+0000","last_fullsized":"2023-12-01T23:18:36.245493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829303+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:18:34.829303+0000","last_peered":"2023-12-01T23:18:34.829303+0000","last_clean":"2023-12-01T23:18:34.829303+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:18:34.829303+0000","last_undegraded":"2023-12-01T23:18:34.829303+0000","last_fullsized":"2023-12-01T23:18:34.829303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753914+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:18:34.753914+0000","last_peered":"2023-12-01T23:18:34.753914+0000","last_clean":"2023-12-01T23:18:34.753914+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:18:34.753914+0000","last_undegraded":"2023-12-01T23:18:34.753914+0000","last_fullsized":"2023-12-01T23:18:34.753914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246240+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:18:36.246240+0000","last_peered":"2023-12-01T23:18:36.246240+0000","last_clean":"2023-12-01T23:18:36.246240+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:18:36.246240+0000","last_undegraded":"2023-12-01T23:18:36.246240+0000","last_fullsized":"2023-12-01T23:18:36.246240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784985+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:18:34.784985+0000","last_peered":"2023-12-01T23:18:34.784985+0000","last_clean":"2023-12-01T23:18:34.784985+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:18:34.784985+0000","last_undegraded":"2023-12-01T23:18:34.784985+0000","last_fullsized":"2023-12-01T23:18:34.784985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.732271+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:18:35.732271+0000","last_peered":"2023-12-01T23:18:35.732271+0000","last_clean":"2023-12-01T23:18:35.732271+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:18:35.732271+0000","last_undegraded":"2023-12-01T23:18:35.732271+0000","last_fullsized":"2023-12-01T23:18:35.732271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866421+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:18:35.866421+0000","last_peered":"2023-12-01T23:18:35.866421+0000","last_clean":"2023-12-01T23:18:35.866421+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:18:35.866421+0000","last_undegraded":"2023-12-01T23:18:35.866421+0000","last_fullsized":"2023-12-01T23:18:35.866421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768150+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:18:34.768150+0000","last_peered":"2023-12-01T23:18:34.768150+0000","last_clean":"2023-12-01T23:18:34.768150+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:18:34.768150+0000","last_undegraded":"2023-12-01T23:18:34.768150+0000","last_fullsized":"2023-12-01T23:18:34.768150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759244+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:18:34.759244+0000","last_peered":"2023-12-01T23:18:34.759244+0000","last_clean":"2023-12-01T23:18:34.759244+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:18:34.759244+0000","last_undegraded":"2023-12-01T23:18:34.759244+0000","last_fullsized":"2023-12-01T23:18:34.759244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245847+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:18:36.245847+0000","last_peered":"2023-12-01T23:18:36.245847+0000","last_clean":"2023-12-01T23:18:36.245847+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:18:36.245847+0000","last_undegraded":"2023-12-01T23:18:36.245847+0000","last_fullsized":"2023-12-01T23:18:36.245847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786277+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:18:34.786277+0000","last_peered":"2023-12-01T23:18:34.786277+0000","last_clean":"2023-12-01T23:18:34.786277+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:18:34.786277+0000","last_undegraded":"2023-12-01T23:18:34.786277+0000","last_fullsized":"2023-12-01T23:18:34.786277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768227+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:18:34.768227+0000","last_peered":"2023-12-01T23:18:34.768227+0000","last_clean":"2023-12-01T23:18:34.768227+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:18:34.768227+0000","last_undegraded":"2023-12-01T23:18:34.768227+0000","last_fullsized":"2023-12-01T23:18:34.768227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856126+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:18:35.856126+0000","last_peered":"2023-12-01T23:18:35.856126+0000","last_clean":"2023-12-01T23:18:35.856126+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:18:35.856126+0000","last_undegraded":"2023-12-01T23:18:35.856126+0000","last_fullsized":"2023-12-01T23:18:35.856126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778077+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:18:34.778077+0000","last_peered":"2023-12-01T23:18:34.778077+0000","last_clean":"2023-12-01T23:18:34.778077+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:18:34.778077+0000","last_undegraded":"2023-12-01T23:18:34.778077+0000","last_fullsized":"2023-12-01T23:18:34.778077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786794+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:18:34.786794+0000","last_peered":"2023-12-01T23:18:34.786794+0000","last_clean":"2023-12-01T23:18:34.786794+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:18:34.786794+0000","last_undegraded":"2023-12-01T23:18:34.786794+0000","last_fullsized":"2023-12-01T23:18:34.786794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856624+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:18:35.856624+0000","last_peered":"2023-12-01T23:18:35.856624+0000","last_clean":"2023-12-01T23:18:35.856624+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:18:35.856624+0000","last_undegraded":"2023-12-01T23:18:35.856624+0000","last_fullsized":"2023-12-01T23:18:35.856624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767757+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:18:34.767757+0000","last_peered":"2023-12-01T23:18:34.767757+0000","last_clean":"2023-12-01T23:18:34.767757+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:18:34.767757+0000","last_undegraded":"2023-12-01T23:18:34.767757+0000","last_fullsized":"2023-12-01T23:18:34.767757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830640+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:18:34.830640+0000","last_peered":"2023-12-01T23:18:34.830640+0000","last_clean":"2023-12-01T23:18:34.830640+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:18:34.830640+0000","last_undegraded":"2023-12-01T23:18:34.830640+0000","last_fullsized":"2023-12-01T23:18:34.830640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856610+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:18:35.856610+0000","last_peered":"2023-12-01T23:18:35.856610+0000","last_clean":"2023-12-01T23:18:35.856610+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:18:35.856610+0000","last_undegraded":"2023-12-01T23:18:35.856610+0000","last_fullsized":"2023-12-01T23:18:35.856610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827686+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:18:34.827686+0000","last_peered":"2023-12-01T23:18:34.827686+0000","last_clean":"2023-12-01T23:18:34.827686+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:18:34.827686+0000","last_undegraded":"2023-12-01T23:18:34.827686+0000","last_fullsized":"2023-12-01T23:18:34.827686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758788+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:18:34.758788+0000","last_peered":"2023-12-01T23:18:34.758788+0000","last_clean":"2023-12-01T23:18:34.758788+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:18:34.758788+0000","last_undegraded":"2023-12-01T23:18:34.758788+0000","last_fullsized":"2023-12-01T23:18:34.758788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245861+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:18:36.245861+0000","last_peered":"2023-12-01T23:18:36.245861+0000","last_clean":"2023-12-01T23:18:36.245861+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:18:36.245861+0000","last_undegraded":"2023-12-01T23:18:36.245861+0000","last_fullsized":"2023-12-01T23:18:36.245861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783998+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:18:34.783998+0000","last_peered":"2023-12-01T23:18:34.783998+0000","last_clean":"2023-12-01T23:18:34.783998+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:18:34.783998+0000","last_undegraded":"2023-12-01T23:18:34.783998+0000","last_fullsized":"2023-12-01T23:18:34.783998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785908+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:18:34.785908+0000","last_peered":"2023-12-01T23:18:34.785908+0000","last_clean":"2023-12-01T23:18:34.785908+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:18:34.785908+0000","last_undegraded":"2023-12-01T23:18:34.785908+0000","last_fullsized":"2023-12-01T23:18:34.785908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758870+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:18:34.758870+0000","last_peered":"2023-12-01T23:18:34.758870+0000","last_clean":"2023-12-01T23:18:34.758870+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:18:34.758870+0000","last_undegraded":"2023-12-01T23:18:34.758870+0000","last_fullsized":"2023-12-01T23:18:34.758870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246489+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:18:36.246489+0000","last_peered":"2023-12-01T23:18:36.246489+0000","last_clean":"2023-12-01T23:18:36.246489+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:18:36.246489+0000","last_undegraded":"2023-12-01T23:18:36.246489+0000","last_fullsized":"2023-12-01T23:18:36.246489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758994+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:18:34.758994+0000","last_peered":"2023-12-01T23:18:34.758994+0000","last_clean":"2023-12-01T23:18:34.758994+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:18:34.758994+0000","last_undegraded":"2023-12-01T23:18:34.758994+0000","last_fullsized":"2023-12-01T23:18:34.758994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830694+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:18:34.830694+0000","last_peered":"2023-12-01T23:18:34.830694+0000","last_clean":"2023-12-01T23:18:34.830694+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:18:34.830694+0000","last_undegraded":"2023-12-01T23:18:34.830694+0000","last_fullsized":"2023-12-01T23:18:34.830694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246217+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:18:36.246217+0000","last_peered":"2023-12-01T23:18:36.246217+0000","last_clean":"2023-12-01T23:18:36.246217+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:18:36.246217+0000","last_undegraded":"2023-12-01T23:18:36.246217+0000","last_fullsized":"2023-12-01T23:18:36.246217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785964+0000","last_change":"2023-12-01T23:18:28.873819+0000","last_active":"2023-12-01T23:18:34.785964+0000","last_peered":"2023-12-01T23:18:34.785964+0000","last_clean":"2023-12-01T23:18:34.785964+0000","last_became_active":"2023-12-01T23:18:28.872949+0000","last_became_peered":"2023-12-01T23:18:28.872949+0000","last_unstale":"2023-12-01T23:18:34.785964+0000","last_undegraded":"2023-12-01T23:18:34.785964+0000","last_fullsized":"2023-12-01T23:18:34.785964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768052+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:18:34.768052+0000","last_peered":"2023-12-01T23:18:34.768052+0000","last_clean":"2023-12-01T23:18:34.768052+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:18:34.768052+0000","last_undegraded":"2023-12-01T23:18:34.768052+0000","last_fullsized":"2023-12-01T23:18:34.768052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245798+0000","last_change":"2023-12-01T23:18:34.834125+0000","last_active":"2023-12-01T23:18:36.245798+0000","last_peered":"2023-12-01T23:18:36.245798+0000","last_clean":"2023-12-01T23:18:36.245798+0000","last_became_active":"2023-12-01T23:18:34.833739+0000","last_became_peered":"2023-12-01T23:18:34.833739+0000","last_unstale":"2023-12-01T23:18:36.245798+0000","last_undegraded":"2023-12-01T23:18:36.245798+0000","last_fullsized":"2023-12-01T23:18:36.245798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:04.156636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759250+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:18:34.759250+0000","last_peered":"2023-12-01T23:18:34.759250+0000","last_clean":"2023-12-01T23:18:34.759250+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:18:34.759250+0000","last_undegraded":"2023-12-01T23:18:34.759250+0000","last_fullsized":"2023-12-01T23:18:34.759250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830583+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:18:34.830583+0000","last_peered":"2023-12-01T23:18:34.830583+0000","last_clean":"2023-12-01T23:18:34.830583+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:18:34.830583+0000","last_undegraded":"2023-12-01T23:18:34.830583+0000","last_fullsized":"2023-12-01T23:18:34.830583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245379+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:18:36.245379+0000","last_peered":"2023-12-01T23:18:36.245379+0000","last_clean":"2023-12-01T23:18:36.245379+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:18:36.245379+0000","last_undegraded":"2023-12-01T23:18:36.245379+0000","last_fullsized":"2023-12-01T23:18:36.245379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759012+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.759012+0000","last_peered":"2023-12-01T23:18:34.759012+0000","last_clean":"2023-12-01T23:18:34.759012+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:18:34.759012+0000","last_undegraded":"2023-12-01T23:18:34.759012+0000","last_fullsized":"2023-12-01T23:18:34.759012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778257+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:18:34.778257+0000","last_peered":"2023-12-01T23:18:34.778257+0000","last_clean":"2023-12-01T23:18:34.778257+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:18:34.778257+0000","last_undegraded":"2023-12-01T23:18:34.778257+0000","last_fullsized":"2023-12-01T23:18:34.778257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245873+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:18:36.245873+0000","last_peered":"2023-12-01T23:18:36.245873+0000","last_clean":"2023-12-01T23:18:36.245873+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:18:36.245873+0000","last_undegraded":"2023-12-01T23:18:36.245873+0000","last_fullsized":"2023-12-01T23:18:36.245873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758841+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:18:34.758841+0000","last_peered":"2023-12-01T23:18:34.758841+0000","last_clean":"2023-12-01T23:18:34.758841+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:18:34.758841+0000","last_undegraded":"2023-12-01T23:18:34.758841+0000","last_fullsized":"2023-12-01T23:18:34.758841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827350+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:18:34.827350+0000","last_peered":"2023-12-01T23:18:34.827350+0000","last_clean":"2023-12-01T23:18:34.827350+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:18:34.827350+0000","last_undegraded":"2023-12-01T23:18:34.827350+0000","last_fullsized":"2023-12-01T23:18:34.827350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245779+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:18:36.245779+0000","last_peered":"2023-12-01T23:18:36.245779+0000","last_clean":"2023-12-01T23:18:36.245779+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:18:36.245779+0000","last_undegraded":"2023-12-01T23:18:36.245779+0000","last_fullsized":"2023-12-01T23:18:36.245779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753529+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:18:34.753529+0000","last_peered":"2023-12-01T23:18:34.753529+0000","last_clean":"2023-12-01T23:18:34.753529+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:18:34.753529+0000","last_undegraded":"2023-12-01T23:18:34.753529+0000","last_fullsized":"2023-12-01T23:18:34.753529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867099+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:18:35.867099+0000","last_peered":"2023-12-01T23:18:35.867099+0000","last_clean":"2023-12-01T23:18:35.867099+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:18:35.867099+0000","last_undegraded":"2023-12-01T23:18:35.867099+0000","last_fullsized":"2023-12-01T23:18:35.867099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759024+0000","last_change":"2023-12-01T23:18:28.872268+0000","last_active":"2023-12-01T23:18:34.759024+0000","last_peered":"2023-12-01T23:18:34.759024+0000","last_clean":"2023-12-01T23:18:34.759024+0000","last_became_active":"2023-12-01T23:18:28.872020+0000","last_became_peered":"2023-12-01T23:18:28.872020+0000","last_unstale":"2023-12-01T23:18:34.759024+0000","last_undegraded":"2023-12-01T23:18:34.759024+0000","last_fullsized":"2023-12-01T23:18:34.759024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786751+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:18:34.786751+0000","last_peered":"2023-12-01T23:18:34.786751+0000","last_clean":"2023-12-01T23:18:34.786751+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:18:34.786751+0000","last_undegraded":"2023-12-01T23:18:34.786751+0000","last_fullsized":"2023-12-01T23:18:34.786751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866861+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:18:35.866861+0000","last_peered":"2023-12-01T23:18:35.866861+0000","last_clean":"2023-12-01T23:18:35.866861+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:18:35.866861+0000","last_undegraded":"2023-12-01T23:18:35.866861+0000","last_fullsized":"2023-12-01T23:18:35.866861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828897+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:18:34.828897+0000","last_peered":"2023-12-01T23:18:34.828897+0000","last_clean":"2023-12-01T23:18:34.828897+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:18:34.828897+0000","last_undegraded":"2023-12-01T23:18:34.828897+0000","last_fullsized":"2023-12-01T23:18:34.828897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829997+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:18:34.829997+0000","last_peered":"2023-12-01T23:18:34.829997+0000","last_clean":"2023-12-01T23:18:34.829997+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:18:34.829997+0000","last_undegraded":"2023-12-01T23:18:34.829997+0000","last_fullsized":"2023-12-01T23:18:34.829997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246916+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:18:36.246916+0000","last_peered":"2023-12-01T23:18:36.246916+0000","last_clean":"2023-12-01T23:18:36.246916+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:18:36.246916+0000","last_undegraded":"2023-12-01T23:18:36.246916+0000","last_fullsized":"2023-12-01T23:18:36.246916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758889+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:18:34.758889+0000","last_peered":"2023-12-01T23:18:34.758889+0000","last_clean":"2023-12-01T23:18:34.758889+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:18:34.758889+0000","last_undegraded":"2023-12-01T23:18:34.758889+0000","last_fullsized":"2023-12-01T23:18:34.758889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:44.926031+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:18:44.926031+0000","last_peered":"2023-12-01T23:18:44.926031+0000","last_clean":"2023-12-01T23:18:44.926031+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:18:44.926031+0000","last_undegraded":"2023-12-01T23:18:44.926031+0000","last_fullsized":"2023-12-01T23:18:44.926031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856252+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:18:35.856252+0000","last_peered":"2023-12-01T23:18:35.856252+0000","last_clean":"2023-12-01T23:18:35.856252+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:18:35.856252+0000","last_undegraded":"2023-12-01T23:18:35.856252+0000","last_fullsized":"2023-12-01T23:18:35.856252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778209+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:18:34.778209+0000","last_peered":"2023-12-01T23:18:34.778209+0000","last_clean":"2023-12-01T23:18:34.778209+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:18:34.778209+0000","last_undegraded":"2023-12-01T23:18:34.778209+0000","last_fullsized":"2023-12-01T23:18:34.778209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767988+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:18:34.767988+0000","last_peered":"2023-12-01T23:18:34.767988+0000","last_clean":"2023-12-01T23:18:34.767988+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:18:34.767988+0000","last_undegraded":"2023-12-01T23:18:34.767988+0000","last_fullsized":"2023-12-01T23:18:34.767988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245639+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:18:36.245639+0000","last_peered":"2023-12-01T23:18:36.245639+0000","last_clean":"2023-12-01T23:18:36.245639+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:18:36.245639+0000","last_undegraded":"2023-12-01T23:18:36.245639+0000","last_fullsized":"2023-12-01T23:18:36.245639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828158+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:18:34.828158+0000","last_peered":"2023-12-01T23:18:34.828158+0000","last_clean":"2023-12-01T23:18:34.828158+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:18:34.828158+0000","last_undegraded":"2023-12-01T23:18:34.828158+0000","last_fullsized":"2023-12-01T23:18:34.828158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786608+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:18:34.786608+0000","last_peered":"2023-12-01T23:18:34.786608+0000","last_clean":"2023-12-01T23:18:34.786608+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:18:34.786608+0000","last_undegraded":"2023-12-01T23:18:34.786608+0000","last_fullsized":"2023-12-01T23:18:34.786608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866572+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:18:35.866572+0000","last_peered":"2023-12-01T23:18:35.866572+0000","last_clean":"2023-12-01T23:18:35.866572+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:18:35.866572+0000","last_undegraded":"2023-12-01T23:18:35.866572+0000","last_fullsized":"2023-12-01T23:18:35.866572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786471+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:18:34.786471+0000","last_peered":"2023-12-01T23:18:34.786471+0000","last_clean":"2023-12-01T23:18:34.786471+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:18:34.786471+0000","last_undegraded":"2023-12-01T23:18:34.786471+0000","last_fullsized":"2023-12-01T23:18:34.786471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753827+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:18:34.753827+0000","last_peered":"2023-12-01T23:18:34.753827+0000","last_clean":"2023-12-01T23:18:34.753827+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:18:34.753827+0000","last_undegraded":"2023-12-01T23:18:34.753827+0000","last_fullsized":"2023-12-01T23:18:34.753827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866532+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:18:35.866532+0000","last_peered":"2023-12-01T23:18:35.866532+0000","last_clean":"2023-12-01T23:18:35.866532+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:18:35.866532+0000","last_undegraded":"2023-12-01T23:18:35.866532+0000","last_fullsized":"2023-12-01T23:18:35.866532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245667+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:18:36.245667+0000","last_peered":"2023-12-01T23:18:36.245667+0000","last_clean":"2023-12-01T23:18:36.245667+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:18:36.245667+0000","last_undegraded":"2023-12-01T23:18:36.245667+0000","last_fullsized":"2023-12-01T23:18:36.245667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767701+0000","last_change":"2023-12-01T23:18:28.821615+0000","last_active":"2023-12-01T23:18:34.767701+0000","last_peered":"2023-12-01T23:18:34.767701+0000","last_clean":"2023-12-01T23:18:34.767701+0000","last_became_active":"2023-12-01T23:18:28.821335+0000","last_became_peered":"2023-12-01T23:18:28.821335+0000","last_unstale":"2023-12-01T23:18:34.767701+0000","last_undegraded":"2023-12-01T23:18:34.767701+0000","last_fullsized":"2023-12-01T23:18:34.767701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787322+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:18:34.787322+0000","last_peered":"2023-12-01T23:18:34.787322+0000","last_clean":"2023-12-01T23:18:34.787322+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:18:34.787322+0000","last_undegraded":"2023-12-01T23:18:34.787322+0000","last_fullsized":"2023-12-01T23:18:34.787322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246556+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:18:36.246556+0000","last_peered":"2023-12-01T23:18:36.246556+0000","last_clean":"2023-12-01T23:18:36.246556+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:18:36.246556+0000","last_undegraded":"2023-12-01T23:18:36.246556+0000","last_fullsized":"2023-12-01T23:18:36.246556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784060+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:18:34.784060+0000","last_peered":"2023-12-01T23:18:34.784060+0000","last_clean":"2023-12-01T23:18:34.784060+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:18:34.784060+0000","last_undegraded":"2023-12-01T23:18:34.784060+0000","last_fullsized":"2023-12-01T23:18:34.784060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784195+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:18:34.784195+0000","last_peered":"2023-12-01T23:18:34.784195+0000","last_clean":"2023-12-01T23:18:34.784195+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:18:34.784195+0000","last_undegraded":"2023-12-01T23:18:34.784195+0000","last_fullsized":"2023-12-01T23:18:34.784195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753679+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:18:34.753679+0000","last_peered":"2023-12-01T23:18:34.753679+0000","last_clean":"2023-12-01T23:18:34.753679+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:18:34.753679+0000","last_undegraded":"2023-12-01T23:18:34.753679+0000","last_fullsized":"2023-12-01T23:18:34.753679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830120+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:18:34.830120+0000","last_peered":"2023-12-01T23:18:34.830120+0000","last_clean":"2023-12-01T23:18:34.830120+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:18:34.830120+0000","last_undegraded":"2023-12-01T23:18:34.830120+0000","last_fullsized":"2023-12-01T23:18:34.830120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245476+0000","last_change":"2023-12-01T23:18:34.837693+0000","last_active":"2023-12-01T23:18:36.245476+0000","last_peered":"2023-12-01T23:18:36.245476+0000","last_clean":"2023-12-01T23:18:36.245476+0000","last_became_active":"2023-12-01T23:18:34.837313+0000","last_became_peered":"2023-12-01T23:18:34.837313+0000","last_unstale":"2023-12-01T23:18:36.245476+0000","last_undegraded":"2023-12-01T23:18:36.245476+0000","last_fullsized":"2023-12-01T23:18:36.245476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:26.160117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784206+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:18:34.784206+0000","last_peered":"2023-12-01T23:18:34.784206+0000","last_clean":"2023-12-01T23:18:34.784206+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:18:34.784206+0000","last_undegraded":"2023-12-01T23:18:34.784206+0000","last_fullsized":"2023-12-01T23:18:34.784206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777604+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:18:34.777604+0000","last_peered":"2023-12-01T23:18:34.777604+0000","last_clean":"2023-12-01T23:18:34.777604+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:18:34.777604+0000","last_undegraded":"2023-12-01T23:18:34.777604+0000","last_fullsized":"2023-12-01T23:18:34.777604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867004+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:18:35.867004+0000","last_peered":"2023-12-01T23:18:35.867004+0000","last_clean":"2023-12-01T23:18:35.867004+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:18:35.867004+0000","last_undegraded":"2023-12-01T23:18:35.867004+0000","last_fullsized":"2023-12-01T23:18:35.867004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753650+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:18:34.753650+0000","last_peered":"2023-12-01T23:18:34.753650+0000","last_clean":"2023-12-01T23:18:34.753650+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:18:34.753650+0000","last_undegraded":"2023-12-01T23:18:34.753650+0000","last_fullsized":"2023-12-01T23:18:34.753650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830553+0000","last_change":"2023-12-01T23:18:28.878753+0000","last_active":"2023-12-01T23:18:34.830553+0000","last_peered":"2023-12-01T23:18:34.830553+0000","last_clean":"2023-12-01T23:18:34.830553+0000","last_became_active":"2023-12-01T23:18:28.878547+0000","last_became_peered":"2023-12-01T23:18:28.878547+0000","last_unstale":"2023-12-01T23:18:34.830553+0000","last_undegraded":"2023-12-01T23:18:34.830553+0000","last_fullsized":"2023-12-01T23:18:34.830553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786682+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:18:34.786682+0000","last_peered":"2023-12-01T23:18:34.786682+0000","last_clean":"2023-12-01T23:18:34.786682+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:18:34.786682+0000","last_undegraded":"2023-12-01T23:18:34.786682+0000","last_fullsized":"2023-12-01T23:18:34.786682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829191+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:18:34.829191+0000","last_peered":"2023-12-01T23:18:34.829191+0000","last_clean":"2023-12-01T23:18:34.829191+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:18:34.829191+0000","last_undegraded":"2023-12-01T23:18:34.829191+0000","last_fullsized":"2023-12-01T23:18:34.829191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784569+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:18:34.784569+0000","last_peered":"2023-12-01T23:18:34.784569+0000","last_clean":"2023-12-01T23:18:34.784569+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:18:34.784569+0000","last_undegraded":"2023-12-01T23:18:34.784569+0000","last_fullsized":"2023-12-01T23:18:34.784569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767962+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:18:34.767962+0000","last_peered":"2023-12-01T23:18:34.767962+0000","last_clean":"2023-12-01T23:18:34.767962+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:18:34.767962+0000","last_undegraded":"2023-12-01T23:18:34.767962+0000","last_fullsized":"2023-12-01T23:18:34.767962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753917+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:18:34.753917+0000","last_peered":"2023-12-01T23:18:34.753917+0000","last_clean":"2023-12-01T23:18:34.753917+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:18:34.753917+0000","last_undegraded":"2023-12-01T23:18:34.753917+0000","last_fullsized":"2023-12-01T23:18:34.753917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784917+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:18:34.784917+0000","last_peered":"2023-12-01T23:18:34.784917+0000","last_clean":"2023-12-01T23:18:34.784917+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:18:34.784917+0000","last_undegraded":"2023-12-01T23:18:34.784917+0000","last_fullsized":"2023-12-01T23:18:34.784917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787245+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:18:34.787245+0000","last_peered":"2023-12-01T23:18:34.787245+0000","last_clean":"2023-12-01T23:18:34.787245+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:18:34.787245+0000","last_undegraded":"2023-12-01T23:18:34.787245+0000","last_fullsized":"2023-12-01T23:18:34.787245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784036+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:18:34.784036+0000","last_peered":"2023-12-01T23:18:34.784036+0000","last_clean":"2023-12-01T23:18:34.784036+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:18:34.784036+0000","last_undegraded":"2023-12-01T23:18:34.784036+0000","last_fullsized":"2023-12-01T23:18:34.784036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786612+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:18:34.786612+0000","last_peered":"2023-12-01T23:18:34.786612+0000","last_clean":"2023-12-01T23:18:34.786612+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:18:34.786612+0000","last_undegraded":"2023-12-01T23:18:34.786612+0000","last_fullsized":"2023-12-01T23:18:34.786612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828033+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:18:34.828033+0000","last_peered":"2023-12-01T23:18:34.828033+0000","last_clean":"2023-12-01T23:18:34.828033+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:18:34.828033+0000","last_undegraded":"2023-12-01T23:18:34.828033+0000","last_fullsized":"2023-12-01T23:18:34.828033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753755+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:18:34.753755+0000","last_peered":"2023-12-01T23:18:34.753755+0000","last_clean":"2023-12-01T23:18:34.753755+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:18:34.753755+0000","last_undegraded":"2023-12-01T23:18:34.753755+0000","last_fullsized":"2023-12-01T23:18:34.753755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759182+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:18:34.759182+0000","last_peered":"2023-12-01T23:18:34.759182+0000","last_clean":"2023-12-01T23:18:34.759182+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:18:34.759182+0000","last_undegraded":"2023-12-01T23:18:34.759182+0000","last_fullsized":"2023-12-01T23:18:34.759182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830476+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:18:34.830476+0000","last_peered":"2023-12-01T23:18:34.830476+0000","last_clean":"2023-12-01T23:18:34.830476+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:18:34.830476+0000","last_undegraded":"2023-12-01T23:18:34.830476+0000","last_fullsized":"2023-12-01T23:18:34.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786114+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:18:34.786114+0000","last_peered":"2023-12-01T23:18:34.786114+0000","last_clean":"2023-12-01T23:18:34.786114+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:18:34.786114+0000","last_undegraded":"2023-12-01T23:18:34.786114+0000","last_fullsized":"2023-12-01T23:18:34.786114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787165+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:18:34.787165+0000","last_peered":"2023-12-01T23:18:34.787165+0000","last_clean":"2023-12-01T23:18:34.787165+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:18:34.787165+0000","last_undegraded":"2023-12-01T23:18:34.787165+0000","last_fullsized":"2023-12-01T23:18:34.787165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767905+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:18:34.767905+0000","last_peered":"2023-12-01T23:18:34.767905+0000","last_clean":"2023-12-01T23:18:34.767905+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:18:34.767905+0000","last_undegraded":"2023-12-01T23:18:34.767905+0000","last_fullsized":"2023-12-01T23:18:34.767905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828817+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:18:34.828817+0000","last_peered":"2023-12-01T23:18:34.828817+0000","last_clean":"2023-12-01T23:18:34.828817+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:18:34.828817+0000","last_undegraded":"2023-12-01T23:18:34.828817+0000","last_fullsized":"2023-12-01T23:18:34.828817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784004+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:18:34.784004+0000","last_peered":"2023-12-01T23:18:34.784004+0000","last_clean":"2023-12-01T23:18:34.784004+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:18:34.784004+0000","last_undegraded":"2023-12-01T23:18:34.784004+0000","last_fullsized":"2023-12-01T23:18:34.784004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778132+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:18:34.778132+0000","last_peered":"2023-12-01T23:18:34.778132+0000","last_clean":"2023-12-01T23:18:34.778132+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:18:34.778132+0000","last_undegraded":"2023-12-01T23:18:34.778132+0000","last_fullsized":"2023-12-01T23:18:34.778132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753984+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:18:34.753984+0000","last_peered":"2023-12-01T23:18:34.753984+0000","last_clean":"2023-12-01T23:18:34.753984+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:18:34.753984+0000","last_undegraded":"2023-12-01T23:18:34.753984+0000","last_fullsized":"2023-12-01T23:18:34.753984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753831+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:18:34.753831+0000","last_peered":"2023-12-01T23:18:34.753831+0000","last_clean":"2023-12-01T23:18:34.753831+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:18:34.753831+0000","last_undegraded":"2023-12-01T23:18:34.753831+0000","last_fullsized":"2023-12-01T23:18:34.753831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759179+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:18:34.759179+0000","last_peered":"2023-12-01T23:18:34.759179+0000","last_clean":"2023-12-01T23:18:34.759179+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:18:34.759179+0000","last_undegraded":"2023-12-01T23:18:34.759179+0000","last_fullsized":"2023-12-01T23:18:34.759179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783732+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:18:34.783732+0000","last_peered":"2023-12-01T23:18:34.783732+0000","last_clean":"2023-12-01T23:18:34.783732+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:18:34.783732+0000","last_undegraded":"2023-12-01T23:18:34.783732+0000","last_fullsized":"2023-12-01T23:18:34.783732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758745+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:18:34.758745+0000","last_peered":"2023-12-01T23:18:34.758745+0000","last_clean":"2023-12-01T23:18:34.758745+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:18:34.758745+0000","last_undegraded":"2023-12-01T23:18:34.758745+0000","last_fullsized":"2023-12-01T23:18:34.758745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786541+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:18:34.786541+0000","last_peered":"2023-12-01T23:18:34.786541+0000","last_clean":"2023-12-01T23:18:34.786541+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:18:34.786541+0000","last_undegraded":"2023-12-01T23:18:34.786541+0000","last_fullsized":"2023-12-01T23:18:34.786541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758959+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:18:34.758959+0000","last_peered":"2023-12-01T23:18:34.758959+0000","last_clean":"2023-12-01T23:18:34.758959+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:18:34.758959+0000","last_undegraded":"2023-12-01T23:18:34.758959+0000","last_fullsized":"2023-12-01T23:18:34.758959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785803+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.785803+0000","last_peered":"2023-12-01T23:18:34.785803+0000","last_clean":"2023-12-01T23:18:34.785803+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:18:34.785803+0000","last_undegraded":"2023-12-01T23:18:34.785803+0000","last_fullsized":"2023-12-01T23:18:34.785803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827512+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:18:34.827512+0000","last_peered":"2023-12-01T23:18:34.827512+0000","last_clean":"2023-12-01T23:18:34.827512+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:18:34.827512+0000","last_undegraded":"2023-12-01T23:18:34.827512+0000","last_fullsized":"2023-12-01T23:18:34.827512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767682+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:18:34.767682+0000","last_peered":"2023-12-01T23:18:34.767682+0000","last_clean":"2023-12-01T23:18:34.767682+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:18:34.767682+0000","last_undegraded":"2023-12-01T23:18:34.767682+0000","last_fullsized":"2023-12-01T23:18:34.767682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759106+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:18:34.759106+0000","last_peered":"2023-12-01T23:18:34.759106+0000","last_clean":"2023-12-01T23:18:34.759106+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:18:34.759106+0000","last_undegraded":"2023-12-01T23:18:34.759106+0000","last_fullsized":"2023-12-01T23:18:34.759106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":703555,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703611,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":112731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":112605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:19:06.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:19:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.118+0000 7eff0b017640 1 Processor -- start 2023-12-01T23:19:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.118+0000 7eff0b017640 1 -- start start 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.119+0000 7eff0b017640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff0415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.119+0000 7eff0b017640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0415a700 con 0x7eff04153c70 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.119+0000 7eff0b017640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040ca870 con 0x7eff04153890 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.119+0000 7eff0b017640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0415dd80 con 0x7eff0415d950 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.120+0000 7eff095b4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff0415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.120+0000 7eff08db3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7eff04153890 0x7eff040c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:51650/0 (socket says 172.21.15.96:51650) 2023-12-01T23:19:07.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.120+0000 7eff03fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7eff04153c70 0x7eff040ceef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33296/0 (socket says 172.21.15.96:33296) 2023-12-01T23:19:07.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.120+0000 7eff08db3640 1 -- 172.21.15.96:0/464192242 learned_addr learned my addr 172.21.15.96:0/464192242 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.122+0000 7eff037fe640 1 -- 172.21.15.96:0/464192242 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765385553 0 0) 0x7eff0415a700 con 0x7eff04153c70 2023-12-01T23:19:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.122+0000 7eff037fe640 1 -- 172.21.15.96:0/464192242 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec003520 con 0x7eff04153c70 2023-12-01T23:19:07.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.122+0000 7eff095b4640 1 -- 172.21.15.96:0/464192242 >> v1:172.21.15.102:6789/0 conn(0x7eff04153890 legacy=0x7eff040c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.122+0000 7eff095b4640 1 -- 172.21.15.96:0/464192242 >> v1:172.21.15.96:6789/0 conn(0x7eff04153c70 legacy=0x7eff040ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.122+0000 7eff095b4640 1 -- 172.21.15.96:0/464192242 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04159af0 con 0x7eff0415d950 2023-12-01T23:19:07.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.124+0000 7eff095b4640 1 --2- 172.21.15.96:0/464192242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff0415aed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efefc009dc0 tx=0x7efefc02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d168fe68c28caca5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:07.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.128+0000 7eff037fe640 1 -- 172.21.15.96:0/464192242 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc02cd50 con 0x7eff0415d950 2023-12-01T23:19:07.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.128+0000 7eff037fe640 1 -- 172.21.15.96:0/464192242 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc034440 con 0x7eff0415d950 2023-12-01T23:19:07.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.128+0000 7eff037fe640 1 -- 172.21.15.96:0/464192242 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0347d0 con 0x7eff0415d950 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 -- 172.21.15.96:0/464192242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 msgr2=0x7eff0415aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 --2- 172.21.15.96:0/464192242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff0415aed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efefc009dc0 tx=0x7efefc02bfa0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 -- 172.21.15.96:0/464192242 shutdown_connections 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 --2- 172.21.15.96:0/464192242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff0415aed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 -- 172.21.15.96:0/464192242 >> 172.21.15.96:0/464192242 conn(0x7eff0406ba00 msgr2=0x7eff0406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 -- 172.21.15.96:0/464192242 shutdown_connections 2023-12-01T23:19:07.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.129+0000 7eff0b017640 1 -- 172.21.15.96:0/464192242 wait complete. 2023-12-01T23:19:07.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.130+0000 7eff0b017640 1 Processor -- start 2023-12-01T23:19:07.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.130+0000 7eff0b017640 1 -- start start 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff04153c70 0x7eff04150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff04151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040c6560 con 0x7eff04153890 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff041f0140 con 0x7eff04153c70 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff0b017640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff041ef2e0 con 0x7eff0415d950 2023-12-01T23:19:07.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff08db3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff03fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff04153c70 0x7eff04150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.131+0000 7eff095b4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff04151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.132+0000 7eff08db3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45654/0 (socket says 172.21.15.96:45654) 2023-12-01T23:19:07.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.132+0000 7eff08db3640 1 -- 172.21.15.96:0/3814783376 learned_addr learned my addr 172.21.15.96:0/3814783376 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.135+0000 7eff08db3640 1 -- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 msgr2=0x7eff04151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.135+0000 7eff08db3640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff04151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.135+0000 7eff08db3640 1 -- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff04153c70 msgr2=0x7eff04150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.135+0000 7eff08db3640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff04153c70 0x7eff04150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.135+0000 7eff08db3640 1 -- 172.21.15.96:0/3814783376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009a70 con 0x7eff04153890 2023-12-01T23:19:07.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.137+0000 7eff08db3640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efef400c4a0 tx=0x7efef400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:07.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.140+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4005ce0 con 0x7eff04153890 2023-12-01T23:19:07.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.140+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4005e40 con 0x7eff04153890 2023-12-01T23:19:07.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.140+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff041ef5c0 con 0x7eff04153890 2023-12-01T23:19:07.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.140+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4007270 con 0x7eff04153890 2023-12-01T23:19:07.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.141+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff041efb80 con 0x7eff04153890 2023-12-01T23:19:07.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.141+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff04067500 con 0x7eff04153890 2023-12-01T23:19:07.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.384+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efef4007490 con 0x7eff04153890 2023-12-01T23:19:07.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.384+0000 7eff017fa640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 0x7efef006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.384+0000 7eff03fff640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 0x7efef006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.385+0000 7eff03fff640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 0x7efef006d350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff04152050 tx=0x7efef8007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:07.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.397+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efef4013e70 con 0x7eff04153890 2023-12-01T23:19:07.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.397+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efef40540b0 con 0x7eff04153890 2023-12-01T23:19:07.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.563+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff040b52d0 con 0x7efef006ae90 2023-12-01T23:19:07.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.571+0000 7eff017fa640 1 -- 172.21.15.96:0/3814783376 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345325 (secure 0 0 0) 0x7eff040b52d0 con 0x7efef006ae90 2023-12-01T23:19:07.576 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:07.578 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:19:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 msgr2=0x7efef006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 0x7efef006d350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7eff04152050 tx=0x7efef8007d30 comp rx=0 tx=0).stop 2023-12-01T23:19:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 msgr2=0x7eff040ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efef400c4a0 tx=0x7efef400c960 comp rx=0 tx=0).stop 2023-12-01T23:19:07.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 shutdown_connections 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7efef006ae90 0x7efef006d350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff0415d950 0x7eff04151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff04153c70 0x7eff04150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 --2- 172.21.15.96:0/3814783376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7eff04153890 0x7eff040ce230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 >> 172.21.15.96:0/3814783376 conn(0x7eff0406ba00 msgr2=0x7eff040cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 shutdown_connections 2023-12-01T23:19:07.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.575+0000 7eff0b017640 1 -- 172.21.15.96:0/3814783376 wait complete. 2023-12-01T23:19:07.587 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-12-01T23:19:06.045388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218568,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756152,"statfs":{"total":773094113280,"available":772870299648,"internally_reserved":0,"allocated":2457600,"data_stored":2090854,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12737,"internal_metadata":221236799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.249999"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828324+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:18:34.828324+0000","last_peered":"2023-12-01T23:18:34.828324+0000","last_clean":"2023-12-01T23:18:34.828324+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:18:34.828324+0000","last_undegraded":"2023-12-01T23:18:34.828324+0000","last_fullsized":"2023-12-01T23:18:34.828324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784668+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:18:34.784668+0000","last_peered":"2023-12-01T23:18:34.784668+0000","last_clean":"2023-12-01T23:18:34.784668+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:18:34.784668+0000","last_undegraded":"2023-12-01T23:18:34.784668+0000","last_fullsized":"2023-12-01T23:18:34.784668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866489+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:18:35.866489+0000","last_peered":"2023-12-01T23:18:35.866489+0000","last_clean":"2023-12-01T23:18:35.866489+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:18:35.866489+0000","last_undegraded":"2023-12-01T23:18:35.866489+0000","last_fullsized":"2023-12-01T23:18:35.866489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784751+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:18:34.784751+0000","last_peered":"2023-12-01T23:18:34.784751+0000","last_clean":"2023-12-01T23:18:34.784751+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:18:34.784751+0000","last_undegraded":"2023-12-01T23:18:34.784751+0000","last_fullsized":"2023-12-01T23:18:34.784751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828043+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:18:34.828043+0000","last_peered":"2023-12-01T23:18:34.828043+0000","last_clean":"2023-12-01T23:18:34.828043+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:18:34.828043+0000","last_undegraded":"2023-12-01T23:18:34.828043+0000","last_fullsized":"2023-12-01T23:18:34.828043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245374+0000","last_change":"2023-12-01T23:18:34.787052+0000","last_active":"2023-12-01T23:18:36.245374+0000","last_peered":"2023-12-01T23:18:36.245374+0000","last_clean":"2023-12-01T23:18:36.245374+0000","last_became_active":"2023-12-01T23:18:34.786671+0000","last_became_peered":"2023-12-01T23:18:34.786671+0000","last_unstale":"2023-12-01T23:18:36.245374+0000","last_undegraded":"2023-12-01T23:18:36.245374+0000","last_fullsized":"2023-12-01T23:18:36.245374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:31.773956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759098+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:18:34.759098+0000","last_peered":"2023-12-01T23:18:34.759098+0000","last_clean":"2023-12-01T23:18:34.759098+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:18:34.759098+0000","last_undegraded":"2023-12-01T23:18:34.759098+0000","last_fullsized":"2023-12-01T23:18:34.759098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785886+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:18:34.785886+0000","last_peered":"2023-12-01T23:18:34.785886+0000","last_clean":"2023-12-01T23:18:34.785886+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:18:34.785886+0000","last_undegraded":"2023-12-01T23:18:34.785886+0000","last_fullsized":"2023-12-01T23:18:34.785886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245809+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:18:36.245809+0000","last_peered":"2023-12-01T23:18:36.245809+0000","last_clean":"2023-12-01T23:18:36.245809+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:18:36.245809+0000","last_undegraded":"2023-12-01T23:18:36.245809+0000","last_fullsized":"2023-12-01T23:18:36.245809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759053+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:18:34.759053+0000","last_peered":"2023-12-01T23:18:34.759053+0000","last_clean":"2023-12-01T23:18:34.759053+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:18:34.759053+0000","last_undegraded":"2023-12-01T23:18:34.759053+0000","last_fullsized":"2023-12-01T23:18:34.759053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786203+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:18:34.786203+0000","last_peered":"2023-12-01T23:18:34.786203+0000","last_clean":"2023-12-01T23:18:34.786203+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:18:34.786203+0000","last_undegraded":"2023-12-01T23:18:34.786203+0000","last_fullsized":"2023-12-01T23:18:34.786203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245949+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:18:36.245949+0000","last_peered":"2023-12-01T23:18:36.245949+0000","last_clean":"2023-12-01T23:18:36.245949+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:18:36.245949+0000","last_undegraded":"2023-12-01T23:18:36.245949+0000","last_fullsized":"2023-12-01T23:18:36.245949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759109+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:18:34.759109+0000","last_peered":"2023-12-01T23:18:34.759109+0000","last_clean":"2023-12-01T23:18:34.759109+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:18:34.759109+0000","last_undegraded":"2023-12-01T23:18:34.759109+0000","last_fullsized":"2023-12-01T23:18:34.759109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245916+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:18:36.245916+0000","last_peered":"2023-12-01T23:18:36.245916+0000","last_clean":"2023-12-01T23:18:36.245916+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:18:36.245916+0000","last_undegraded":"2023-12-01T23:18:36.245916+0000","last_fullsized":"2023-12-01T23:18:36.245916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784022+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:18:34.784022+0000","last_peered":"2023-12-01T23:18:34.784022+0000","last_clean":"2023-12-01T23:18:34.784022+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:18:34.784022+0000","last_undegraded":"2023-12-01T23:18:34.784022+0000","last_fullsized":"2023-12-01T23:18:34.784022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768545+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:18:34.768545+0000","last_peered":"2023-12-01T23:18:34.768545+0000","last_clean":"2023-12-01T23:18:34.768545+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:18:34.768545+0000","last_undegraded":"2023-12-01T23:18:34.768545+0000","last_fullsized":"2023-12-01T23:18:34.768545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246329+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:18:36.246329+0000","last_peered":"2023-12-01T23:18:36.246329+0000","last_clean":"2023-12-01T23:18:36.246329+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:18:36.246329+0000","last_undegraded":"2023-12-01T23:18:36.246329+0000","last_fullsized":"2023-12-01T23:18:36.246329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783932+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:18:34.783932+0000","last_peered":"2023-12-01T23:18:34.783932+0000","last_clean":"2023-12-01T23:18:34.783932+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:18:34.783932+0000","last_undegraded":"2023-12-01T23:18:34.783932+0000","last_fullsized":"2023-12-01T23:18:34.783932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767868+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:18:34.767868+0000","last_peered":"2023-12-01T23:18:34.767868+0000","last_clean":"2023-12-01T23:18:34.767868+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:18:34.767868+0000","last_undegraded":"2023-12-01T23:18:34.767868+0000","last_fullsized":"2023-12-01T23:18:34.767868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856617+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:18:35.856617+0000","last_peered":"2023-12-01T23:18:35.856617+0000","last_clean":"2023-12-01T23:18:35.856617+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:18:35.856617+0000","last_undegraded":"2023-12-01T23:18:35.856617+0000","last_fullsized":"2023-12-01T23:18:35.856617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777575+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:18:34.777575+0000","last_peered":"2023-12-01T23:18:34.777575+0000","last_clean":"2023-12-01T23:18:34.777575+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:18:34.777575+0000","last_undegraded":"2023-12-01T23:18:34.777575+0000","last_fullsized":"2023-12-01T23:18:34.777575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758714+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:18:34.758714+0000","last_peered":"2023-12-01T23:18:34.758714+0000","last_clean":"2023-12-01T23:18:34.758714+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:18:34.758714+0000","last_undegraded":"2023-12-01T23:18:34.758714+0000","last_fullsized":"2023-12-01T23:18:34.758714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245493+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:18:36.245493+0000","last_peered":"2023-12-01T23:18:36.245493+0000","last_clean":"2023-12-01T23:18:36.245493+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:18:36.245493+0000","last_undegraded":"2023-12-01T23:18:36.245493+0000","last_fullsized":"2023-12-01T23:18:36.245493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829303+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:18:34.829303+0000","last_peered":"2023-12-01T23:18:34.829303+0000","last_clean":"2023-12-01T23:18:34.829303+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:18:34.829303+0000","last_undegraded":"2023-12-01T23:18:34.829303+0000","last_fullsized":"2023-12-01T23:18:34.829303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753914+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:18:34.753914+0000","last_peered":"2023-12-01T23:18:34.753914+0000","last_clean":"2023-12-01T23:18:34.753914+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:18:34.753914+0000","last_undegraded":"2023-12-01T23:18:34.753914+0000","last_fullsized":"2023-12-01T23:18:34.753914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246240+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:18:36.246240+0000","last_peered":"2023-12-01T23:18:36.246240+0000","last_clean":"2023-12-01T23:18:36.246240+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:18:36.246240+0000","last_undegraded":"2023-12-01T23:18:36.246240+0000","last_fullsized":"2023-12-01T23:18:36.246240+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784985+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:18:34.784985+0000","last_peered":"2023-12-01T23:18:34.784985+0000","last_clean":"2023-12-01T23:18:34.784985+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:18:34.784985+0000","last_undegraded":"2023-12-01T23:18:34.784985+0000","last_fullsized":"2023-12-01T23:18:34.784985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.732271+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:18:35.732271+0000","last_peered":"2023-12-01T23:18:35.732271+0000","last_clean":"2023-12-01T23:18:35.732271+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:18:35.732271+0000","last_undegraded":"2023-12-01T23:18:35.732271+0000","last_fullsized":"2023-12-01T23:18:35.732271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866421+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:18:35.866421+0000","last_peered":"2023-12-01T23:18:35.866421+0000","last_clean":"2023-12-01T23:18:35.866421+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:18:35.866421+0000","last_undegraded":"2023-12-01T23:18:35.866421+0000","last_fullsized":"2023-12-01T23:18:35.866421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768150+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:18:34.768150+0000","last_peered":"2023-12-01T23:18:34.768150+0000","last_clean":"2023-12-01T23:18:34.768150+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:18:34.768150+0000","last_undegraded":"2023-12-01T23:18:34.768150+0000","last_fullsized":"2023-12-01T23:18:34.768150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759244+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:18:34.759244+0000","last_peered":"2023-12-01T23:18:34.759244+0000","last_clean":"2023-12-01T23:18:34.759244+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:18:34.759244+0000","last_undegraded":"2023-12-01T23:18:34.759244+0000","last_fullsized":"2023-12-01T23:18:34.759244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245847+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:18:36.245847+0000","last_peered":"2023-12-01T23:18:36.245847+0000","last_clean":"2023-12-01T23:18:36.245847+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:18:36.245847+0000","last_undegraded":"2023-12-01T23:18:36.245847+0000","last_fullsized":"2023-12-01T23:18:36.245847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786277+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:18:34.786277+0000","last_peered":"2023-12-01T23:18:34.786277+0000","last_clean":"2023-12-01T23:18:34.786277+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:18:34.786277+0000","last_undegraded":"2023-12-01T23:18:34.786277+0000","last_fullsized":"2023-12-01T23:18:34.786277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768227+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:18:34.768227+0000","last_peered":"2023-12-01T23:18:34.768227+0000","last_clean":"2023-12-01T23:18:34.768227+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:18:34.768227+0000","last_undegraded":"2023-12-01T23:18:34.768227+0000","last_fullsized":"2023-12-01T23:18:34.768227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856126+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:18:35.856126+0000","last_peered":"2023-12-01T23:18:35.856126+0000","last_clean":"2023-12-01T23:18:35.856126+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:18:35.856126+0000","last_undegraded":"2023-12-01T23:18:35.856126+0000","last_fullsized":"2023-12-01T23:18:35.856126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778077+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:18:34.778077+0000","last_peered":"2023-12-01T23:18:34.778077+0000","last_clean":"2023-12-01T23:18:34.778077+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:18:34.778077+0000","last_undegraded":"2023-12-01T23:18:34.778077+0000","last_fullsized":"2023-12-01T23:18:34.778077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786794+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:18:34.786794+0000","last_peered":"2023-12-01T23:18:34.786794+0000","last_clean":"2023-12-01T23:18:34.786794+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:18:34.786794+0000","last_undegraded":"2023-12-01T23:18:34.786794+0000","last_fullsized":"2023-12-01T23:18:34.786794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856624+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:18:35.856624+0000","last_peered":"2023-12-01T23:18:35.856624+0000","last_clean":"2023-12-01T23:18:35.856624+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:18:35.856624+0000","last_undegraded":"2023-12-01T23:18:35.856624+0000","last_fullsized":"2023-12-01T23:18:35.856624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767757+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:18:34.767757+0000","last_peered":"2023-12-01T23:18:34.767757+0000","last_clean":"2023-12-01T23:18:34.767757+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:18:34.767757+0000","last_undegraded":"2023-12-01T23:18:34.767757+0000","last_fullsized":"2023-12-01T23:18:34.767757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830640+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:18:34.830640+0000","last_peered":"2023-12-01T23:18:34.830640+0000","last_clean":"2023-12-01T23:18:34.830640+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:18:34.830640+0000","last_undegraded":"2023-12-01T23:18:34.830640+0000","last_fullsized":"2023-12-01T23:18:34.830640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856610+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:18:35.856610+0000","last_peered":"2023-12-01T23:18:35.856610+0000","last_clean":"2023-12-01T23:18:35.856610+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:18:35.856610+0000","last_undegraded":"2023-12-01T23:18:35.856610+0000","last_fullsized":"2023-12-01T23:18:35.856610+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827686+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:18:34.827686+0000","last_peered":"2023-12-01T23:18:34.827686+0000","last_clean":"2023-12-01T23:18:34.827686+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:18:34.827686+0000","last_undegraded":"2023-12-01T23:18:34.827686+0000","last_fullsized":"2023-12-01T23:18:34.827686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758788+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:18:34.758788+0000","last_peered":"2023-12-01T23:18:34.758788+0000","last_clean":"2023-12-01T23:18:34.758788+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:18:34.758788+0000","last_undegraded":"2023-12-01T23:18:34.758788+0000","last_fullsized":"2023-12-01T23:18:34.758788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245861+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:18:36.245861+0000","last_peered":"2023-12-01T23:18:36.245861+0000","last_clean":"2023-12-01T23:18:36.245861+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:18:36.245861+0000","last_undegraded":"2023-12-01T23:18:36.245861+0000","last_fullsized":"2023-12-01T23:18:36.245861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783998+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:18:34.783998+0000","last_peered":"2023-12-01T23:18:34.783998+0000","last_clean":"2023-12-01T23:18:34.783998+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:18:34.783998+0000","last_undegraded":"2023-12-01T23:18:34.783998+0000","last_fullsized":"2023-12-01T23:18:34.783998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785908+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:18:34.785908+0000","last_peered":"2023-12-01T23:18:34.785908+0000","last_clean":"2023-12-01T23:18:34.785908+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:18:34.785908+0000","last_undegraded":"2023-12-01T23:18:34.785908+0000","last_fullsized":"2023-12-01T23:18:34.785908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758870+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:18:34.758870+0000","last_peered":"2023-12-01T23:18:34.758870+0000","last_clean":"2023-12-01T23:18:34.758870+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:18:34.758870+0000","last_undegraded":"2023-12-01T23:18:34.758870+0000","last_fullsized":"2023-12-01T23:18:34.758870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246489+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:18:36.246489+0000","last_peered":"2023-12-01T23:18:36.246489+0000","last_clean":"2023-12-01T23:18:36.246489+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:18:36.246489+0000","last_undegraded":"2023-12-01T23:18:36.246489+0000","last_fullsized":"2023-12-01T23:18:36.246489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758994+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:18:34.758994+0000","last_peered":"2023-12-01T23:18:34.758994+0000","last_clean":"2023-12-01T23:18:34.758994+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:18:34.758994+0000","last_undegraded":"2023-12-01T23:18:34.758994+0000","last_fullsized":"2023-12-01T23:18:34.758994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830694+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:18:34.830694+0000","last_peered":"2023-12-01T23:18:34.830694+0000","last_clean":"2023-12-01T23:18:34.830694+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:18:34.830694+0000","last_undegraded":"2023-12-01T23:18:34.830694+0000","last_fullsized":"2023-12-01T23:18:34.830694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246217+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:18:36.246217+0000","last_peered":"2023-12-01T23:18:36.246217+0000","last_clean":"2023-12-01T23:18:36.246217+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:18:36.246217+0000","last_undegraded":"2023-12-01T23:18:36.246217+0000","last_fullsized":"2023-12-01T23:18:36.246217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785964+0000","last_change":"2023-12-01T23:18:28.873819+0000","last_active":"2023-12-01T23:18:34.785964+0000","last_peered":"2023-12-01T23:18:34.785964+0000","last_clean":"2023-12-01T23:18:34.785964+0000","last_became_active":"2023-12-01T23:18:28.872949+0000","last_became_peered":"2023-12-01T23:18:28.872949+0000","last_unstale":"2023-12-01T23:18:34.785964+0000","last_undegraded":"2023-12-01T23:18:34.785964+0000","last_fullsized":"2023-12-01T23:18:34.785964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.768052+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:18:34.768052+0000","last_peered":"2023-12-01T23:18:34.768052+0000","last_clean":"2023-12-01T23:18:34.768052+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:18:34.768052+0000","last_undegraded":"2023-12-01T23:18:34.768052+0000","last_fullsized":"2023-12-01T23:18:34.768052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245798+0000","last_change":"2023-12-01T23:18:34.834125+0000","last_active":"2023-12-01T23:18:36.245798+0000","last_peered":"2023-12-01T23:18:36.245798+0000","last_clean":"2023-12-01T23:18:36.245798+0000","last_became_active":"2023-12-01T23:18:34.833739+0000","last_became_peered":"2023-12-01T23:18:34.833739+0000","last_unstale":"2023-12-01T23:18:36.245798+0000","last_undegraded":"2023-12-01T23:18:36.245798+0000","last_fullsized":"2023-12-01T23:18:36.245798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:13:04.156636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759250+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:18:34.759250+0000","last_peered":"2023-12-01T23:18:34.759250+0000","last_clean":"2023-12-01T23:18:34.759250+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:18:34.759250+0000","last_undegraded":"2023-12-01T23:18:34.759250+0000","last_fullsized":"2023-12-01T23:18:34.759250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830583+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:18:34.830583+0000","last_peered":"2023-12-01T23:18:34.830583+0000","last_clean":"2023-12-01T23:18:34.830583+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:18:34.830583+0000","last_undegraded":"2023-12-01T23:18:34.830583+0000","last_fullsized":"2023-12-01T23:18:34.830583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245379+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:18:36.245379+0000","last_peered":"2023-12-01T23:18:36.245379+0000","last_clean":"2023-12-01T23:18:36.245379+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:18:36.245379+0000","last_undegraded":"2023-12-01T23:18:36.245379+0000","last_fullsized":"2023-12-01T23:18:36.245379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759012+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.759012+0000","last_peered":"2023-12-01T23:18:34.759012+0000","last_clean":"2023-12-01T23:18:34.759012+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:18:34.759012+0000","last_undegraded":"2023-12-01T23:18:34.759012+0000","last_fullsized":"2023-12-01T23:18:34.759012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778257+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:18:34.778257+0000","last_peered":"2023-12-01T23:18:34.778257+0000","last_clean":"2023-12-01T23:18:34.778257+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:18:34.778257+0000","last_undegraded":"2023-12-01T23:18:34.778257+0000","last_fullsized":"2023-12-01T23:18:34.778257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245873+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:18:36.245873+0000","last_peered":"2023-12-01T23:18:36.245873+0000","last_clean":"2023-12-01T23:18:36.245873+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:18:36.245873+0000","last_undegraded":"2023-12-01T23:18:36.245873+0000","last_fullsized":"2023-12-01T23:18:36.245873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758841+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:18:34.758841+0000","last_peered":"2023-12-01T23:18:34.758841+0000","last_clean":"2023-12-01T23:18:34.758841+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:18:34.758841+0000","last_undegraded":"2023-12-01T23:18:34.758841+0000","last_fullsized":"2023-12-01T23:18:34.758841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827350+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:18:34.827350+0000","last_peered":"2023-12-01T23:18:34.827350+0000","last_clean":"2023-12-01T23:18:34.827350+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:18:34.827350+0000","last_undegraded":"2023-12-01T23:18:34.827350+0000","last_fullsized":"2023-12-01T23:18:34.827350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245779+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:18:36.245779+0000","last_peered":"2023-12-01T23:18:36.245779+0000","last_clean":"2023-12-01T23:18:36.245779+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:18:36.245779+0000","last_undegraded":"2023-12-01T23:18:36.245779+0000","last_fullsized":"2023-12-01T23:18:36.245779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753529+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:18:34.753529+0000","last_peered":"2023-12-01T23:18:34.753529+0000","last_clean":"2023-12-01T23:18:34.753529+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:18:34.753529+0000","last_undegraded":"2023-12-01T23:18:34.753529+0000","last_fullsized":"2023-12-01T23:18:34.753529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753557+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:18:34.753557+0000","last_peered":"2023-12-01T23:18:34.753557+0000","last_clean":"2023-12-01T23:18:34.753557+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:18:34.753557+0000","last_undegraded":"2023-12-01T23:18:34.753557+0000","last_fullsized":"2023-12-01T23:18:34.753557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867099+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:18:35.867099+0000","last_peered":"2023-12-01T23:18:35.867099+0000","last_clean":"2023-12-01T23:18:35.867099+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:18:35.867099+0000","last_undegraded":"2023-12-01T23:18:35.867099+0000","last_fullsized":"2023-12-01T23:18:35.867099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759024+0000","last_change":"2023-12-01T23:18:28.872268+0000","last_active":"2023-12-01T23:18:34.759024+0000","last_peered":"2023-12-01T23:18:34.759024+0000","last_clean":"2023-12-01T23:18:34.759024+0000","last_became_active":"2023-12-01T23:18:28.872020+0000","last_became_peered":"2023-12-01T23:18:28.872020+0000","last_unstale":"2023-12-01T23:18:34.759024+0000","last_undegraded":"2023-12-01T23:18:34.759024+0000","last_fullsized":"2023-12-01T23:18:34.759024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786751+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:18:34.786751+0000","last_peered":"2023-12-01T23:18:34.786751+0000","last_clean":"2023-12-01T23:18:34.786751+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:18:34.786751+0000","last_undegraded":"2023-12-01T23:18:34.786751+0000","last_fullsized":"2023-12-01T23:18:34.786751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866861+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:18:35.866861+0000","last_peered":"2023-12-01T23:18:35.866861+0000","last_clean":"2023-12-01T23:18:35.866861+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:18:35.866861+0000","last_undegraded":"2023-12-01T23:18:35.866861+0000","last_fullsized":"2023-12-01T23:18:35.866861+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828897+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:18:34.828897+0000","last_peered":"2023-12-01T23:18:34.828897+0000","last_clean":"2023-12-01T23:18:34.828897+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:18:34.828897+0000","last_undegraded":"2023-12-01T23:18:34.828897+0000","last_fullsized":"2023-12-01T23:18:34.828897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829997+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:18:34.829997+0000","last_peered":"2023-12-01T23:18:34.829997+0000","last_clean":"2023-12-01T23:18:34.829997+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:18:34.829997+0000","last_undegraded":"2023-12-01T23:18:34.829997+0000","last_fullsized":"2023-12-01T23:18:34.829997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246916+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:18:36.246916+0000","last_peered":"2023-12-01T23:18:36.246916+0000","last_clean":"2023-12-01T23:18:36.246916+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:18:36.246916+0000","last_undegraded":"2023-12-01T23:18:36.246916+0000","last_fullsized":"2023-12-01T23:18:36.246916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758889+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:18:34.758889+0000","last_peered":"2023-12-01T23:18:34.758889+0000","last_clean":"2023-12-01T23:18:34.758889+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:18:34.758889+0000","last_undegraded":"2023-12-01T23:18:34.758889+0000","last_fullsized":"2023-12-01T23:18:34.758889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:44.926031+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:18:44.926031+0000","last_peered":"2023-12-01T23:18:44.926031+0000","last_clean":"2023-12-01T23:18:44.926031+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:18:44.926031+0000","last_undegraded":"2023-12-01T23:18:44.926031+0000","last_fullsized":"2023-12-01T23:18:44.926031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.856252+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:18:35.856252+0000","last_peered":"2023-12-01T23:18:35.856252+0000","last_clean":"2023-12-01T23:18:35.856252+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:18:35.856252+0000","last_undegraded":"2023-12-01T23:18:35.856252+0000","last_fullsized":"2023-12-01T23:18:35.856252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778209+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:18:34.778209+0000","last_peered":"2023-12-01T23:18:34.778209+0000","last_clean":"2023-12-01T23:18:34.778209+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:18:34.778209+0000","last_undegraded":"2023-12-01T23:18:34.778209+0000","last_fullsized":"2023-12-01T23:18:34.778209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767988+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:18:34.767988+0000","last_peered":"2023-12-01T23:18:34.767988+0000","last_clean":"2023-12-01T23:18:34.767988+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:18:34.767988+0000","last_undegraded":"2023-12-01T23:18:34.767988+0000","last_fullsized":"2023-12-01T23:18:34.767988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245639+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:18:36.245639+0000","last_peered":"2023-12-01T23:18:36.245639+0000","last_clean":"2023-12-01T23:18:36.245639+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:18:36.245639+0000","last_undegraded":"2023-12-01T23:18:36.245639+0000","last_fullsized":"2023-12-01T23:18:36.245639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828158+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:18:34.828158+0000","last_peered":"2023-12-01T23:18:34.828158+0000","last_clean":"2023-12-01T23:18:34.828158+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:18:34.828158+0000","last_undegraded":"2023-12-01T23:18:34.828158+0000","last_fullsized":"2023-12-01T23:18:34.828158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786608+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:18:34.786608+0000","last_peered":"2023-12-01T23:18:34.786608+0000","last_clean":"2023-12-01T23:18:34.786608+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:18:34.786608+0000","last_undegraded":"2023-12-01T23:18:34.786608+0000","last_fullsized":"2023-12-01T23:18:34.786608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866572+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:18:35.866572+0000","last_peered":"2023-12-01T23:18:35.866572+0000","last_clean":"2023-12-01T23:18:35.866572+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:18:35.866572+0000","last_undegraded":"2023-12-01T23:18:35.866572+0000","last_fullsized":"2023-12-01T23:18:35.866572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786471+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:18:34.786471+0000","last_peered":"2023-12-01T23:18:34.786471+0000","last_clean":"2023-12-01T23:18:34.786471+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:18:34.786471+0000","last_undegraded":"2023-12-01T23:18:34.786471+0000","last_fullsized":"2023-12-01T23:18:34.786471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753827+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:18:34.753827+0000","last_peered":"2023-12-01T23:18:34.753827+0000","last_clean":"2023-12-01T23:18:34.753827+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:18:34.753827+0000","last_undegraded":"2023-12-01T23:18:34.753827+0000","last_fullsized":"2023-12-01T23:18:34.753827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.866532+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:18:35.866532+0000","last_peered":"2023-12-01T23:18:35.866532+0000","last_clean":"2023-12-01T23:18:35.866532+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:18:35.866532+0000","last_undegraded":"2023-12-01T23:18:35.866532+0000","last_fullsized":"2023-12-01T23:18:35.866532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245667+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:18:36.245667+0000","last_peered":"2023-12-01T23:18:36.245667+0000","last_clean":"2023-12-01T23:18:36.245667+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:18:36.245667+0000","last_undegraded":"2023-12-01T23:18:36.245667+0000","last_fullsized":"2023-12-01T23:18:36.245667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767701+0000","last_change":"2023-12-01T23:18:28.821615+0000","last_active":"2023-12-01T23:18:34.767701+0000","last_peered":"2023-12-01T23:18:34.767701+0000","last_clean":"2023-12-01T23:18:34.767701+0000","last_became_active":"2023-12-01T23:18:28.821335+0000","last_became_peered":"2023-12-01T23:18:28.821335+0000","last_unstale":"2023-12-01T23:18:34.767701+0000","last_undegraded":"2023-12-01T23:18:34.767701+0000","last_fullsized":"2023-12-01T23:18:34.767701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787322+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:18:34.787322+0000","last_peered":"2023-12-01T23:18:34.787322+0000","last_clean":"2023-12-01T23:18:34.787322+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:18:34.787322+0000","last_undegraded":"2023-12-01T23:18:34.787322+0000","last_fullsized":"2023-12-01T23:18:34.787322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.246556+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:18:36.246556+0000","last_peered":"2023-12-01T23:18:36.246556+0000","last_clean":"2023-12-01T23:18:36.246556+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:18:36.246556+0000","last_undegraded":"2023-12-01T23:18:36.246556+0000","last_fullsized":"2023-12-01T23:18:36.246556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784060+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:18:34.784060+0000","last_peered":"2023-12-01T23:18:34.784060+0000","last_clean":"2023-12-01T23:18:34.784060+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:18:34.784060+0000","last_undegraded":"2023-12-01T23:18:34.784060+0000","last_fullsized":"2023-12-01T23:18:34.784060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784195+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:18:34.784195+0000","last_peered":"2023-12-01T23:18:34.784195+0000","last_clean":"2023-12-01T23:18:34.784195+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:18:34.784195+0000","last_undegraded":"2023-12-01T23:18:34.784195+0000","last_fullsized":"2023-12-01T23:18:34.784195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753679+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:18:34.753679+0000","last_peered":"2023-12-01T23:18:34.753679+0000","last_clean":"2023-12-01T23:18:34.753679+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:18:34.753679+0000","last_undegraded":"2023-12-01T23:18:34.753679+0000","last_fullsized":"2023-12-01T23:18:34.753679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830120+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:18:34.830120+0000","last_peered":"2023-12-01T23:18:34.830120+0000","last_clean":"2023-12-01T23:18:34.830120+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:18:34.830120+0000","last_undegraded":"2023-12-01T23:18:34.830120+0000","last_fullsized":"2023-12-01T23:18:34.830120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:36.245476+0000","last_change":"2023-12-01T23:18:34.837693+0000","last_active":"2023-12-01T23:18:36.245476+0000","last_peered":"2023-12-01T23:18:36.245476+0000","last_clean":"2023-12-01T23:18:36.245476+0000","last_became_active":"2023-12-01T23:18:34.837313+0000","last_became_peered":"2023-12-01T23:18:34.837313+0000","last_unstale":"2023-12-01T23:18:36.245476+0000","last_undegraded":"2023-12-01T23:18:36.245476+0000","last_fullsized":"2023-12-01T23:18:36.245476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:26.160117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784206+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:18:34.784206+0000","last_peered":"2023-12-01T23:18:34.784206+0000","last_clean":"2023-12-01T23:18:34.784206+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:18:34.784206+0000","last_undegraded":"2023-12-01T23:18:34.784206+0000","last_fullsized":"2023-12-01T23:18:34.784206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.777604+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:18:34.777604+0000","last_peered":"2023-12-01T23:18:34.777604+0000","last_clean":"2023-12-01T23:18:34.777604+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:18:34.777604+0000","last_undegraded":"2023-12-01T23:18:34.777604+0000","last_fullsized":"2023-12-01T23:18:34.777604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-01T23:18:35.867004+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:18:35.867004+0000","last_peered":"2023-12-01T23:18:35.867004+0000","last_clean":"2023-12-01T23:18:35.867004+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:18:35.867004+0000","last_undegraded":"2023-12-01T23:18:35.867004+0000","last_fullsized":"2023-12-01T23:18:35.867004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753650+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:18:34.753650+0000","last_peered":"2023-12-01T23:18:34.753650+0000","last_clean":"2023-12-01T23:18:34.753650+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:18:34.753650+0000","last_undegraded":"2023-12-01T23:18:34.753650+0000","last_fullsized":"2023-12-01T23:18:34.753650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830553+0000","last_change":"2023-12-01T23:18:28.878753+0000","last_active":"2023-12-01T23:18:34.830553+0000","last_peered":"2023-12-01T23:18:34.830553+0000","last_clean":"2023-12-01T23:18:34.830553+0000","last_became_active":"2023-12-01T23:18:28.878547+0000","last_became_peered":"2023-12-01T23:18:28.878547+0000","last_unstale":"2023-12-01T23:18:34.830553+0000","last_undegraded":"2023-12-01T23:18:34.830553+0000","last_fullsized":"2023-12-01T23:18:34.830553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786682+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:18:34.786682+0000","last_peered":"2023-12-01T23:18:34.786682+0000","last_clean":"2023-12-01T23:18:34.786682+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:18:34.786682+0000","last_undegraded":"2023-12-01T23:18:34.786682+0000","last_fullsized":"2023-12-01T23:18:34.786682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.829191+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:18:34.829191+0000","last_peered":"2023-12-01T23:18:34.829191+0000","last_clean":"2023-12-01T23:18:34.829191+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:18:34.829191+0000","last_undegraded":"2023-12-01T23:18:34.829191+0000","last_fullsized":"2023-12-01T23:18:34.829191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784569+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:18:34.784569+0000","last_peered":"2023-12-01T23:18:34.784569+0000","last_clean":"2023-12-01T23:18:34.784569+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:18:34.784569+0000","last_undegraded":"2023-12-01T23:18:34.784569+0000","last_fullsized":"2023-12-01T23:18:34.784569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767962+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:18:34.767962+0000","last_peered":"2023-12-01T23:18:34.767962+0000","last_clean":"2023-12-01T23:18:34.767962+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:18:34.767962+0000","last_undegraded":"2023-12-01T23:18:34.767962+0000","last_fullsized":"2023-12-01T23:18:34.767962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753917+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:18:34.753917+0000","last_peered":"2023-12-01T23:18:34.753917+0000","last_clean":"2023-12-01T23:18:34.753917+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:18:34.753917+0000","last_undegraded":"2023-12-01T23:18:34.753917+0000","last_fullsized":"2023-12-01T23:18:34.753917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784917+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:18:34.784917+0000","last_peered":"2023-12-01T23:18:34.784917+0000","last_clean":"2023-12-01T23:18:34.784917+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:18:34.784917+0000","last_undegraded":"2023-12-01T23:18:34.784917+0000","last_fullsized":"2023-12-01T23:18:34.784917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787245+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:18:34.787245+0000","last_peered":"2023-12-01T23:18:34.787245+0000","last_clean":"2023-12-01T23:18:34.787245+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:18:34.787245+0000","last_undegraded":"2023-12-01T23:18:34.787245+0000","last_fullsized":"2023-12-01T23:18:34.787245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784036+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:18:34.784036+0000","last_peered":"2023-12-01T23:18:34.784036+0000","last_clean":"2023-12-01T23:18:34.784036+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:18:34.784036+0000","last_undegraded":"2023-12-01T23:18:34.784036+0000","last_fullsized":"2023-12-01T23:18:34.784036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786612+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:18:34.786612+0000","last_peered":"2023-12-01T23:18:34.786612+0000","last_clean":"2023-12-01T23:18:34.786612+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:18:34.786612+0000","last_undegraded":"2023-12-01T23:18:34.786612+0000","last_fullsized":"2023-12-01T23:18:34.786612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828033+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:18:34.828033+0000","last_peered":"2023-12-01T23:18:34.828033+0000","last_clean":"2023-12-01T23:18:34.828033+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:18:34.828033+0000","last_undegraded":"2023-12-01T23:18:34.828033+0000","last_fullsized":"2023-12-01T23:18:34.828033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753755+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:18:34.753755+0000","last_peered":"2023-12-01T23:18:34.753755+0000","last_clean":"2023-12-01T23:18:34.753755+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:18:34.753755+0000","last_undegraded":"2023-12-01T23:18:34.753755+0000","last_fullsized":"2023-12-01T23:18:34.753755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759182+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:18:34.759182+0000","last_peered":"2023-12-01T23:18:34.759182+0000","last_clean":"2023-12-01T23:18:34.759182+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:18:34.759182+0000","last_undegraded":"2023-12-01T23:18:34.759182+0000","last_fullsized":"2023-12-01T23:18:34.759182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.830476+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:18:34.830476+0000","last_peered":"2023-12-01T23:18:34.830476+0000","last_clean":"2023-12-01T23:18:34.830476+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:18:34.830476+0000","last_undegraded":"2023-12-01T23:18:34.830476+0000","last_fullsized":"2023-12-01T23:18:34.830476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786114+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:18:34.786114+0000","last_peered":"2023-12-01T23:18:34.786114+0000","last_clean":"2023-12-01T23:18:34.786114+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:18:34.786114+0000","last_undegraded":"2023-12-01T23:18:34.786114+0000","last_fullsized":"2023-12-01T23:18:34.786114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.787165+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:18:34.787165+0000","last_peered":"2023-12-01T23:18:34.787165+0000","last_clean":"2023-12-01T23:18:34.787165+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:18:34.787165+0000","last_undegraded":"2023-12-01T23:18:34.787165+0000","last_fullsized":"2023-12-01T23:18:34.787165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767905+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:18:34.767905+0000","last_peered":"2023-12-01T23:18:34.767905+0000","last_clean":"2023-12-01T23:18:34.767905+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:18:34.767905+0000","last_undegraded":"2023-12-01T23:18:34.767905+0000","last_fullsized":"2023-12-01T23:18:34.767905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.828817+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:18:34.828817+0000","last_peered":"2023-12-01T23:18:34.828817+0000","last_clean":"2023-12-01T23:18:34.828817+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:18:34.828817+0000","last_undegraded":"2023-12-01T23:18:34.828817+0000","last_fullsized":"2023-12-01T23:18:34.828817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.784004+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:18:34.784004+0000","last_peered":"2023-12-01T23:18:34.784004+0000","last_clean":"2023-12-01T23:18:34.784004+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:18:34.784004+0000","last_undegraded":"2023-12-01T23:18:34.784004+0000","last_fullsized":"2023-12-01T23:18:34.784004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.778132+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:18:34.778132+0000","last_peered":"2023-12-01T23:18:34.778132+0000","last_clean":"2023-12-01T23:18:34.778132+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:18:34.778132+0000","last_undegraded":"2023-12-01T23:18:34.778132+0000","last_fullsized":"2023-12-01T23:18:34.778132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753984+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:18:34.753984+0000","last_peered":"2023-12-01T23:18:34.753984+0000","last_clean":"2023-12-01T23:18:34.753984+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:18:34.753984+0000","last_undegraded":"2023-12-01T23:18:34.753984+0000","last_fullsized":"2023-12-01T23:18:34.753984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.753831+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:18:34.753831+0000","last_peered":"2023-12-01T23:18:34.753831+0000","last_clean":"2023-12-01T23:18:34.753831+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:18:34.753831+0000","last_undegraded":"2023-12-01T23:18:34.753831+0000","last_fullsized":"2023-12-01T23:18:34.753831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759179+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:18:34.759179+0000","last_peered":"2023-12-01T23:18:34.759179+0000","last_clean":"2023-12-01T23:18:34.759179+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:18:34.759179+0000","last_undegraded":"2023-12-01T23:18:34.759179+0000","last_fullsized":"2023-12-01T23:18:34.759179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.783732+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:18:34.783732+0000","last_peered":"2023-12-01T23:18:34.783732+0000","last_clean":"2023-12-01T23:18:34.783732+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:18:34.783732+0000","last_undegraded":"2023-12-01T23:18:34.783732+0000","last_fullsized":"2023-12-01T23:18:34.783732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758745+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:18:34.758745+0000","last_peered":"2023-12-01T23:18:34.758745+0000","last_clean":"2023-12-01T23:18:34.758745+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:18:34.758745+0000","last_undegraded":"2023-12-01T23:18:34.758745+0000","last_fullsized":"2023-12-01T23:18:34.758745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.786541+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:18:34.786541+0000","last_peered":"2023-12-01T23:18:34.786541+0000","last_clean":"2023-12-01T23:18:34.786541+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:18:34.786541+0000","last_undegraded":"2023-12-01T23:18:34.786541+0000","last_fullsized":"2023-12-01T23:18:34.786541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.758959+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:18:34.758959+0000","last_peered":"2023-12-01T23:18:34.758959+0000","last_clean":"2023-12-01T23:18:34.758959+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:18:34.758959+0000","last_undegraded":"2023-12-01T23:18:34.758959+0000","last_fullsized":"2023-12-01T23:18:34.758959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.785803+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:18:34.785803+0000","last_peered":"2023-12-01T23:18:34.785803+0000","last_clean":"2023-12-01T23:18:34.785803+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:18:34.785803+0000","last_undegraded":"2023-12-01T23:18:34.785803+0000","last_fullsized":"2023-12-01T23:18:34.785803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.827512+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:18:34.827512+0000","last_peered":"2023-12-01T23:18:34.827512+0000","last_clean":"2023-12-01T23:18:34.827512+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:18:34.827512+0000","last_undegraded":"2023-12-01T23:18:34.827512+0000","last_fullsized":"2023-12-01T23:18:34.827512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.767682+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:18:34.767682+0000","last_peered":"2023-12-01T23:18:34.767682+0000","last_clean":"2023-12-01T23:18:34.767682+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:18:34.767682+0000","last_undegraded":"2023-12-01T23:18:34.767682+0000","last_fullsized":"2023-12-01T23:18:34.767682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-01T23:18:34.759106+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:18:34.759106+0000","last_peered":"2023-12-01T23:18:34.759106+0000","last_clean":"2023-12-01T23:18:34.759106+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:18:34.759106+0000","last_undegraded":"2023-12-01T23:18:34.759106+0000","last_fullsized":"2023-12-01T23:18:34.759106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":703555,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1588,"internal_metadata":27654604},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":703611,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":116446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":112731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":112605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:19:07.592 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-01T23:19:07.592 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-01T23:19:07.592 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-01T23:19:07.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-01T23:19:07.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 Processor -- start 2023-12-01T23:19:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 -- start start 2023-12-01T23:19:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd17c153be0 0x7fd17c159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 0x7fd17c1641b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd17c153fc0 con 0x7fd17c06fa00 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd17c0c3340 con 0x7fd17c153be0 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.723+0000 7fd1844ad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c06b7b0 con 0x7fd17c0c5e60 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.724+0000 7fd181a48640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd17c06fa00 0x7fd17c0c41b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33300/0 (socket says 172.21.15.96:33300) 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.724+0000 7fd181a48640 1 -- 172.21.15.96:0/310275484 learned_addr learned my addr 172.21.15.96:0/310275484 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.724+0000 7fd182a4a640 1 --2- 172.21.15.96:0/310275484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 0x7fd17c1641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.724+0000 7fd182249640 1 --2- 172.21.15.96:0/310275484 >> v2:172.21.15.102:3300/0 conn(0x7fd17c153be0 0x7fd17c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd181247640 1 -- 172.21.15.96:0/310275484 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927722570 0 0) 0x7fd17c153fc0 con 0x7fd17c06fa00 2023-12-01T23:19:07.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd181247640 1 -- 172.21.15.96:0/310275484 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd168003520 con 0x7fd17c06fa00 2023-12-01T23:19:07.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd182a4a640 1 -- 172.21.15.96:0/310275484 >> v2:172.21.15.102:3300/0 conn(0x7fd17c153be0 msgr2=0x7fd17c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:07.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd182a4a640 1 --2- 172.21.15.96:0/310275484 >> v2:172.21.15.102:3300/0 conn(0x7fd17c153be0 0x7fd17c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd182a4a640 1 -- 172.21.15.96:0/310275484 >> v1:172.21.15.96:6789/0 conn(0x7fd17c06fa00 legacy=0x7fd17c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.727+0000 7fd182a4a640 1 -- 172.21.15.96:0/310275484 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c06ba90 con 0x7fd17c0c5e60 2023-12-01T23:19:07.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.729+0000 7fd182a4a640 1 --2- 172.21.15.96:0/310275484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 0x7fd17c1641b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd174009d90 tx=0x7fd17402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b816215189752013 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:07.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd181247640 1 -- 172.21.15.96:0/310275484 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17402cc50 con 0x7fd17c0c5e60 2023-12-01T23:19:07.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd181247640 1 -- 172.21.15.96:0/310275484 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17402cdb0 con 0x7fd17c0c5e60 2023-12-01T23:19:07.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd181247640 1 -- 172.21.15.96:0/310275484 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174034660 con 0x7fd17c0c5e60 2023-12-01T23:19:07.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 -- 172.21.15.96:0/310275484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 msgr2=0x7fd17c1641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 --2- 172.21.15.96:0/310275484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 0x7fd17c1641b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd174009d90 tx=0x7fd17402bea0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 -- 172.21.15.96:0/310275484 shutdown_connections 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 --2- 172.21.15.96:0/310275484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c0c5e60 0x7fd17c1641b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 --2- 172.21.15.96:0/310275484 >> v2:172.21.15.102:3300/0 conn(0x7fd17c153be0 0x7fd17c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.733+0000 7fd1844ad640 1 -- 172.21.15.96:0/310275484 >> 172.21.15.96:0/310275484 conn(0x7fd17c0c7f60 msgr2=0x7fd17c0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.734+0000 7fd1844ad640 1 -- 172.21.15.96:0/310275484 shutdown_connections 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.734+0000 7fd1844ad640 1 -- 172.21.15.96:0/310275484 wait complete. 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 Processor -- start 2023-12-01T23:19:07.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 -- start start 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c06fa00 0x7fd17c1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd17c0c5e60 0x7fd17c06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c140c10 con 0x7fd17c153be0 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c14b990 con 0x7fd17c0c5e60 2023-12-01T23:19:07.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.735+0000 7fd1844ad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17c1562a0 con 0x7fd17c06fa00 2023-12-01T23:19:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.736+0000 7fd182a4a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.736+0000 7fd181a48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd17c0c5e60 0x7fd17c06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.736+0000 7fd182249640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c06fa00 0x7fd17c1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.736+0000 7fd182a4a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45656/0 (socket says 172.21.15.96:45656) 2023-12-01T23:19:07.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.736+0000 7fd182a4a640 1 -- 172.21.15.96:0/1124010002 learned_addr learned my addr 172.21.15.96:0/1124010002 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.739+0000 7fd182a4a640 1 -- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c06fa00 msgr2=0x7fd17c1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.739+0000 7fd182a4a640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c06fa00 0x7fd17c1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.739+0000 7fd182a4a640 1 -- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd17c0c5e60 msgr2=0x7fd17c06ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.739+0000 7fd182a4a640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd17c0c5e60 0x7fd17c06ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:07.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.740+0000 7fd182a4a640 1 -- 172.21.15.96:0/1124010002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009a70 con 0x7fd17c153be0 2023-12-01T23:19:07.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.742+0000 7fd182a4a640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd174009eb0 tx=0x7fd174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.745+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17403e610 con 0x7fd17c153be0 2023-12-01T23:19:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.745+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17403e770 con 0x7fd17c153be0 2023-12-01T23:19:07.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.745+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17403eb20 con 0x7fd17c153be0 2023-12-01T23:19:07.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.746+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17c06a740 con 0x7fd17c153be0 2023-12-01T23:19:07.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.746+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17c14c350 con 0x7fd17c153be0 2023-12-01T23:19:07.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.746+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17c06a900 con 0x7fd17c153be0 2023-12-01T23:19:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.988+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd17403b050 con 0x7fd17c153be0 2023-12-01T23:19:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.988+0000 7fd16effd640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 0x7fd16006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.988+0000 7fd182249640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 0x7fd16006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:07.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:07.989+0000 7fd182249640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 0x7fd16006d350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd170009b40 tx=0x7fd170009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.001+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd17407aff0 con 0x7fd17c153be0 2023-12-01T23:19:08.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.001+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd174077330 con 0x7fd17c153be0 2023-12-01T23:19:08.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.223+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd17c067500 con 0x7fd17c153be0 2023-12-01T23:19:08.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.228+0000 7fd16effd640 1 -- 172.21.15.96:0/1124010002 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd174039040 con 0x7fd17c153be0 2023-12-01T23:19:08.230 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:08.230 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 msgr2=0x7fd16006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 0x7fd16006d350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd170009b40 tx=0x7fd170009190 comp rx=0 tx=0).stop 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 msgr2=0x7fd17c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd174009eb0 tx=0x7fd174004a40 comp rx=0 tx=0).stop 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 shutdown_connections 2023-12-01T23:19:08.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd16006ae90 0x7fd16006d350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd17c153be0 0x7fd17c154470 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd17c0c5e60 0x7fd17c06ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 --2- 172.21.15.96:0/1124010002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd17c06fa00 0x7fd17c1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 >> 172.21.15.96:0/1124010002 conn(0x7fd17c0c7f60 msgr2=0x7fd17c071570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 shutdown_connections 2023-12-01T23:19:08.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.230+0000 7fd1844ad640 1 -- 172.21.15.96:0/1124010002 wait complete. 2023-12-01T23:19:08.243 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-01T23:19:08.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:19:08.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.341+0000 7f120e725640 1 Processor -- start 2023-12-01T23:19:08.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.341+0000 7f120e725640 1 -- start start 2023-12-01T23:19:08.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f120e725640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 0x7f120806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f120e725640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806e0f0 con 0x7f120806f160 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f120e725640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1208159710 con 0x7f12080c2e40 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f120e725640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12080c72d0 con 0x7f12081537d0 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f1207fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 0x7f120806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f12077fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f120806f160 0x7f1208159bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33312/0 (socket says 172.21.15.96:33312) 2023-12-01T23:19:08.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.342+0000 7f12077fe640 1 -- 172.21.15.96:0/2847221677 learned_addr learned my addr 172.21.15.96:0/2847221677 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123435562 0 0) 0x7f1208159710 con 0x7f12080c2e40 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003520 con 0x7f12080c2e40 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260475413 0 0) 0x7f120806e0f0 con 0x7f120806f160 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1208159710 con 0x7f120806f160 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1207fff640 1 -- 172.21.15.96:0/2847221677 >> v1:172.21.15.102:6789/0 conn(0x7f12080c2e40 legacy=0x7f1208163f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1207fff640 1 -- 172.21.15.96:0/2847221677 >> v1:172.21.15.96:6789/0 conn(0x7f120806f160 legacy=0x7f1208159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.345+0000 7f1207fff640 1 -- 172.21.15.96:0/2847221677 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080c7590 con 0x7f12081537d0 2023-12-01T23:19:08.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.347+0000 7f1207fff640 1 --2- 172.21.15.96:0/2847221677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 0x7f120806a500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097d0 tx=0x7f11f802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b58572ec42650540 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8030880 con 0x7f12081537d0 2023-12-01T23:19:08.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f80309e0 con 0x7f12081537d0 2023-12-01T23:19:08.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f1206ffd640 1 -- 172.21.15.96:0/2847221677 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8030d70 con 0x7f12081537d0 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 -- 172.21.15.96:0/2847221677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 msgr2=0x7f120806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 --2- 172.21.15.96:0/2847221677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 0x7f120806a500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097d0 tx=0x7f11f802b9c0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 -- 172.21.15.96:0/2847221677 shutdown_connections 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 --2- 172.21.15.96:0/2847221677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12081537d0 0x7f120806a500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 -- 172.21.15.96:0/2847221677 >> 172.21.15.96:0/2847221677 conn(0x7f12080cbf60 msgr2=0x7f12080cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 -- 172.21.15.96:0/2847221677 shutdown_connections 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.351+0000 7f120e725640 1 -- 172.21.15.96:0/2847221677 wait complete. 2023-12-01T23:19:08.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.352+0000 7f120e725640 1 Processor -- start 2023-12-01T23:19:08.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 -- start start 2023-12-01T23:19:08.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 0x7f12080c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12081537d0 0x7f1208151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080c5220 con 0x7f12080c2e40 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12080c5f10 con 0x7f12081537d0 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.353+0000 7f120e725640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12081f2e80 con 0x7f120806f160 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.354+0000 7f12077fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.354+0000 7f1207fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 0x7f12080c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.354+0000 7f120ccc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12081537d0 0x7f1208151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.354+0000 7f12077fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45670/0 (socket says 172.21.15.96:45670) 2023-12-01T23:19:08.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.354+0000 7f12077fe640 1 -- 172.21.15.96:0/164574333 learned_addr learned my addr 172.21.15.96:0/164574333 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:08.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f12077fe640 1 -- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 msgr2=0x7f12080c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f12077fe640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 0x7f12080c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f12077fe640 1 -- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12081537d0 msgr2=0x7f1208151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f12077fe640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12081537d0 0x7f1208151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f12077fe640 1 -- 172.21.15.96:0/164574333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009400 con 0x7f12080c2e40 2023-12-01T23:19:08.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.357+0000 7f1207fff640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 0x7f12080c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:19:08.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.360+0000 7f12077fe640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00c410 tx=0x7f11fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.363+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc005ce0 con 0x7f12080c2e40 2023-12-01T23:19:08.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.363+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc005e40 con 0x7f12080c2e40 2023-12-01T23:19:08.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.363+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0072f0 con 0x7f12080c2e40 2023-12-01T23:19:08.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.364+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080c61b0 con 0x7f12080c2e40 2023-12-01T23:19:08.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.364+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12081f23a0 con 0x7f12080c2e40 2023-12-01T23:19:08.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.365+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1208067500 con 0x7f12080c2e40 2023-12-01T23:19:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.384+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11fc007510 con 0x7f12080c2e40 2023-12-01T23:19:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.384+0000 7f1204ff9640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 0x7f11f406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.384+0000 7f1207fff640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 0x7f11f406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.385+0000 7f1207fff640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 0x7f11f406d350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11f8036000 tx=0x7f11f8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.618+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11fc013e70 con 0x7f12080c2e40 2023-12-01T23:19:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.618+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11fc0542f0 con 0x7f12080c2e40 2023-12-01T23:19:08.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.789+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1208150120 con 0x7f12080c2e40 2023-12-01T23:19:08.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.835+0000 7f1204ff9640 1 -- 172.21.15.96:0/164574333 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f11fc057910 con 0x7f12080c2e40 2023-12-01T23:19:08.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:08.838 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:19:08.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 msgr2=0x7f11f406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 0x7f11f406d350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f11f8036000 tx=0x7f11f8008030 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 msgr2=0x7f12080c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11fc00c410 tx=0x7f11fc00c8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 shutdown_connections 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f11f406ae90 0x7f11f406d350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12081537d0 0x7f1208151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12080c2e40 0x7f12080c4ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 --2- 172.21.15.96:0/164574333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120806f160 0x7f12080c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.837+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 >> 172.21.15.96:0/164574333 conn(0x7f12080cbf60 msgr2=0x7f1208070280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.838+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 shutdown_connections 2023-12-01T23:19:08.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.838+0000 7f120e725640 1 -- 172.21.15.96:0/164574333 wait complete. 2023-12-01T23:19:08.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:19:08.851 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:19:08.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.953+0000 7f1b414a6640 1 Processor -- start 2023-12-01T23:19:08.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.953+0000 7f1b414a6640 1 -- start start 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b414a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b3c1501c0 0x7f1b3c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b414a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b414a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0c1a90 con 0x7f1b3c072450 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b414a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0c1d30 con 0x7f1b3c1501c0 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b414a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0c2010 con 0x7f1b3c0bff00 2023-12-01T23:19:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b3b7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1b3c072450 0x7f1b3c071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33324/0 (socket says 172.21.15.96:33324) 2023-12-01T23:19:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.954+0000 7f1b3b7fe640 1 -- 172.21.15.96:0/1599663105 learned_addr learned my addr 172.21.15.96:0/1599663105 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.955+0000 7f1b3affd640 1 --2- 172.21.15.96:0/1599663105 >> v2:172.21.15.102:3300/0 conn(0x7f1b3c1501c0 0x7f1b3c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.955+0000 7f1b3a7fc640 1 --2- 172.21.15.96:0/1599663105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b39ffb640 1 -- 172.21.15.96:0/1599663105 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591235593 0 0) 0x7f1b3c0c1a90 con 0x7f1b3c072450 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b39ffb640 1 -- 172.21.15.96:0/1599663105 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003520 con 0x7f1b3c072450 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b3a7fc640 1 -- 172.21.15.96:0/1599663105 >> v2:172.21.15.102:3300/0 conn(0x7f1b3c1501c0 msgr2=0x7f1b3c159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b3a7fc640 1 --2- 172.21.15.96:0/1599663105 >> v2:172.21.15.102:3300/0 conn(0x7f1b3c1501c0 0x7f1b3c159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b3a7fc640 1 -- 172.21.15.96:0/1599663105 >> v1:172.21.15.96:6789/0 conn(0x7f1b3c072450 legacy=0x7f1b3c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.957+0000 7f1b3a7fc640 1 -- 172.21.15.96:0/1599663105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c156380 con 0x7f1b3c0bff00 2023-12-01T23:19:08.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.959+0000 7f1b3a7fc640 1 --2- 172.21.15.96:0/1599663105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c156e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b300097a0 tx=0x7f1b3002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c81f1027c1880a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b39ffb640 1 -- 172.21.15.96:0/1599663105 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30030610 con 0x7f1b3c0bff00 2023-12-01T23:19:08.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b39ffb640 1 -- 172.21.15.96:0/1599663105 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30030770 con 0x7f1b3c0bff00 2023-12-01T23:19:08.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b39ffb640 1 -- 172.21.15.96:0/1599663105 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30030b00 con 0x7f1b3c0bff00 2023-12-01T23:19:08.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 -- 172.21.15.96:0/1599663105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 msgr2=0x7f1b3c156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 --2- 172.21.15.96:0/1599663105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c156e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b300097a0 tx=0x7f1b3002b960 comp rx=0 tx=0).stop 2023-12-01T23:19:08.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 -- 172.21.15.96:0/1599663105 shutdown_connections 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 --2- 172.21.15.96:0/1599663105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c156e60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 --2- 172.21.15.96:0/1599663105 >> v2:172.21.15.102:3300/0 conn(0x7f1b3c1501c0 0x7f1b3c159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 -- 172.21.15.96:0/1599663105 >> 172.21.15.96:0/1599663105 conn(0x7f1b3c06cd60 msgr2=0x7f1b3c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 -- 172.21.15.96:0/1599663105 shutdown_connections 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.963+0000 7f1b414a6640 1 -- 172.21.15.96:0/1599663105 wait complete. 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 Processor -- start 2023-12-01T23:19:08.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 -- start start 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b3c072450 0x7f1b3c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c145090 con 0x7f1b3c1501c0 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c159bd0 con 0x7f1b3c072450 2023-12-01T23:19:08.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.965+0000 7f1b414a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c145870 con 0x7f1b3c0bff00 2023-12-01T23:19:08.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.966+0000 7f1b3b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.966+0000 7f1b3a7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.966+0000 7f1b3affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b3c072450 0x7f1b3c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:08.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.966+0000 7f1b3b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45672/0 (socket says 172.21.15.96:45672) 2023-12-01T23:19:08.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.966+0000 7f1b3b7fe640 1 -- 172.21.15.96:0/646347581 learned_addr learned my addr 172.21.15.96:0/646347581 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:08.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.969+0000 7f1b3b7fe640 1 -- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 msgr2=0x7f1b3c148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.969+0000 7f1b3b7fe640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.969+0000 7f1b3b7fe640 1 -- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b3c072450 msgr2=0x7f1b3c144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:08.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.969+0000 7f1b3b7fe640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b3c072450 0x7f1b3c144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:08.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.969+0000 7f1b3b7fe640 1 -- 172.21.15.96:0/646347581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009400 con 0x7f1b3c1501c0 2023-12-01T23:19:08.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.972+0000 7f1b3b7fe640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c450 tx=0x7f1b3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.975+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34005ce0 con 0x7f1b3c1501c0 2023-12-01T23:19:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.975+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34005e40 con 0x7f1b3c1501c0 2023-12-01T23:19:08.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.975+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c159740 con 0x7f1b3c1501c0 2023-12-01T23:19:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.975+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34007270 con 0x7f1b3c1501c0 2023-12-01T23:19:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.975+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c159130 con 0x7f1b3c1501c0 2023-12-01T23:19:08.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:08.976+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c0c77e0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.216+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b340073d0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.217+0000 7f1b237fe640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 0x7f1b2806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.217+0000 7f1b3affd640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 0x7f1b2806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.217+0000 7f1b3affd640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 0x7f1b2806d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c011340 tx=0x7f1b2c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:09.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.230+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b34057ab0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.230+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b34053df0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.402+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b3c1598d0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.407+0000 7f1b237fe640 1 -- 172.21.15.96:0/646347581 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b340210a0 con 0x7f1b3c1501c0 2023-12-01T23:19:09.409 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:19:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 msgr2=0x7f1b2806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 0x7f1b2806d350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c011340 tx=0x7f1b2c00b040 comp rx=0 tx=0).stop 2023-12-01T23:19:09.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 msgr2=0x7f1b3c1ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400c450 tx=0x7f1b3400c910 comp rx=0 tx=0).stop 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 shutdown_connections 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1b2806ae90 0x7f1b2806d350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b3c1501c0 0x7f1b3c1ecdb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b3c0bff00 0x7f1b3c148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 --2- 172.21.15.96:0/646347581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b3c072450 0x7f1b3c144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 >> 172.21.15.96:0/646347581 conn(0x7f1b3c06cd60 msgr2=0x7f1b3c0c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 shutdown_connections 2023-12-01T23:19:09.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.409+0000 7f1b414a6640 1 -- 172.21.15.96:0/646347581 wait complete. 2023-12-01T23:19:09.422 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:19:09.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.523+0000 7ff115dce640 1 Processor -- start 2023-12-01T23:19:09.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.523+0000 7ff115dce640 1 -- start start 2023-12-01T23:19:09.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.524+0000 7ff115dce640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 0x7ff11006b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.524+0000 7ff115dce640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff11015af60 0x7ff11015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.524+0000 7ff115dce640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff110151b00 con 0x7ff1100c68f0 2023-12-01T23:19:09.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.524+0000 7ff115dce640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1101582b0 con 0x7ff110151720 2023-12-01T23:19:09.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.524+0000 7ff115dce640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff110157730 con 0x7ff11015af60 2023-12-01T23:19:09.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.525+0000 7ff10f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 0x7ff11006b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.525+0000 7ff10ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff11015af60 0x7ff11015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.525+0000 7ff10f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 0x7ff11006b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45678/0 (socket says 172.21.15.96:45678) 2023-12-01T23:19:09.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.525+0000 7ff10f7fe640 1 -- 172.21.15.96:0/2333084232 learned_addr learned my addr 172.21.15.96:0/2333084232 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.528+0000 7ff10ffff640 1 -- 172.21.15.96:0/2333084232 >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 msgr2=0x7ff11006b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.528+0000 7ff10ffff640 1 --2- 172.21.15.96:0/2333084232 >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 0x7ff11006b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.528+0000 7ff10ffff640 1 -- 172.21.15.96:0/2333084232 >> v1:172.21.15.96:6789/0 conn(0x7ff1100c68f0 legacy=0x7ff11006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.528+0000 7ff10ffff640 1 -- 172.21.15.96:0/2333084232 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110157a10 con 0x7ff11015af60 2023-12-01T23:19:09.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.531+0000 7ff10ffff640 1 --2- 172.21.15.96:0/2333084232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff11015b3b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff108009d90 tx=0x7ff10802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603c84cc497471ed server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.534+0000 7ff10e7fc640 1 -- 172.21.15.96:0/2333084232 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10802cbd0 con 0x7ff11015af60 2023-12-01T23:19:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.534+0000 7ff10e7fc640 1 -- 172.21.15.96:0/2333084232 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10802cd30 con 0x7ff11015af60 2023-12-01T23:19:09.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.534+0000 7ff10e7fc640 1 -- 172.21.15.96:0/2333084232 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10802cea0 con 0x7ff11015af60 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 -- 172.21.15.96:0/2333084232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 msgr2=0x7ff11015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 --2- 172.21.15.96:0/2333084232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff11015b3b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff108009d90 tx=0x7ff10802be20 comp rx=0 tx=0).stop 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 -- 172.21.15.96:0/2333084232 shutdown_connections 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 --2- 172.21.15.96:0/2333084232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff11015b3b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 --2- 172.21.15.96:0/2333084232 >> v2:172.21.15.96:3300/0 conn(0x7ff110151720 0x7ff11006b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 -- 172.21.15.96:0/2333084232 >> 172.21.15.96:0/2333084232 conn(0x7ff1100cbef0 msgr2=0x7ff1100cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:09.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 -- 172.21.15.96:0/2333084232 shutdown_connections 2023-12-01T23:19:09.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.535+0000 7ff115dce640 1 -- 172.21.15.96:0/2333084232 wait complete. 2023-12-01T23:19:09.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.536+0000 7ff115dce640 1 Processor -- start 2023-12-01T23:19:09.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.536+0000 7ff115dce640 1 -- start start 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1100c68f0 0x7ff1101efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff1101ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101f0220 con 0x7ff110151720 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1101f27d0 con 0x7ff11015af60 2023-12-01T23:19:09.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.537+0000 7ff115dce640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11014bdb0 con 0x7ff1100c68f0 2023-12-01T23:19:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.538+0000 7ff10effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.538+0000 7ff10ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff1101ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.538+0000 7ff10effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45692/0 (socket says 172.21.15.96:45692) 2023-12-01T23:19:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.538+0000 7ff10effd640 1 -- 172.21.15.96:0/3209267902 learned_addr learned my addr 172.21.15.96:0/3209267902 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:09.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.538+0000 7ff10f7fe640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1100c68f0 0x7ff1101efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.541+0000 7ff10effd640 1 -- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1100c68f0 msgr2=0x7ff1101efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.541+0000 7ff10effd640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1100c68f0 0x7ff1101efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.541+0000 7ff10effd640 1 -- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 msgr2=0x7ff1101ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.541+0000 7ff10effd640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff1101ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.541+0000 7ff10effd640 1 -- 172.21.15.96:0/3209267902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108009a70 con 0x7ff110151720 2023-12-01T23:19:09.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.544+0000 7ff10effd640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c450 tx=0x7ff10400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.547+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040052d0 con 0x7ff110151720 2023-12-01T23:19:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.547+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104005430 con 0x7ff110151720 2023-12-01T23:19:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.547+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1101f2a20 con 0x7ff110151720 2023-12-01T23:19:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.547+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104012870 con 0x7ff110151720 2023-12-01T23:19:09.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.547+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1101f2fe0 con 0x7ff110151720 2023-12-01T23:19:09.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.548+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1100cce50 con 0x7ff110151720 2023-12-01T23:19:09.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.795+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1040129d0 con 0x7ff110151720 2023-12-01T23:19:09.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.795+0000 7ff0f7fff640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 0x7ff0fc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:09.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.795+0000 7ff10f7fe640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 0x7ff0fc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:09.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.796+0000 7ff10f7fe640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 0x7ff0fc06d350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff100009bd0 tx=0x7ff100009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:09.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.807+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff104058940 con 0x7ff110151720 2023-12-01T23:19:09.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.807+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff104054c80 con 0x7ff110151720 2023-12-01T23:19:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.974+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff110067710 con 0x7ff110151720 2023-12-01T23:19:09.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.979+0000 7ff0f7fff640 1 -- 172.21.15.96:0/3209267902 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff1040582a0 con 0x7ff110151720 2023-12-01T23:19:09.981 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.980+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 msgr2=0x7ff0fc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 0x7ff0fc06d350 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff100009bd0 tx=0x7ff100009240 comp rx=0 tx=0).stop 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 msgr2=0x7ff1100cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c450 tx=0x7ff10400c910 comp rx=0 tx=0).stop 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 shutdown_connections 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff0fc06ae90 0x7ff0fc06d350 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff11015af60 0x7ff1101ebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff110151720 0x7ff1100cb1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 --2- 172.21.15.96:0/3209267902 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1100c68f0 0x7ff1101efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:09.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 >> 172.21.15.96:0/3209267902 conn(0x7ff1100cbef0 msgr2=0x7ff110150330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:09.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 shutdown_connections 2023-12-01T23:19:09.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:09.981+0000 7ff115dce640 1 -- 172.21.15.96:0/3209267902 wait complete. 2023-12-01T23:19:09.993 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:19:10.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.093+0000 7f1c542c2640 1 Processor -- start 2023-12-01T23:19:10.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.093+0000 7f1c542c2640 1 -- start start 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.094+0000 7f1c542c2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.094+0000 7f1c542c2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c4c0c2000 0x7f1c4c0c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.094+0000 7f1c542c2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0c29b0 con 0x7f1c4c157f50 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.094+0000 7f1c542c2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c15b9c0 con 0x7f1c4c0c2000 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.094+0000 7f1c542c2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c15ab60 con 0x7f1c4c151630 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.095+0000 7f1c5185d640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1c4c157f50 0x7f1c4c0c9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33348/0 (socket says 172.21.15.96:33348) 2023-12-01T23:19:10.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.095+0000 7f1c5285f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c4c0c2000 0x7f1c4c0c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.095+0000 7f1c5185d640 1 -- 172.21.15.96:0/3851484199 learned_addr learned my addr 172.21.15.96:0/3851484199 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:10.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.095+0000 7f1c5205e640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5105c640 1 -- 172.21.15.96:0/3851484199 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962264041 0 0) 0x7f1c4c0c29b0 con 0x7f1c4c157f50 2023-12-01T23:19:10.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5105c640 1 -- 172.21.15.96:0/3851484199 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c34003520 con 0x7f1c4c157f50 2023-12-01T23:19:10.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5285f640 1 -- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 msgr2=0x7f1c4c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:10.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5285f640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c06f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5285f640 1 -- 172.21.15.96:0/3851484199 >> v1:172.21.15.96:6789/0 conn(0x7f1c4c157f50 legacy=0x7f1c4c0c9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.098+0000 7f1c5285f640 1 -- 172.21.15.96:0/3851484199 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c15ae40 con 0x7f1c4c0c2000 2023-12-01T23:19:10.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.101+0000 7f1c5285f640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c0c2470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097a0 tx=0x7f1c3c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd656b9b4564cefa server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.104+0000 7f1c5105c640 1 -- 172.21.15.96:0/3851484199 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c030610 con 0x7f1c4c0c2000 2023-12-01T23:19:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c5105c640 1 -- 172.21.15.96:0/3851484199 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c030770 con 0x7f1c4c0c2000 2023-12-01T23:19:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c5105c640 1 -- 172.21.15.96:0/3851484199 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c030b00 con 0x7f1c4c0c2000 2023-12-01T23:19:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 -- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c0c2000 msgr2=0x7f1c4c0c2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c0c2470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097a0 tx=0x7f1c3c02b960 comp rx=0 tx=0).stop 2023-12-01T23:19:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 -- 172.21.15.96:0/3851484199 shutdown_connections 2023-12-01T23:19:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c0c2470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 --2- 172.21.15.96:0/3851484199 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 -- 172.21.15.96:0/3851484199 >> 172.21.15.96:0/3851484199 conn(0x7f1c4c061100 msgr2=0x7f1c4c0614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 -- 172.21.15.96:0/3851484199 shutdown_connections 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.105+0000 7f1c542c2640 1 -- 172.21.15.96:0/3851484199 wait complete. 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.106+0000 7f1c542c2640 1 Processor -- start 2023-12-01T23:19:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.106+0000 7f1c542c2640 1 -- start start 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c157f50 0x7f1c4c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c147d10 con 0x7f1c4c0c2000 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14eb70 con 0x7f1c4c157f50 2023-12-01T23:19:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.107+0000 7f1c542c2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c146e40 con 0x7f1c4c151630 2023-12-01T23:19:10.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.108+0000 7f1c5205e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.108+0000 7f1c5205e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45696/0 (socket says 172.21.15.96:45696) 2023-12-01T23:19:10.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.108+0000 7f1c5205e640 1 -- 172.21.15.96:0/1724034084 learned_addr learned my addr 172.21.15.96:0/1724034084 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:10.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.108+0000 7f1c5285f640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c157f50 0x7f1c4c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.108+0000 7f1c5185d640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.111+0000 7f1c5205e640 1 -- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 msgr2=0x7f1c4c159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.111+0000 7f1c5205e640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.111+0000 7f1c5205e640 1 -- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c157f50 msgr2=0x7f1c4c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.111+0000 7f1c5205e640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c157f50 0x7f1c4c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.111+0000 7f1c5205e640 1 -- 172.21.15.96:0/1724034084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c009400 con 0x7f1c4c0c2000 2023-12-01T23:19:10.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.113+0000 7f1c5205e640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400efc0 tx=0x7f1c4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.117+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44014480 con 0x7f1c4c0c2000 2023-12-01T23:19:10.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.117+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400f040 con 0x7f1c4c0c2000 2023-12-01T23:19:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.117+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c147100 con 0x7f1c4c0c2000 2023-12-01T23:19:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.117+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44014800 con 0x7f1c4c0c2000 2023-12-01T23:19:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.117+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c1476c0 con 0x7f1c4c0c2000 2023-12-01T23:19:10.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.118+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c0740e0 con 0x7f1c4c0c2000 2023-12-01T23:19:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.359+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c44014960 con 0x7f1c4c0c2000 2023-12-01T23:19:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.359+0000 7f1c4affd640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 0x7f1c3806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.359+0000 7f1c5185d640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 0x7f1c3806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.360+0000 7f1c5185d640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 0x7f1c3806d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c1e7380 tx=0x7f1c40009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.372+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c440595b0 con 0x7f1c4c0c2000 2023-12-01T23:19:10.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.373+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c44088e60 con 0x7f1c4c0c2000 2023-12-01T23:19:10.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.545+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c4c150260 con 0x7f1c4c0c2000 2023-12-01T23:19:10.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.567+0000 7f1c4affd640 1 -- 172.21.15.96:0/1724034084 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c440558f0 con 0x7f1c4c0c2000 2023-12-01T23:19:10.570 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 msgr2=0x7f1c3806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 0x7f1c3806d380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c1e7380 tx=0x7f1c40009040 comp rx=0 tx=0).stop 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 msgr2=0x7f1c4c14e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c4400efc0 tx=0x7f1c4400c490 comp rx=0 tx=0).stop 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 shutdown_connections 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1c3806aec0 0x7f1c3806d380 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4c157f50 0x7f1c4c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4c151630 0x7f1c4c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 --2- 172.21.15.96:0/1724034084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c4c0c2000 0x7f1c4c14e630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 >> 172.21.15.96:0/1724034084 conn(0x7f1c4c061100 msgr2=0x7f1c4c0c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:10.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 shutdown_connections 2023-12-01T23:19:10.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.570+0000 7f1c542c2640 1 -- 172.21.15.96:0/1724034084 wait complete. 2023-12-01T23:19:10.583 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:19:10.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.684+0000 7f496350c640 1 Processor -- start 2023-12-01T23:19:10.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.684+0000 7f496350c640 1 -- start start 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.685+0000 7f496350c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f495c159860 0x7f495c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.685+0000 7f496350c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495c072b60 con 0x7f495c0bff00 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.685+0000 7f496350c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495c0c1a90 con 0x7f495c1501c0 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.685+0000 7f496350c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495c159c80 con 0x7f495c159860 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.686+0000 7f4960aa7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f495c0bff00 0x7f495c071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33352/0 (socket says 172.21.15.96:33352) 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.686+0000 7f4960aa7640 1 -- 172.21.15.96:0/3325466094 learned_addr learned my addr 172.21.15.96:0/3325466094 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:10.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.686+0000 7f4961aa9640 1 --2- 172.21.15.96:0/3325466094 >> v2:172.21.15.102:3300/0 conn(0x7f495c159860 0x7f495c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.688+0000 7f4953fff640 1 -- 172.21.15.96:0/3325466094 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704833280 0 0) 0x7f495c072b60 con 0x7f495c0bff00 2023-12-01T23:19:10.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.688+0000 7f4953fff640 1 -- 172.21.15.96:0/3325466094 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4948003520 con 0x7f495c0bff00 2023-12-01T23:19:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.689+0000 7f4961aa9640 1 -- 172.21.15.96:0/3325466094 >> v1:172.21.15.102:6789/0 conn(0x7f495c1501c0 legacy=0x7f495c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.689+0000 7f4961aa9640 1 -- 172.21.15.96:0/3325466094 >> v1:172.21.15.96:6789/0 conn(0x7f495c0bff00 legacy=0x7f495c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.689+0000 7f4961aa9640 1 -- 172.21.15.96:0/3325466094 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0c1d30 con 0x7f495c159860 2023-12-01T23:19:10.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.692+0000 7f4961aa9640 1 --2- 172.21.15.96:0/3325466094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c156e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49540097a0 tx=0x7f495402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3011313631279036 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f4953fff640 1 -- 172.21.15.96:0/3325466094 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495402f810 con 0x7f495c159860 2023-12-01T23:19:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f4953fff640 1 -- 172.21.15.96:0/3325466094 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495402f970 con 0x7f495c159860 2023-12-01T23:19:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f4953fff640 1 -- 172.21.15.96:0/3325466094 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495402fd00 con 0x7f495c159860 2023-12-01T23:19:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 -- 172.21.15.96:0/3325466094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 msgr2=0x7f495c156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 --2- 172.21.15.96:0/3325466094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c156e60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49540097a0 tx=0x7f495402b9f0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 -- 172.21.15.96:0/3325466094 shutdown_connections 2023-12-01T23:19:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 --2- 172.21.15.96:0/3325466094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c156e60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 -- 172.21.15.96:0/3325466094 >> 172.21.15.96:0/3325466094 conn(0x7f495c06cd60 msgr2=0x7f495c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 -- 172.21.15.96:0/3325466094 shutdown_connections 2023-12-01T23:19:10.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.697+0000 7f496350c640 1 -- 172.21.15.96:0/3325466094 wait complete. 2023-12-01T23:19:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 Processor -- start 2023-12-01T23:19:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 -- start start 2023-12-01T23:19:10.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f495c0bff00 0x7f495c0c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c0c32f0 con 0x7f495c1501c0 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c150b60 con 0x7f495c159860 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.698+0000 7f496350c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c1f1090 con 0x7f495c0bff00 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.699+0000 7f4960aa7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.699+0000 7f49612a8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f495c0bff00 0x7f495c0c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.699+0000 7f4961aa9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.699+0000 7f4960aa7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45698/0 (socket says 172.21.15.96:45698) 2023-12-01T23:19:10.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.699+0000 7f4960aa7640 1 -- 172.21.15.96:0/3327473783 learned_addr learned my addr 172.21.15.96:0/3327473783 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:10.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.703+0000 7f4960aa7640 1 -- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f495c0bff00 msgr2=0x7f495c0c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.703+0000 7f4960aa7640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f495c0bff00 0x7f495c0c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.703+0000 7f4960aa7640 1 -- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 msgr2=0x7f495c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:10.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.703+0000 7f4960aa7640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:10.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.703+0000 7f4960aa7640 1 -- 172.21.15.96:0/3327473783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4954009400 con 0x7f495c1501c0 2023-12-01T23:19:10.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.705+0000 7f4960aa7640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c440 tx=0x7f494c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c005ce0 con 0x7f495c1501c0 2023-12-01T23:19:10.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c005e40 con 0x7f495c1501c0 2023-12-01T23:19:10.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495c0c6c00 con 0x7f495c1501c0 2023-12-01T23:19:10.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c007310 con 0x7f495c1501c0 2023-12-01T23:19:10.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c1ecfb0 con 0x7f495c1501c0 2023-12-01T23:19:10.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.709+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c1ed140 con 0x7f495c1501c0 2023-12-01T23:19:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.952+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f494c007470 con 0x7f495c1501c0 2023-12-01T23:19:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.952+0000 7f4951ffb640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 0x7f494006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.952+0000 7f49612a8640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 0x7f494006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:10.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.953+0000 7f49612a8640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 0x7f494006d350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4958001f10 tx=0x7f4958009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.970+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f494c013e70 con 0x7f495c1501c0 2023-12-01T23:19:10.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:10.970+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f494c0542b0 con 0x7f495c1501c0 2023-12-01T23:19:11.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.139+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f495c150ff0 con 0x7f495c1501c0 2023-12-01T23:19:11.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.144+0000 7f4951ffb640 1 -- 172.21.15.96:0/3327473783 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f494c0578d0 con 0x7f495c1501c0 2023-12-01T23:19:11.145 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.145+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 msgr2=0x7f494006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.145+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 0x7f494006d350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4958001f10 tx=0x7f4958009040 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 msgr2=0x7f495c1f0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c440 tx=0x7f494c00c900 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 shutdown_connections 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f494006ae90 0x7f494006d350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f495c159860 0x7f495c06eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f495c1501c0 0x7f495c1f0b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 --2- 172.21.15.96:0/3327473783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f495c0bff00 0x7f495c0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 >> 172.21.15.96:0/3327473783 conn(0x7f495c06cd60 msgr2=0x7f495c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 shutdown_connections 2023-12-01T23:19:11.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.146+0000 7f496350c640 1 -- 172.21.15.96:0/3327473783 wait complete. 2023-12-01T23:19:11.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:19:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.257+0000 7fd3e1bec640 1 Processor -- start 2023-12-01T23:19:11.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.257+0000 7fd3e1bec640 1 -- start start 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3e1bec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 0x7fd3dc159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3e1bec640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 0x7fd3dc071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3e1bec640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc072b60 con 0x7fd3dc0bff00 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3e1bec640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc0c1a90 con 0x7fd3dc156e60 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3e1bec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0c1d30 con 0x7fd3dc1501c0 2023-12-01T23:19:11.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3dbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 0x7fd3dc071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.258+0000 7fd3db7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 0x7fd3dc159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.259+0000 7fd3dbfff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 0x7fd3dc071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45712/0 (socket says 172.21.15.96:45712) 2023-12-01T23:19:11.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.259+0000 7fd3dbfff640 1 -- 172.21.15.96:0/2927112038 learned_addr learned my addr 172.21.15.96:0/2927112038 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.261+0000 7fd3db7fe640 1 -- 172.21.15.96:0/2927112038 >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 msgr2=0x7fd3dc071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.261+0000 7fd3db7fe640 1 --2- 172.21.15.96:0/2927112038 >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 0x7fd3dc071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.261+0000 7fd3db7fe640 1 -- 172.21.15.96:0/2927112038 >> v1:172.21.15.96:6789/0 conn(0x7fd3dc0bff00 legacy=0x7fd3dc072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.261+0000 7fd3db7fe640 1 -- 172.21.15.96:0/2927112038 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc0c2010 con 0x7fd3dc1501c0 2023-12-01T23:19:11.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.263+0000 7fd3db7fe640 1 --2- 172.21.15.96:0/2927112038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 0x7fd3dc159860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0097a0 tx=0x7fd3cc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c14b2c6159f0cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:11.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.267+0000 7fd3da7fc640 1 -- 172.21.15.96:0/2927112038 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc030610 con 0x7fd3dc1501c0 2023-12-01T23:19:11.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.267+0000 7fd3da7fc640 1 -- 172.21.15.96:0/2927112038 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc030770 con 0x7fd3dc1501c0 2023-12-01T23:19:11.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.267+0000 7fd3da7fc640 1 -- 172.21.15.96:0/2927112038 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc030b00 con 0x7fd3dc1501c0 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2927112038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 msgr2=0x7fd3dc159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2927112038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 0x7fd3dc159860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0097a0 tx=0x7fd3cc02b960 comp rx=0 tx=0).stop 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2927112038 shutdown_connections 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2927112038 >> v2:172.21.15.96:3300/0 conn(0x7fd3dc156e60 0x7fd3dc071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2927112038 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc1501c0 0x7fd3dc159860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2927112038 >> 172.21.15.96:0/2927112038 conn(0x7fd3dc06cd60 msgr2=0x7fd3dc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2927112038 shutdown_connections 2023-12-01T23:19:11.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.268+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2927112038 wait complete. 2023-12-01T23:19:11.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.269+0000 7fd3e1bec640 1 Processor -- start 2023-12-01T23:19:11.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.269+0000 7fd3e1bec640 1 -- start start 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3dc0bff00 0x7fd3dc13ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc156e60 0x7fd3dc1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc13b060 con 0x7fd3dc1501c0 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc13b2d0 con 0x7fd3dc0bff00 2023-12-01T23:19:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.270+0000 7fd3e1bec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc13bb70 con 0x7fd3dc156e60 2023-12-01T23:19:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.271+0000 7fd3daffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.271+0000 7fd3daffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45720/0 (socket says 172.21.15.96:45720) 2023-12-01T23:19:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.271+0000 7fd3dbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc156e60 0x7fd3dc1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.271+0000 7fd3daffd640 1 -- 172.21.15.96:0/2340018301 learned_addr learned my addr 172.21.15.96:0/2340018301 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.271+0000 7fd3db7fe640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3dc0bff00 0x7fd3dc13ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.274+0000 7fd3daffd640 1 -- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc156e60 msgr2=0x7fd3dc1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.274+0000 7fd3daffd640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc156e60 0x7fd3dc1420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.274+0000 7fd3daffd640 1 -- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3dc0bff00 msgr2=0x7fd3dc13ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.274+0000 7fd3daffd640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3dc0bff00 0x7fd3dc13ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.274+0000 7fd3daffd640 1 -- 172.21.15.96:0/2340018301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc009400 con 0x7fd3dc1501c0 2023-12-01T23:19:11.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.277+0000 7fd3daffd640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c460 tx=0x7fd3d000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:11.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.280+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00052d0 con 0x7fd3dc1501c0 2023-12-01T23:19:11.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.280+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d0005450 con 0x7fd3dc1501c0 2023-12-01T23:19:11.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.280+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0007260 con 0x7fd3dc1501c0 2023-12-01T23:19:11.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.280+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc1edae0 con 0x7fd3dc1501c0 2023-12-01T23:19:11.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.280+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc13b520 con 0x7fd3dc1501c0 2023-12-01T23:19:11.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.281+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc0c77e0 con 0x7fd3dc1501c0 2023-12-01T23:19:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.520+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd3d00073c0 con 0x7fd3dc1501c0 2023-12-01T23:19:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.520+0000 7fd3c3fff640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 0x7fd3c806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.520+0000 7fd3db7fe640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 0x7fd3c806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.521+0000 7fd3db7fe640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 0x7fd3c806d380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc036000 tx=0x7fd3cc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:11.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.534+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd3d0007670 con 0x7fd3dc1501c0 2023-12-01T23:19:11.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.534+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3d0053fc0 con 0x7fd3dc1501c0 2023-12-01T23:19:11.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.742+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3dc067500 con 0x7fd3dc1501c0 2023-12-01T23:19:11.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.755+0000 7fd3c3fff640 1 -- 172.21.15.96:0/2340018301 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7fd3d0020020 con 0x7fd3dc1501c0 2023-12-01T23:19:11.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:11.756 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:19:11.756 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.756+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 msgr2=0x7fd3c806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.756+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 0x7fd3c806d380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc036000 tx=0x7fd3cc008030 comp rx=0 tx=0).stop 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.756+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 msgr2=0x7fd3dc1f0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.756+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd3d000c460 tx=0x7fd3d000c920 comp rx=0 tx=0).stop 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 shutdown_connections 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd3c806aec0 0x7fd3c806d380 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3dc156e60 0x7fd3dc1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3dc1501c0 0x7fd3dc1f0550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 --2- 172.21.15.96:0/2340018301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3dc0bff00 0x7fd3dc13ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 >> 172.21.15.96:0/2340018301 conn(0x7fd3dc06cd60 msgr2=0x7fd3dc070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:11.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 shutdown_connections 2023-12-01T23:19:11.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.757+0000 7fd3e1bec640 1 -- 172.21.15.96:0/2340018301 wait complete. 2023-12-01T23:19:11.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:19:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.868+0000 7f88cb139640 1 Processor -- start 2023-12-01T23:19:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.868+0000 7f88cb139640 1 -- start start 2023-12-01T23:19:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88cb139640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88c40728b0 0x7f88c40c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88cb139640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c415b6e0 con 0x7f88c4151510 2023-12-01T23:19:11.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88cb139640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c415a880 con 0x7f88c40c5fd0 2023-12-01T23:19:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88cb139640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c40c6460 con 0x7f88c40728b0 2023-12-01T23:19:11.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88c8ed5640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f88c4151510 0x7f88c40cae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33372/0 (socket says 172.21.15.96:33372) 2023-12-01T23:19:11.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88c8ed5640 1 -- 172.21.15.96:0/1121038754 learned_addr learned my addr 172.21.15.96:0/1121038754 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:11.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.869+0000 7f88bbfff640 1 --2- 172.21.15.96:0/1121038754 >> v2:172.21.15.102:3300/0 conn(0x7f88c40728b0 0x7f88c40c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.872+0000 7f88bb7fe640 1 -- 172.21.15.96:0/1121038754 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925004511 0 0) 0x7f88c415b6e0 con 0x7f88c4151510 2023-12-01T23:19:11.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.872+0000 7f88bb7fe640 1 -- 172.21.15.96:0/1121038754 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac003520 con 0x7f88c4151510 2023-12-01T23:19:11.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.874+0000 7f88bbfff640 1 -- 172.21.15.96:0/1121038754 >> v1:172.21.15.102:6789/0 conn(0x7f88c40c5fd0 legacy=0x7f88c4161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.874+0000 7f88bbfff640 1 -- 172.21.15.96:0/1121038754 >> v1:172.21.15.96:6789/0 conn(0x7f88c4151510 legacy=0x7f88c40cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.874+0000 7f88bbfff640 1 -- 172.21.15.96:0/1121038754 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c406f7e0 con 0x7f88c40728b0 2023-12-01T23:19:11.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.878+0000 7f88bbfff640 1 --2- 172.21.15.96:0/1121038754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c40c5a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88b40097a0 tx=0x7f88b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7d2d26284c2fc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.882+0000 7f88bb7fe640 1 -- 172.21.15.96:0/1121038754 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4030610 con 0x7f88c40728b0 2023-12-01T23:19:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.882+0000 7f88bb7fe640 1 -- 172.21.15.96:0/1121038754 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b4030770 con 0x7f88c40728b0 2023-12-01T23:19:11.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.882+0000 7f88bb7fe640 1 -- 172.21.15.96:0/1121038754 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4030b00 con 0x7f88c40728b0 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.882+0000 7f88cb139640 1 -- 172.21.15.96:0/1121038754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 msgr2=0x7f88c40c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.882+0000 7f88cb139640 1 --2- 172.21.15.96:0/1121038754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c40c5a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f88b40097a0 tx=0x7f88b402b960 comp rx=0 tx=0).stop 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.883+0000 7f88cb139640 1 -- 172.21.15.96:0/1121038754 shutdown_connections 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.883+0000 7f88cb139640 1 --2- 172.21.15.96:0/1121038754 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c40c5a90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.883+0000 7f88cb139640 1 -- 172.21.15.96:0/1121038754 >> 172.21.15.96:0/1121038754 conn(0x7f88c406cd60 msgr2=0x7f88c406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.883+0000 7f88cb139640 1 -- 172.21.15.96:0/1121038754 shutdown_connections 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.883+0000 7f88cb139640 1 -- 172.21.15.96:0/1121038754 wait complete. 2023-12-01T23:19:11.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.884+0000 7f88cb139640 1 Processor -- start 2023-12-01T23:19:11.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.884+0000 7f88cb139640 1 -- start start 2023-12-01T23:19:11.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c4159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88c4151510 0x7f88c41ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41ecbd0 con 0x7f88c40c5fd0 2023-12-01T23:19:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c414c600 con 0x7f88c40728b0 2023-12-01T23:19:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88cb139640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c414bc00 con 0x7f88c4151510 2023-12-01T23:19:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88c8ed5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88c96d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88c4151510 0x7f88c41ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88bbfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45730/0 (socket says 172.21.15.96:45730) 2023-12-01T23:19:11.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.885+0000 7f88bbfff640 1 -- 172.21.15.96:0/3382735058 learned_addr learned my addr 172.21.15.96:0/3382735058 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88c8ed5640 1 -- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88c4151510 msgr2=0x7f88c41ed560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88c8ed5640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88c4151510 0x7f88c41ed560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88c8ed5640 1 -- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 msgr2=0x7f88c41ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88c8ed5640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88c8ed5640 1 -- 172.21.15.96:0/3382735058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009400 con 0x7f88c40728b0 2023-12-01T23:19:11.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.889+0000 7f88bbfff640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:19:11.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.891+0000 7f88c8ed5640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c4159920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c3c0 tx=0x7f88c0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:11.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.895+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0005ce0 con 0x7f88c40728b0 2023-12-01T23:19:11.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.895+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0005e40 con 0x7f88c40728b0 2023-12-01T23:19:11.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.895+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00072d0 con 0x7f88c40728b0 2023-12-01T23:19:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.895+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c414c320 con 0x7f88c40728b0 2023-12-01T23:19:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.895+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c414be80 con 0x7f88c40728b0 2023-12-01T23:19:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.896+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4067500 con 0x7f88c40728b0 2023-12-01T23:19:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.916+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88c0007430 con 0x7f88c40728b0 2023-12-01T23:19:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.916+0000 7f88b97fa640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 0x7f88b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:11.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.916+0000 7f88bbfff640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 0x7f88b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:11.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:11.916+0000 7f88bbfff640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 0x7f88b006d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f88c406f2f0 tx=0x7f88b4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.142+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f88c0057df0 con 0x7f88c40728b0 2023-12-01T23:19:12.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.152+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88c0054130 con 0x7f88c40728b0 2023-12-01T23:19:12.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.319+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88c414fd70 con 0x7f88c40728b0 2023-12-01T23:19:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.361+0000 7f88b97fa640 1 -- 172.21.15.96:0/3382735058 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f88c0057750 con 0x7f88c40728b0 2023-12-01T23:19:12.363 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:12.363 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.363+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 msgr2=0x7f88b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.363+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 0x7f88b006d380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f88c406f2f0 tx=0x7f88b4008030 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.363+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 msgr2=0x7f88c4159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.363+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c4159920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c3c0 tx=0x7f88c0001e70 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 shutdown_connections 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f88b006aec0 0x7f88b006d380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88c4151510 0x7f88c41ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f88c40c5fd0 0x7f88c41ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 --2- 172.21.15.96:0/3382735058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88c40728b0 0x7f88c4159920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 >> 172.21.15.96:0/3382735058 conn(0x7f88c406cd60 msgr2=0x7f88c414dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 shutdown_connections 2023-12-01T23:19:12.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.364+0000 7f88cb139640 1 -- 172.21.15.96:0/3382735058 wait complete. 2023-12-01T23:19:12.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:19:12.376 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:19:12.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.479+0000 7fa82d417640 1 Processor -- start 2023-12-01T23:19:12.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.479+0000 7fa82d417640 1 -- start start 2023-12-01T23:19:12.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa82d417640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa828153c70 0x7fa82815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa82d417640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82815a700 con 0x7fa828153890 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa82d417640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280ca870 con 0x7fa8280ceef0 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa82d417640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa828159af0 con 0x7fa828153c70 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa826ffd640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fa828153890 0x7fa8280c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33376/0 (socket says 172.21.15.96:33376) 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.480+0000 7fa826ffd640 1 -- 172.21.15.96:0/749337018 learned_addr learned my addr 172.21.15.96:0/749337018 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:12.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.481+0000 7fa8267fc640 1 --2- 172.21.15.96:0/749337018 >> v2:172.21.15.102:3300/0 conn(0x7fa828153c70 0x7fa82815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:12.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.483+0000 7fa825ffb640 1 -- 172.21.15.96:0/749337018 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120503087 0 0) 0x7fa82815a700 con 0x7fa828153890 2023-12-01T23:19:12.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.483+0000 7fa825ffb640 1 -- 172.21.15.96:0/749337018 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa810003520 con 0x7fa828153890 2023-12-01T23:19:12.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.484+0000 7fa8267fc640 1 -- 172.21.15.96:0/749337018 >> v1:172.21.15.102:6789/0 conn(0x7fa8280ceef0 legacy=0x7fa82815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.484+0000 7fa8267fc640 1 -- 172.21.15.96:0/749337018 >> v1:172.21.15.96:6789/0 conn(0x7fa828153890 legacy=0x7fa8280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.484+0000 7fa8267fc640 1 -- 172.21.15.96:0/749337018 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828159dd0 con 0x7fa828153c70 2023-12-01T23:19:12.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.488+0000 7fa8267fc640 1 --2- 172.21.15.96:0/749337018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa828153c70 0x7fa82815d950 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097a0 tx=0x7fa81c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6be0ba9b2ea77d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:12.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.492+0000 7fa825ffb640 1 -- 172.21.15.96:0/749337018 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c02f810 con 0x7fa828153c70 2023-12-01T23:19:12.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa825ffb640 1 -- 172.21.15.96:0/749337018 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c02f970 con 0x7fa828153c70 2023-12-01T23:19:12.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa825ffb640 1 -- 172.21.15.96:0/749337018 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c02fd00 con 0x7fa828153c70 2023-12-01T23:19:12.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 -- 172.21.15.96:0/749337018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa828153c70 msgr2=0x7fa82815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 --2- 172.21.15.96:0/749337018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa828153c70 0x7fa82815d950 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0097a0 tx=0x7fa81c02b9f0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 -- 172.21.15.96:0/749337018 shutdown_connections 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 --2- 172.21.15.96:0/749337018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa828153c70 0x7fa82815d950 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 -- 172.21.15.96:0/749337018 >> 172.21.15.96:0/749337018 conn(0x7fa82806ba00 msgr2=0x7fa82806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 -- 172.21.15.96:0/749337018 shutdown_connections 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.493+0000 7fa82d417640 1 -- 172.21.15.96:0/749337018 wait complete. 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 Processor -- start 2023-12-01T23:19:12.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 -- start start 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8280ceef0 0x7fa8280b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa828153c70 0x7fa82814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814ec70 con 0x7fa828153890 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82814a230 con 0x7fa8280ceef0 2023-12-01T23:19:12.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.495+0000 7fa82d417640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa828154130 con 0x7fa828153c70 2023-12-01T23:19:12.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.496+0000 7fa8267fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.496+0000 7fa826ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8280ceef0 0x7fa8280b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.496+0000 7fa8277fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa828153c70 0x7fa82814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.496+0000 7fa8267fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45732/0 (socket says 172.21.15.96:45732) 2023-12-01T23:19:12.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.496+0000 7fa8267fc640 1 -- 172.21.15.96:0/236423582 learned_addr learned my addr 172.21.15.96:0/236423582 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:12.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.499+0000 7fa8267fc640 1 -- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa828153c70 msgr2=0x7fa82814f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.499+0000 7fa8267fc640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa828153c70 0x7fa82814f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.499+0000 7fa8267fc640 1 -- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8280ceef0 msgr2=0x7fa8280b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.499+0000 7fa8267fc640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8280ceef0 0x7fa8280b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.499+0000 7fa8267fc640 1 -- 172.21.15.96:0/236423582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009400 con 0x7fa828153890 2023-12-01T23:19:12.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.502+0000 7fa8267fc640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02c000 tx=0x7fa81c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.505+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c03c040 con 0x7fa828153890 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.505+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c0378f0 con 0x7fa828153890 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.505+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c037ca0 con 0x7fa828153890 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.505+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa828154410 con 0x7fa828153890 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.505+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8281549d0 con 0x7fa828153890 2023-12-01T23:19:12.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.506+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa828067500 con 0x7fa828153890 2023-12-01T23:19:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.524+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa81c04b3b0 con 0x7fa828153890 2023-12-01T23:19:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.525+0000 7fa80f7fe640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 0x7fa81406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:12.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.525+0000 7fa826ffd640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 0x7fa81406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:12.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.525+0000 7fa826ffd640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 0x7fa81406d380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa818001560 tx=0x7fa818001a90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:12.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.527+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa81c07a5c0 con 0x7fa828153890 2023-12-01T23:19:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.759+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa81c076900 con 0x7fa828153890 2023-12-01T23:19:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.932+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa82815ce20 con 0x7fa828153890 2023-12-01T23:19:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.937+0000 7fa80f7fe640 1 -- 172.21.15.96:0/236423582 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa81c0470a0 con 0x7fa828153890 2023-12-01T23:19:12.938 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:19:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 msgr2=0x7fa81406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 0x7fa81406d380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa818001560 tx=0x7fa818001a90 comp rx=0 tx=0).stop 2023-12-01T23:19:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 msgr2=0x7fa828149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02c000 tx=0x7fa81c004730 comp rx=0 tx=0).stop 2023-12-01T23:19:12.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 shutdown_connections 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa81406aec0 0x7fa81406d380 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa828153c70 0x7fa82814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa828153890 0x7fa828149cf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 --2- 172.21.15.96:0/236423582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8280ceef0 0x7fa8280b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 >> 172.21.15.96:0/236423582 conn(0x7fa82806ba00 msgr2=0x7fa8281507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 shutdown_connections 2023-12-01T23:19:12.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:12.939+0000 7fa82d417640 1 -- 172.21.15.96:0/236423582 wait complete. 2023-12-01T23:19:12.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:19:13.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.052+0000 7f1e3896e640 1 Processor -- start 2023-12-01T23:19:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 -- start start 2023-12-01T23:19:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1e3414cc60 0x7f1e340bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e340caed0 con 0x7f1e34156b90 2023-12-01T23:19:13.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e34156770 con 0x7f1e3414cc60 2023-12-01T23:19:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.053+0000 7f1e3896e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e340c0ee0 con 0x7f1e340c58e0 2023-12-01T23:19:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.054+0000 7f1e3259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1e3414cc60 0x7f1e340bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.054+0000 7f1e2bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.054+0000 7f1e2bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57890/0 (socket says 172.21.15.96:57890) 2023-12-01T23:19:13.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.054+0000 7f1e2bfff640 1 -- 172.21.15.96:0/2697451756 learned_addr learned my addr 172.21.15.96:0/2697451756 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.056+0000 7f1e2bfff640 1 -- 172.21.15.96:0/2697451756 >> v2:172.21.15.96:3300/0 conn(0x7f1e3414cc60 msgr2=0x7f1e340bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.056+0000 7f1e2bfff640 1 --2- 172.21.15.96:0/2697451756 >> v2:172.21.15.96:3300/0 conn(0x7f1e3414cc60 0x7f1e340bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.056+0000 7f1e2bfff640 1 -- 172.21.15.96:0/2697451756 >> v1:172.21.15.96:6789/0 conn(0x7f1e34156b90 legacy=0x7f1e340c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.056+0000 7f1e2bfff640 1 -- 172.21.15.96:0/2697451756 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340cb170 con 0x7f1e340c58e0 2023-12-01T23:19:13.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.058+0000 7f1e2bfff640 1 --2- 172.21.15.96:0/2697451756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00bb10 tx=0x7f1e1c02e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0bbd12cb258056e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.062+0000 7f1e31d9b640 1 -- 172.21.15.96:0/2697451756 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c036440 con 0x7f1e340c58e0 2023-12-01T23:19:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.062+0000 7f1e31d9b640 1 -- 172.21.15.96:0/2697451756 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c0365a0 con 0x7f1e340c58e0 2023-12-01T23:19:13.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.062+0000 7f1e31d9b640 1 -- 172.21.15.96:0/2697451756 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c036930 con 0x7f1e340c58e0 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 -- 172.21.15.96:0/2697451756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 msgr2=0x7f1e34072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 --2- 172.21.15.96:0/2697451756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00bb10 tx=0x7f1e1c02e150 comp rx=0 tx=0).stop 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 -- 172.21.15.96:0/2697451756 shutdown_connections 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 --2- 172.21.15.96:0/2697451756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e34072490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 --2- 172.21.15.96:0/2697451756 >> v2:172.21.15.96:3300/0 conn(0x7f1e3414cc60 0x7f1e340bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 -- 172.21.15.96:0/2697451756 >> 172.21.15.96:0/2697451756 conn(0x7f1e3406cd60 msgr2=0x7f1e3406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 -- 172.21.15.96:0/2697451756 shutdown_connections 2023-12-01T23:19:13.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.063+0000 7f1e3896e640 1 -- 172.21.15.96:0/2697451756 wait complete. 2023-12-01T23:19:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.064+0000 7f1e3896e640 1 Processor -- start 2023-12-01T23:19:13.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.064+0000 7f1e3896e640 1 -- start start 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e341eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e34156b90 0x7f1e34157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e341ef1f0 con 0x7f1e3414cc60 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e34150010 con 0x7f1e34156b90 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e3896e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e341eae20 con 0x7f1e340c58e0 2023-12-01T23:19:13.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.065+0000 7f1e32d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e34156b90 0x7f1e34157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.066+0000 7f1e3259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e341eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.066+0000 7f1e2bfff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45742/0 (socket says 172.21.15.96:45742) 2023-12-01T23:19:13.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.066+0000 7f1e2bfff640 1 -- 172.21.15.96:0/4080479511 learned_addr learned my addr 172.21.15.96:0/4080479511 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.069+0000 7f1e2bfff640 1 -- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 msgr2=0x7f1e341eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.069+0000 7f1e2bfff640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e341eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.069+0000 7f1e2bfff640 1 -- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e34156b90 msgr2=0x7f1e34157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.069+0000 7f1e2bfff640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e34156b90 0x7f1e34157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.069+0000 7f1e2bfff640 1 -- 172.21.15.96:0/4080479511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c00b770 con 0x7f1e3414cc60 2023-12-01T23:19:13.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.071+0000 7f1e2bfff640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00b2c0 tx=0x7f1e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.074+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c036440 con 0x7f1e3414cc60 2023-12-01T23:19:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.075+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c034980 con 0x7f1e3414cc60 2023-12-01T23:19:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.075+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e341eb100 con 0x7f1e3414cc60 2023-12-01T23:19:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.075+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c034d10 con 0x7f1e3414cc60 2023-12-01T23:19:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.075+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e341502b0 con 0x7f1e3414cc60 2023-12-01T23:19:13.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.076+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e34067500 con 0x7f1e3414cc60 2023-12-01T23:19:13.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.317+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e1c053480 con 0x7f1e3414cc60 2023-12-01T23:19:13.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.317+0000 7f1e2affd640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 0x7f1e1406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.317+0000 7f1e3259c640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 0x7f1e1406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.318+0000 7f1e3259c640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 0x7f1e1406d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009b40 tx=0x7f1e24009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.329+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e1c07d720 con 0x7f1e3414cc60 2023-12-01T23:19:13.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.330+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e1c079a60 con 0x7f1e3414cc60 2023-12-01T23:19:13.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.498+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e34072270 con 0x7f1e3414cc60 2023-12-01T23:19:13.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.504+0000 7f1e2affd640 1 -- 172.21.15.96:0/4080479511 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e1c03b020 con 0x7f1e3414cc60 2023-12-01T23:19:13.505 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:19:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 msgr2=0x7f1e1406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 0x7f1e1406d350 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009b40 tx=0x7f1e24009190 comp rx=0 tx=0).stop 2023-12-01T23:19:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 msgr2=0x7f1e34158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00b2c0 tx=0x7f1e1c0046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 shutdown_connections 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1e1406ae90 0x7f1e1406d350 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e34156b90 0x7f1e34157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e3414cc60 0x7f1e34158080 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 --2- 172.21.15.96:0/4080479511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e340c58e0 0x7f1e341eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 >> 172.21.15.96:0/4080479511 conn(0x7f1e3406cd60 msgr2=0x7f1e340c7140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 shutdown_connections 2023-12-01T23:19:13.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.506+0000 7f1e3896e640 1 -- 172.21.15.96:0/4080479511 wait complete. 2023-12-01T23:19:13.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:19:13.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.620+0000 7f71bf0ad640 1 Processor -- start 2023-12-01T23:19:13.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.620+0000 7f71bf0ad640 1 -- start start 2023-12-01T23:19:13.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.621+0000 7f71bf0ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b8153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.621+0000 7f71bf0ad640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b80ca6c0 con 0x7f71b80c7700 2023-12-01T23:19:13.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.621+0000 7f71bf0ad640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8159880 con 0x7f71b8070d00 2023-12-01T23:19:13.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.621+0000 7f71bf0ad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b8159b60 con 0x7f71b80710e0 2023-12-01T23:19:13.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.622+0000 7f71b7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b8153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.622+0000 7f71bd64a640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f71b80c7700 0x7f71b80c8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33392/0 (socket says 172.21.15.96:33392) 2023-12-01T23:19:13.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.622+0000 7f71bd64a640 1 -- 172.21.15.96:0/3654204551 learned_addr learned my addr 172.21.15.96:0/3654204551 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:13.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.624+0000 7f71b77fe640 1 -- 172.21.15.96:0/3654204551 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138322166 0 0) 0x7f71b80ca6c0 con 0x7f71b80c7700 2023-12-01T23:19:13.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.624+0000 7f71b77fe640 1 -- 172.21.15.96:0/3654204551 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a0003520 con 0x7f71b80c7700 2023-12-01T23:19:13.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.624+0000 7f71b7fff640 1 -- 172.21.15.96:0/3654204551 >> v1:172.21.15.102:6789/0 conn(0x7f71b8070d00 legacy=0x7f71b815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.624+0000 7f71b7fff640 1 -- 172.21.15.96:0/3654204551 >> v1:172.21.15.96:6789/0 conn(0x7f71b80c7700 legacy=0x7f71b80c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.624+0000 7f71b7fff640 1 -- 172.21.15.96:0/3654204551 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8159e40 con 0x7f71b80710e0 2023-12-01T23:19:13.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.627+0000 7f71b7fff640 1 --2- 172.21.15.96:0/3654204551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b8153380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0097d0 tx=0x7f71ac02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6749065a395d9634 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.630+0000 7f71b77fe640 1 -- 172.21.15.96:0/3654204551 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac030880 con 0x7f71b80710e0 2023-12-01T23:19:13.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.630+0000 7f71b77fe640 1 -- 172.21.15.96:0/3654204551 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac0309e0 con 0x7f71b80710e0 2023-12-01T23:19:13.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.630+0000 7f71b77fe640 1 -- 172.21.15.96:0/3654204551 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac030d70 con 0x7f71b80710e0 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 -- 172.21.15.96:0/3654204551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 msgr2=0x7f71b8153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/3654204551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b8153380 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0097d0 tx=0x7f71ac02b9c0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 -- 172.21.15.96:0/3654204551 shutdown_connections 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/3654204551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b8153380 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 -- 172.21.15.96:0/3654204551 >> 172.21.15.96:0/3654204551 conn(0x7f71b806ab30 msgr2=0x7f71b806ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 -- 172.21.15.96:0/3654204551 shutdown_connections 2023-12-01T23:19:13.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.631+0000 7f71bf0ad640 1 -- 172.21.15.96:0/3654204551 wait complete. 2023-12-01T23:19:13.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.632+0000 7f71bf0ad640 1 Processor -- start 2023-12-01T23:19:13.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.632+0000 7f71bf0ad640 1 -- start start 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b81f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71b80c7700 0x7f71b81f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b814e970 con 0x7f71b8070d00 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81f2600 con 0x7f71b80c7700 2023-12-01T23:19:13.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bf0ad640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b814d070 con 0x7f71b80710e0 2023-12-01T23:19:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.633+0000 7f71bce49640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.634+0000 7f71bd64a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71b80c7700 0x7f71b81f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.634+0000 7f71b7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b81f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.634+0000 7f71bce49640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45756/0 (socket says 172.21.15.96:45756) 2023-12-01T23:19:13.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.634+0000 7f71bce49640 1 -- 172.21.15.96:0/2271281495 learned_addr learned my addr 172.21.15.96:0/2271281495 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71b7fff640 1 -- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71b80c7700 msgr2=0x7f71b81f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71b7fff640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71b80c7700 0x7f71b81f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71b7fff640 1 -- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 msgr2=0x7f71b815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71b7fff640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71b7fff640 1 -- 172.21.15.96:0/2271281495 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009400 con 0x7f71b80710e0 2023-12-01T23:19:13.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.637+0000 7f71bce49640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:19:13.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.640+0000 7f71b7fff640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b81f2a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71ac033000 tx=0x7f71ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.644+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac03e040 con 0x7f71b80710e0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.644+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac039de0 con 0x7f71b80710e0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.644+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b814d350 con 0x7f71b80710e0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.644+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac043680 con 0x7f71b80710e0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.644+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b814d910 con 0x7f71b80710e0 2023-12-01T23:19:13.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.645+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b81f2790 con 0x7f71b80710e0 2023-12-01T23:19:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.664+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71ac0437e0 con 0x7f71b80710e0 2023-12-01T23:19:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.665+0000 7f71b57fa640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 0x7f71a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.665+0000 7f71bce49640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 0x7f71a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.665+0000 7f71bce49640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 0x7f71a406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001c30 tx=0x7f71a8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:13.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.668+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f71ac07b0d0 con 0x7f71b80710e0 2023-12-01T23:19:13.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:13.903+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71ac077410 con 0x7f71b80710e0 2023-12-01T23:19:14.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.082+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71b8067500 con 0x7f71b80710e0 2023-12-01T23:19:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.088+0000 7f71b57fa640 1 -- 172.21.15.96:0/2271281495 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71ac048020 con 0x7f71b80710e0 2023-12-01T23:19:14.089 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:19:14.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 msgr2=0x7f71a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 0x7f71a406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f71a8001c30 tx=0x7f71a8009040 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 msgr2=0x7f71b81f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b81f2a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71ac033000 tx=0x7f71ac004730 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 shutdown_connections 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f71a406ae70 0x7f71a406d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71b80c7700 0x7f71b81f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71b80710e0 0x7f71b81f2a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 --2- 172.21.15.96:0/2271281495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f71b8070d00 0x7f71b815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 >> 172.21.15.96:0/2271281495 conn(0x7f71b806ab30 msgr2=0x7f71b81573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 shutdown_connections 2023-12-01T23:19:14.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.090+0000 7f71bf0ad640 1 -- 172.21.15.96:0/2271281495 wait complete. 2023-12-01T23:19:14.102 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:19:14.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.203+0000 7f17a9fc9640 1 Processor -- start 2023-12-01T23:19:14.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.203+0000 7f17a9fc9640 1 -- start start 2023-12-01T23:19:14.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.204+0000 7f17a9fc9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.204+0000 7f17a9fc9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17a415d830 0x7f17a41533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.204+0000 7f17a9fc9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a415cc90 con 0x7f17a40ca1b0 2023-12-01T23:19:14.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.204+0000 7f17a9fc9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a41596a0 con 0x7f17a415d830 2023-12-01T23:19:14.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.204+0000 7f17a9fc9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c7c40 con 0x7f17a40c9dd0 2023-12-01T23:19:14.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.205+0000 7f17a3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f17a415d830 0x7f17a41533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.205+0000 7f17a37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.205+0000 7f17a37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57934/0 (socket says 172.21.15.96:57934) 2023-12-01T23:19:14.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.205+0000 7f17a37fe640 1 -- 172.21.15.96:0/3689553115 learned_addr learned my addr 172.21.15.96:0/3689553115 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:14.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.207+0000 7f17a37fe640 1 -- 172.21.15.96:0/3689553115 >> v2:172.21.15.96:3300/0 conn(0x7f17a415d830 msgr2=0x7f17a41533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:14.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.207+0000 7f17a37fe640 1 --2- 172.21.15.96:0/3689553115 >> v2:172.21.15.96:3300/0 conn(0x7f17a415d830 0x7f17a41533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.207+0000 7f17a37fe640 1 -- 172.21.15.96:0/3689553115 >> v1:172.21.15.96:6789/0 conn(0x7f17a40ca1b0 legacy=0x7f17a415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.207+0000 7f17a37fe640 1 -- 172.21.15.96:0/3689553115 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a41598b0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.209+0000 7f17a37fe640 1 --2- 172.21.15.96:0/3689553115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1794009870 tx=0x7f179402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b9af3634574e5c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:14.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.213+0000 7f17a2ffd640 1 -- 172.21.15.96:0/3689553115 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179402f840 con 0x7f17a40c9dd0 2023-12-01T23:19:14.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.213+0000 7f17a2ffd640 1 -- 172.21.15.96:0/3689553115 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179402f9a0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.213+0000 7f17a2ffd640 1 -- 172.21.15.96:0/3689553115 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179402fd30 con 0x7f17a40c9dd0 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 -- 172.21.15.96:0/3689553115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 msgr2=0x7f17a40c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/3689553115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1794009870 tx=0x7f179402ba20 comp rx=0 tx=0).stop 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 -- 172.21.15.96:0/3689553115 shutdown_connections 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/3689553115 >> v2:172.21.15.96:3300/0 conn(0x7f17a415d830 0x7f17a41533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/3689553115 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a40c7700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 -- 172.21.15.96:0/3689553115 >> 172.21.15.96:0/3689553115 conn(0x7f17a4061100 msgr2=0x7f17a40614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 -- 172.21.15.96:0/3689553115 shutdown_connections 2023-12-01T23:19:14.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.214+0000 7f17a9fc9640 1 -- 172.21.15.96:0/3689553115 wait complete. 2023-12-01T23:19:14.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.215+0000 7f17a9fc9640 1 Processor -- start 2023-12-01T23:19:14.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.215+0000 7f17a9fc9640 1 -- start start 2023-12-01T23:19:14.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17a40ca1b0 0x7f17a414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17a415d830 0x7f17a40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c6390 con 0x7f17a415d830 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c4bd0 con 0x7f17a40ca1b0 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a9fc9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c40e0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17a415d830 0x7f17a40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f17a37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.216+0000 7f179affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17a40ca1b0 0x7f17a414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.217+0000 7f17a37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57948/0 (socket says 172.21.15.96:57948) 2023-12-01T23:19:14.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.217+0000 7f17a37fe640 1 -- 172.21.15.96:0/2036775533 learned_addr learned my addr 172.21.15.96:0/2036775533 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.220+0000 7f17a37fe640 1 -- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17a40ca1b0 msgr2=0x7f17a414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.220+0000 7f17a37fe640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17a40ca1b0 0x7f17a414cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.220+0000 7f17a37fe640 1 -- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17a415d830 msgr2=0x7f17a40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.220+0000 7f17a37fe640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17a415d830 0x7f17a40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.220+0000 7f17a37fe640 1 -- 172.21.15.96:0/2036775533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094d0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.222+0000 7f17a37fe640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f179402ba60 tx=0x7f1794004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.226+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794037c40 con 0x7f17a40c9dd0 2023-12-01T23:19:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.226+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1794037da0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.226+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17940426c0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.226+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a40c4330 con 0x7f17a40c9dd0 2023-12-01T23:19:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.226+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a40c48f0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.227+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a40c60d0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.466+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f179402d3d0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.467+0000 7f17a0ff9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 0x7f178406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.467+0000 7f179affd640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 0x7f178406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.467+0000 7f179affd640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 0x7f178406d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17a40c74e0 tx=0x7f178c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:14.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.470+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f179403c070 con 0x7f17a40c9dd0 2023-12-01T23:19:14.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.480+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17940773c0 con 0x7f17a40c9dd0 2023-12-01T23:19:14.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.648+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17a4152f80 con 0x7f17a40c9dd0 2023-12-01T23:19:14.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.654+0000 7f17a0ff9640 1 -- 172.21.15.96:0/2036775533 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f179407fe60 con 0x7f17a40c9dd0 2023-12-01T23:19:14.655 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 msgr2=0x7f178406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 0x7f178406d380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17a40c74e0 tx=0x7f178c009040 comp rx=0 tx=0).stop 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 msgr2=0x7f17a41ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f179402ba60 tx=0x7f1794004730 comp rx=0 tx=0).stop 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 shutdown_connections 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f178406aec0 0x7f178406d380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17a415d830 0x7f17a40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17a40ca1b0 0x7f17a414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 --2- 172.21.15.96:0/2036775533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17a40c9dd0 0x7f17a41ef930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.656+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 >> 172.21.15.96:0/2036775533 conn(0x7f17a4061100 msgr2=0x7f17a4158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.657+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 shutdown_connections 2023-12-01T23:19:14.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.657+0000 7f17a9fc9640 1 -- 172.21.15.96:0/2036775533 wait complete. 2023-12-01T23:19:14.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:19:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.768+0000 7f301582b640 1 Processor -- start 2023-12-01T23:19:14.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.768+0000 7f301582b640 1 -- start start 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f301582b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30101501c0 0x7f3010159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f301582b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 0x7f3010071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f301582b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3010072b60 con 0x7f30100bff00 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f301582b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30101572d0 con 0x7f30101501c0 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f301582b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30100c1a90 con 0x7f3010156e60 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f300f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 0x7f3010071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.769+0000 7f300effd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f30101501c0 0x7f3010159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.770+0000 7f300f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 0x7f3010071710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:47368/0 (socket says 172.21.15.96:47368) 2023-12-01T23:19:14.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.770+0000 7f300f7fe640 1 -- 172.21.15.96:0/2769898805 learned_addr learned my addr 172.21.15.96:0/2769898805 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:14.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.772+0000 7f300effd640 1 -- 172.21.15.96:0/2769898805 >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 msgr2=0x7f3010071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:14.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.772+0000 7f300effd640 1 --2- 172.21.15.96:0/2769898805 >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 0x7f3010071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.772+0000 7f300effd640 1 -- 172.21.15.96:0/2769898805 >> v1:172.21.15.102:6789/0 conn(0x7f30100bff00 legacy=0x7f3010072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.772+0000 7f300effd640 1 -- 172.21.15.96:0/2769898805 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100c1d30 con 0x7f30101501c0 2023-12-01T23:19:14.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.774+0000 7f300effd640 1 --2- 172.21.15.96:0/2769898805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30101501c0 0x7f3010159860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3010070840 tx=0x7f300002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c61fd84f9100edd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.777+0000 7f300dffb640 1 -- 172.21.15.96:0/2769898805 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300002cd00 con 0x7f30101501c0 2023-12-01T23:19:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f300dffb640 1 -- 172.21.15.96:0/2769898805 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300002ce60 con 0x7f30101501c0 2023-12-01T23:19:14.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f300dffb640 1 -- 172.21.15.96:0/2769898805 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000034660 con 0x7f30101501c0 2023-12-01T23:19:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 -- 172.21.15.96:0/2769898805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30101501c0 msgr2=0x7f3010159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 --2- 172.21.15.96:0/2769898805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30101501c0 0x7f3010159860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3010070840 tx=0x7f300002bf50 comp rx=0 tx=0).stop 2023-12-01T23:19:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 -- 172.21.15.96:0/2769898805 shutdown_connections 2023-12-01T23:19:14.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 --2- 172.21.15.96:0/2769898805 >> v2:172.21.15.102:3300/0 conn(0x7f3010156e60 0x7f3010071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 --2- 172.21.15.96:0/2769898805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30101501c0 0x7f3010159860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 -- 172.21.15.96:0/2769898805 >> 172.21.15.96:0/2769898805 conn(0x7f301006cd60 msgr2=0x7f301006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 -- 172.21.15.96:0/2769898805 shutdown_connections 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.778+0000 7f301582b640 1 -- 172.21.15.96:0/2769898805 wait complete. 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 Processor -- start 2023-12-01T23:19:14.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 -- start start 2023-12-01T23:19:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30101501c0 0x7f301014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3010156e60 0x7f3010153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30101eef30 con 0x7f30100bff00 2023-12-01T23:19:14.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30101ee390 con 0x7f30101501c0 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.780+0000 7f301582b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30101ee600 con 0x7f3010156e60 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.781+0000 7f300effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.781+0000 7f300e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30101501c0 0x7f301014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.781+0000 7f300effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45796/0 (socket says 172.21.15.96:45796) 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.781+0000 7f300effd640 1 -- 172.21.15.96:0/4101645158 learned_addr learned my addr 172.21.15.96:0/4101645158 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:14.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.781+0000 7f300f7fe640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3010156e60 0x7f3010153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.784+0000 7f300effd640 1 -- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3010156e60 msgr2=0x7f3010153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.784+0000 7f300effd640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3010156e60 0x7f3010153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.784+0000 7f300effd640 1 -- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30101501c0 msgr2=0x7f301014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.784+0000 7f300effd640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30101501c0 0x7f301014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:14.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.784+0000 7f300effd640 1 -- 172.21.15.96:0/4101645158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009a70 con 0x7f30100bff00 2023-12-01T23:19:14.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.787+0000 7f300effd640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3000009e80 tx=0x7f3000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.790+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300003e610 con 0x7f30100bff00 2023-12-01T23:19:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.790+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300003e770 con 0x7f30100bff00 2023-12-01T23:19:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.790+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300003eb20 con 0x7f30100bff00 2023-12-01T23:19:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.790+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30101ee8e0 con 0x7f30100bff00 2023-12-01T23:19:14.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.790+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30100ca110 con 0x7f30100bff00 2023-12-01T23:19:14.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:14.792+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30100c77e0 con 0x7f30100bff00 2023-12-01T23:19:15.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.032+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f300003b050 con 0x7f30100bff00 2023-12-01T23:19:15.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.032+0000 7f2ff7fff640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 0x7f2ffc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.032+0000 7f300e7fc640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 0x7f2ffc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.033+0000 7f300e7fc640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 0x7f2ffc06d350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f30100cad20 tx=0x7f3004009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:15.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.046+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f300007b090 con 0x7f30100bff00 2023-12-01T23:19:15.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.046+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30000773d0 con 0x7f30100bff00 2023-12-01T23:19:15.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.255+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3010067500 con 0x7f30100bff00 2023-12-01T23:19:15.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.267+0000 7f2ff7fff640 1 -- 172.21.15.96:0/4101645158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f300004e070 con 0x7f30100bff00 2023-12-01T23:19:15.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:15.269 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:19:15.269 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.269+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 msgr2=0x7f2ffc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.269+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 0x7f2ffc06d350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f30100cad20 tx=0x7f3004009040 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 msgr2=0x7f3010157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3000009e80 tx=0x7f3000004a40 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 shutdown_connections 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f2ffc06ae90 0x7f2ffc06d350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3010156e60 0x7f3010153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30101501c0 0x7f301014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 --2- 172.21.15.96:0/4101645158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30100bff00 0x7f3010157e40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 >> 172.21.15.96:0/4101645158 conn(0x7f301006cd60 msgr2=0x7f3010072450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:15.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 shutdown_connections 2023-12-01T23:19:15.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.270+0000 7f301582b640 1 -- 172.21.15.96:0/4101645158 wait complete. 2023-12-01T23:19:15.281 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:19:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.380+0000 7fd768ca2640 1 Processor -- start 2023-12-01T23:19:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.380+0000 7fd768ca2640 1 -- start start 2023-12-01T23:19:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.380+0000 7fd768ca2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 0x7fd764159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.380+0000 7fd768ca2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd76406fa00 0x7fd7640c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd768ca2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd764153fc0 con 0x7fd7640c5e60 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd768ca2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640c3340 con 0x7fd764153be0 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd768ca2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76406b7b0 con 0x7fd76406fa00 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd76259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 0x7fd764159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd75bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd76406fa00 0x7fd7640c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd76259c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 0x7fd764159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45812/0 (socket says 172.21.15.96:45812) 2023-12-01T23:19:15.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.381+0000 7fd76259c640 1 -- 172.21.15.96:0/589935323 learned_addr learned my addr 172.21.15.96:0/589935323 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.384+0000 7fd75bfff640 1 -- 172.21.15.96:0/589935323 >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 msgr2=0x7fd764159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.384+0000 7fd75bfff640 1 --2- 172.21.15.96:0/589935323 >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 0x7fd764159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.384+0000 7fd75bfff640 1 -- 172.21.15.96:0/589935323 >> v1:172.21.15.96:6789/0 conn(0x7fd7640c5e60 legacy=0x7fd76406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.384+0000 7fd75bfff640 1 -- 172.21.15.96:0/589935323 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76406ba90 con 0x7fd76406fa00 2023-12-01T23:19:15.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.386+0000 7fd75bfff640 1 --2- 172.21.15.96:0/589935323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76406fa00 0x7fd7640c41b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7640c8fe0 tx=0x7fd74c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe67e3f1b3b0910c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.390+0000 7fd761d9b640 1 -- 172.21.15.96:0/589935323 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c031830 con 0x7fd76406fa00 2023-12-01T23:19:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.390+0000 7fd761d9b640 1 -- 172.21.15.96:0/589935323 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c031990 con 0x7fd76406fa00 2023-12-01T23:19:15.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.390+0000 7fd761d9b640 1 -- 172.21.15.96:0/589935323 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c031d20 con 0x7fd76406fa00 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 -- 172.21.15.96:0/589935323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76406fa00 msgr2=0x7fd7640c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 --2- 172.21.15.96:0/589935323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76406fa00 0x7fd7640c41b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7640c8fe0 tx=0x7fd74c02b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 -- 172.21.15.96:0/589935323 shutdown_connections 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 --2- 172.21.15.96:0/589935323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd76406fa00 0x7fd7640c41b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 --2- 172.21.15.96:0/589935323 >> v2:172.21.15.96:3300/0 conn(0x7fd764153be0 0x7fd764159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 -- 172.21.15.96:0/589935323 >> 172.21.15.96:0/589935323 conn(0x7fd7640c7f60 msgr2=0x7fd7640c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 -- 172.21.15.96:0/589935323 shutdown_connections 2023-12-01T23:19:15.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.391+0000 7fd768ca2640 1 -- 172.21.15.96:0/589935323 wait complete. 2023-12-01T23:19:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.392+0000 7fd768ca2640 1 Processor -- start 2023-12-01T23:19:15.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.392+0000 7fd768ca2640 1 -- start start 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7640c5e60 0x7fd764146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd764153be0 0x7fd764147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641518b0 con 0x7fd76406fa00 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641ef910 con 0x7fd7640c5e60 2023-12-01T23:19:15.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.393+0000 7fd768ca2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7641efe40 con 0x7fd764153be0 2023-12-01T23:19:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.394+0000 7fd76259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.394+0000 7fd75bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7640c5e60 0x7fd764146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.394+0000 7fd762d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd764153be0 0x7fd764147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.394+0000 7fd76259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45820/0 (socket says 172.21.15.96:45820) 2023-12-01T23:19:15.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.394+0000 7fd76259c640 1 -- 172.21.15.96:0/2215385773 learned_addr learned my addr 172.21.15.96:0/2215385773 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.397+0000 7fd76259c640 1 -- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd764153be0 msgr2=0x7fd764147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.397+0000 7fd76259c640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd764153be0 0x7fd764147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.397+0000 7fd76259c640 1 -- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7640c5e60 msgr2=0x7fd764146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.397+0000 7fd76259c640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7640c5e60 0x7fd764146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.397+0000 7fd76259c640 1 -- 172.21.15.96:0/2215385773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c009400 con 0x7fd76406fa00 2023-12-01T23:19:15.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.399+0000 7fd76259c640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e870 tx=0x7fd75400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.403+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400c8e0 con 0x7fd76406fa00 2023-12-01T23:19:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.403+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400ca40 con 0x7fd76406fa00 2023-12-01T23:19:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.403+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400cdf0 con 0x7fd76406fa00 2023-12-01T23:19:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.403+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7641531a0 con 0x7fd76406fa00 2023-12-01T23:19:15.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.403+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76414c280 con 0x7fd76406fa00 2023-12-01T23:19:15.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.404+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764067500 con 0x7fd76406fa00 2023-12-01T23:19:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.422+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd754013470 con 0x7fd76406fa00 2023-12-01T23:19:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.422+0000 7fd75affd640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 0x7fd74406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.422+0000 7fd75bfff640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 0x7fd74406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.423+0000 7fd75bfff640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 0x7fd74406d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd74c036000 tx=0x7fd74c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:15.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.425+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd754058cc0 con 0x7fd76406fa00 2023-12-01T23:19:15.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.660+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd754055000 con 0x7fd76406fa00 2023-12-01T23:19:15.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.829+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7640c69d0 con 0x7fd76406fa00 2023-12-01T23:19:15.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.868+0000 7fd75affd640 1 -- 172.21.15.96:0/2215385773 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fd754021090 con 0x7fd76406fa00 2023-12-01T23:19:15.869 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:15.869 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 msgr2=0x7fd74406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 0x7fd74406d380 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd74c036000 tx=0x7fd74c03c040 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 msgr2=0x7fd76414b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e870 tx=0x7fd75400ed30 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 shutdown_connections 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd74406aec0 0x7fd74406d380 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd764153be0 0x7fd764147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7640c5e60 0x7fd764146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 --2- 172.21.15.96:0/2215385773 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd76406fa00 0x7fd76414b930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 >> 172.21.15.96:0/2215385773 conn(0x7fd7640c7f60 msgr2=0x7fd764071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 shutdown_connections 2023-12-01T23:19:15.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.870+0000 7fd768ca2640 1 -- 172.21.15.96:0/2215385773 wait complete. 2023-12-01T23:19:15.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:19:15.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.983+0000 7f998e8e5640 1 Processor -- start 2023-12-01T23:19:15.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.983+0000 7f998e8e5640 1 -- start start 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998e8e5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9988153c70 0x7f998815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998e8e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998e8e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998815a700 con 0x7f9988153890 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998e8e5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99880ca870 con 0x7f9988153c70 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998e8e5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9988159af0 con 0x7f99880ceef0 2023-12-01T23:19:15.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.984+0000 7f998ce82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.985+0000 7f998ce82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57982/0 (socket says 172.21.15.96:57982) 2023-12-01T23:19:15.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.985+0000 7f998ce82640 1 -- 172.21.15.96:0/98193413 learned_addr learned my addr 172.21.15.96:0/98193413 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.987+0000 7f998ce82640 1 -- 172.21.15.96:0/98193413 >> v2:172.21.15.96:3300/0 conn(0x7f9988153c70 msgr2=0x7f998815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.987+0000 7f998ce82640 1 --2- 172.21.15.96:0/98193413 >> v2:172.21.15.96:3300/0 conn(0x7f9988153c70 0x7f998815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.987+0000 7f998ce82640 1 -- 172.21.15.96:0/98193413 >> v1:172.21.15.96:6789/0 conn(0x7f9988153890 legacy=0x7f99880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:15.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.987+0000 7f998ce82640 1 -- 172.21.15.96:0/98193413 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9988159dd0 con 0x7f99880ceef0 2023-12-01T23:19:15.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.990+0000 7f998ce82640 1 --2- 172.21.15.96:0/98193413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9980009e50 tx=0x7f998002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=563b5e8fce8e64ad server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.995+0000 7f9986ffd640 1 -- 172.21.15.96:0/98193413 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998002cb00 con 0x7f99880ceef0 2023-12-01T23:19:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f9986ffd640 1 -- 172.21.15.96:0/98193413 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998002cc60 con 0x7f99880ceef0 2023-12-01T23:19:15.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f9986ffd640 1 -- 172.21.15.96:0/98193413 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99800343f0 con 0x7f99880ceef0 2023-12-01T23:19:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 -- 172.21.15.96:0/98193413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 msgr2=0x7f99880cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 --2- 172.21.15.96:0/98193413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9980009e50 tx=0x7f998002bf60 comp rx=0 tx=0).stop 2023-12-01T23:19:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 -- 172.21.15.96:0/98193413 shutdown_connections 2023-12-01T23:19:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 --2- 172.21.15.96:0/98193413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880ceef0 0x7f99880cf320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 --2- 172.21.15.96:0/98193413 >> v2:172.21.15.96:3300/0 conn(0x7f9988153c70 0x7f998815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 -- 172.21.15.96:0/98193413 >> 172.21.15.96:0/98193413 conn(0x7f998806ba00 msgr2=0x7f998806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 -- 172.21.15.96:0/98193413 shutdown_connections 2023-12-01T23:19:15.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.996+0000 7f998e8e5640 1 -- 172.21.15.96:0/98193413 wait complete. 2023-12-01T23:19:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.998+0000 7f998e8e5640 1 Processor -- start 2023-12-01T23:19:15.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.998+0000 7f998e8e5640 1 -- start start 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99880ceef0 0x7f9988141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9988153c70 0x7f998813c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880c5640 con 0x7f99880ceef0 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880c4d50 con 0x7f9988153c70 2023-12-01T23:19:16.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:15.999+0000 7f998e8e5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99881efd80 con 0x7f9988153890 2023-12-01T23:19:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.000+0000 7f998ce82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9988153c70 0x7f998813c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.000+0000 7f99877fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:16.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.000+0000 7f99877fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57986/0 (socket says 172.21.15.96:57986) 2023-12-01T23:19:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.000+0000 7f99877fe640 1 -- 172.21.15.96:0/2053175452 learned_addr learned my addr 172.21.15.96:0/2053175452 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:16.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.001+0000 7f9987fff640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99880ceef0 0x7f9988141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:16.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.004+0000 7f99877fe640 1 -- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9988153c70 msgr2=0x7f998813c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:16.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.004+0000 7f99877fe640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9988153c70 0x7f998813c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.004+0000 7f99877fe640 1 -- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99880ceef0 msgr2=0x7f9988141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:16.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.004+0000 7f99877fe640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99880ceef0 0x7f9988141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.004+0000 7f99877fe640 1 -- 172.21.15.96:0/2053175452 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980009b30 con 0x7f9988153890 2023-12-01T23:19:16.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.006+0000 7f99877fe640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b410 tx=0x7f997c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.010+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011830 con 0x7f9988153890 2023-12-01T23:19:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.010+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c0119b0 con 0x7f9988153890 2023-12-01T23:19:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.010+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99880c4ff0 con 0x7f9988153890 2023-12-01T23:19:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.010+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c011d60 con 0x7f9988153890 2023-12-01T23:19:16.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.010+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9988142070 con 0x7f9988153890 2023-12-01T23:19:16.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.011+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99880c57f0 con 0x7f9988153890 2023-12-01T23:19:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.032+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f997c01a400 con 0x7f9988153890 2023-12-01T23:19:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.032+0000 7f9984ff9640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 0x7f997406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.033+0000 7f9987fff640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 0x7f997406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:16.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.033+0000 7f9987fff640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 0x7f997406d380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99780015d0 tx=0x7f9978009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.262+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f997c059110 con 0x7f9988153890 2023-12-01T23:19:16.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.272+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f997c054d50 con 0x7f9988153890 2023-12-01T23:19:16.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.484+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9988067500 con 0x7f9988153890 2023-12-01T23:19:16.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.547+0000 7f9984ff9640 1 -- 172.21.15.96:0/2053175452 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f997c015020 con 0x7f9988153890 2023-12-01T23:19:16.548 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:19:16.549 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:19:16.549 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 msgr2=0x7f997406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 0x7f997406d380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99780015d0 tx=0x7f9978009040 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 msgr2=0x7f9988141b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b410 tx=0x7f997c00b8d0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 shutdown_connections 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f997406aec0 0x7f997406d380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9988153c70 0x7f998813c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9988153890 0x7f9988141b30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 --2- 172.21.15.96:0/2053175452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f99880ceef0 0x7f9988141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:16.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 >> 172.21.15.96:0/2053175452 conn(0x7f998806ba00 msgr2=0x7f998815d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:16.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 shutdown_connections 2023-12-01T23:19:16.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:16.550+0000 7f998e8e5640 1 -- 172.21.15.96:0/2053175452 wait complete. 2023-12-01T23:19:17.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-01T23:18:28.557088+0000', 'modified': '2023-12-01T23:18:57.289784+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4255': {'gid': 4255, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.102:6833/2956212258', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 2956212258}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 2956212258}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-01T23:19:17.166 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-01T23:19:17.166 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2023-12-01T23:19:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.268+0000 7f15f91b0640 1 Processor -- start 2023-12-01T23:19:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.268+0000 7f15f91b0640 1 -- start start 2023-12-01T23:19:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.269+0000 7f15f91b0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15f4153890 0x7f15f415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.269+0000 7f15f91b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.269+0000 7f15f91b0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f415a700 con 0x7f15f40ceef0 2023-12-01T23:19:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.269+0000 7f15f91b0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40ca870 con 0x7f15f4153890 2023-12-01T23:19:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.269+0000 7f15f91b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4159af0 con 0x7f15f4153c70 2023-12-01T23:19:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.270+0000 7f15f2d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f15f4153890 0x7f15f415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.270+0000 7f15f259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.270+0000 7f15f259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55278/0 (socket says 172.21.15.96:55278) 2023-12-01T23:19:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.270+0000 7f15f259c640 1 -- 172.21.15.96:0/450756017 learned_addr learned my addr 172.21.15.96:0/450756017 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.273+0000 7f15f259c640 1 -- 172.21.15.96:0/450756017 >> v2:172.21.15.96:3300/0 conn(0x7f15f4153890 msgr2=0x7f15f415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.273+0000 7f15f259c640 1 --2- 172.21.15.96:0/450756017 >> v2:172.21.15.96:3300/0 conn(0x7f15f4153890 0x7f15f415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.273+0000 7f15f259c640 1 -- 172.21.15.96:0/450756017 >> v1:172.21.15.96:6789/0 conn(0x7f15f40ceef0 legacy=0x7f15f415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.273+0000 7f15f259c640 1 -- 172.21.15.96:0/450756017 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4159dd0 con 0x7f15f4153c70 2023-12-01T23:19:17.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.274+0000 7f15f259c640 1 --2- 172.21.15.96:0/450756017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58b4c48724d38742 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.278+0000 7f15f1d9b640 1 -- 172.21.15.96:0/450756017 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e802f840 con 0x7f15f4153c70 2023-12-01T23:19:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.278+0000 7f15f1d9b640 1 -- 172.21.15.96:0/450756017 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e802f9a0 con 0x7f15f4153c70 2023-12-01T23:19:17.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.278+0000 7f15f1d9b640 1 -- 172.21.15.96:0/450756017 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e802fd30 con 0x7f15f4153c70 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 -- 172.21.15.96:0/450756017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 msgr2=0x7f15f40c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 --2- 172.21.15.96:0/450756017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009870 tx=0x7f15e802ba20 comp rx=0 tx=0).stop 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 -- 172.21.15.96:0/450756017 shutdown_connections 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 --2- 172.21.15.96:0/450756017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c9fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 --2- 172.21.15.96:0/450756017 >> v2:172.21.15.96:3300/0 conn(0x7f15f4153890 0x7f15f415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 -- 172.21.15.96:0/450756017 >> 172.21.15.96:0/450756017 conn(0x7f15f406ba00 msgr2=0x7f15f406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 -- 172.21.15.96:0/450756017 shutdown_connections 2023-12-01T23:19:17.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.279+0000 7f15f91b0640 1 -- 172.21.15.96:0/450756017 wait complete. 2023-12-01T23:19:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.280+0000 7f15f91b0640 1 Processor -- start 2023-12-01T23:19:17.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.280+0000 7f15f91b0640 1 -- start start 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15f40ceef0 0x7f15f41f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41f2d80 con 0x7f15f4153890 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41546e0 con 0x7f15f40ceef0 2023-12-01T23:19:17.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f91b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41549c0 con 0x7f15f4153c70 2023-12-01T23:19:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.281+0000 7f15f259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.282+0000 7f15f359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.282+0000 7f15f259c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45170/0 (socket says 172.21.15.96:45170) 2023-12-01T23:19:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.282+0000 7f15f259c640 1 -- 172.21.15.96:0/3709561894 learned_addr learned my addr 172.21.15.96:0/3709561894 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.282+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15f40ceef0 0x7f15f41f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.285+0000 7f15f259c640 1 -- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 msgr2=0x7f15f40c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.285+0000 7f15f259c640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.285+0000 7f15f259c640 1 -- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15f40ceef0 msgr2=0x7f15f41f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.285+0000 7f15f259c640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15f40ceef0 0x7f15f41f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.285+0000 7f15f259c640 1 -- 172.21.15.96:0/3709561894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80094d0 con 0x7f15f4153890 2023-12-01T23:19:17.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.287+0000 7f15f259c640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000c00 tx=0x7f15e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.291+0000 7f15db7fe640 1 -- 172.21.15.96:0/3709561894 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e803b040 con 0x7f15f4153890 2023-12-01T23:19:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.291+0000 7f15db7fe640 1 -- 172.21.15.96:0/3709561894 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8037c60 con 0x7f15f4153890 2023-12-01T23:19:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.291+0000 7f15db7fe640 1 -- 172.21.15.96:0/3709561894 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8042480 con 0x7f15f4153890 2023-12-01T23:19:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.291+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f41f2730 con 0x7f15f4153890 2023-12-01T23:19:17.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.291+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4154090 con 0x7f15f4153890 2023-12-01T23:19:17.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.293+0000 7f15fbe1a740 1 Processor -- start 2023-12-01T23:19:17.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 -- start start 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 0x556ba4a99a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4a99f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a980b0 0x556ba4ad8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba4a54980 con 0x556ba4a980b0 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba4a06b90 con 0x556ba4ae34d0 2023-12-01T23:19:17.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.294+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ba4a04280 con 0x556ba4a99650 2023-12-01T23:19:17.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.295+0000 7f15f359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 0x556ba4a99a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.295+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4a99f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.296+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4a99f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:35288/0 (socket says 172.21.15.96:35288) 2023-12-01T23:19:17.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.296+0000 7f15f2d9d640 1 -- 172.21.15.96:0/3659972640 learned_addr learned my addr 172.21.15.96:0/3659972640 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.298+0000 7f15f359e640 1 -- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 msgr2=0x556ba4a99f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.298+0000 7f15f359e640 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4a99f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.298+0000 7f15f359e640 1 -- 172.21.15.96:0/3659972640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a980b0 msgr2=0x556ba4ad8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.298+0000 7f15f359e640 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a980b0 0x556ba4ad8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.298+0000 7f15f359e640 1 -- 172.21.15.96:0/3659972640 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba49c5500 con 0x556ba4a99650 2023-12-01T23:19:17.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.300+0000 7f15f359e640 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 0x556ba4a99a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0015d0 tx=0x7f15ec007db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6da79f4b78f9670c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.302+0000 7f15d8ff9640 1 -- 172.21.15.96:0/3659972640 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0050d0 con 0x556ba4a99650 2023-12-01T23:19:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.304+0000 7f15d8ff9640 1 -- 172.21.15.96:0/3659972640 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec005230 con 0x556ba4a99650 2023-12-01T23:19:17.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.304+0000 7f15d8ff9640 1 -- 172.21.15.96:0/3659972640 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00f7b0 con 0x556ba4a99650 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 msgr2=0x556ba4a99a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 0x556ba4a99a30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0015d0 tx=0x7f15ec007db0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3659972640 shutdown_connections 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a980b0 0x556ba4ad8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4a99f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3659972640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4a99650 0x556ba4a99a30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3659972640 >> 172.21.15.96:0/3659972640 conn(0x556ba4a95dc0 msgr2=0x556ba4a98700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3659972640 shutdown_connections 2023-12-01T23:19:17.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3659972640 wait complete. 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 -- start start 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.305+0000 7f15fbe1a740 1 Processor -- start 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 0x556ba4ad4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4ad7620 0x556ba4ac0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba49ffb70 con 0x556ba4ad7620 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba49b9e00 con 0x556ba4a99650 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ba49b9aa0 con 0x556ba4ae34d0 2023-12-01T23:19:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.306+0000 7f15fbe1a740 10 client.0 _ll_register_callbacks cb 0x556ba4711ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T23:19:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.307+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.307+0000 7f15f359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 0x556ba4ad4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.307+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:55294/0 (socket says 172.21.15.96:55294) 2023-12-01T23:19:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.307+0000 7f15f2d9d640 1 -- 172.21.15.96:0/3303101568 learned_addr learned my addr 172.21.15.96:0/3303101568 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f2d9d640 1 -- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 msgr2=0x556ba4ad4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 0x556ba4ad4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f2d9d640 1 -- 172.21.15.96:0/3303101568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4ad7620 msgr2=0x556ba4ac0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4ad7620 0x556ba4ac0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f2d9d640 1 -- 172.21.15.96:0/3303101568 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f415a700 con 0x556ba4ae34d0 2023-12-01T23:19:17.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.310+0000 7f15f359e640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 0x556ba4ad4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:19:17.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.311+0000 7f15db7fe640 1 -- 172.21.15.96:0/3709561894 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15e80425e0 con 0x7f15f4153890 2023-12-01T23:19:17.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.312+0000 7f15db7fe640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 0x7f15e006d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.312+0000 7f15f359e640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 0x7f15e006d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.312+0000 7f15f359e640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 0x7f15e006d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15ec008fd0 tx=0x7f15ec005000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.313+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15e4014e30 tx=0x7f15e4012670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b0e667490d0f97 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.313+0000 7f15d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3301/0 2023-12-01T23:19:17.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.314+0000 7f15db7fe640 1 -- 172.21.15.96:0/3709561894 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15e807b210 con 0x7f15f4153890 2023-12-01T23:19:17.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.316+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400e040 con 0x556ba4ae34d0 2023-12-01T23:19:17.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.316+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mon.2 v2:172.21.15.102:3301/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15e401a070 con 0x556ba4ae34d0 2023-12-01T23:19:17.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.316+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ba49f8b50 con 0x556ba4ae34d0 2023-12-01T23:19:17.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.318+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e4003b90 con 0x556ba4ae34d0 2023-12-01T23:19:17.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.318+0000 7f15fbe1a740 10 client.4577 fetch_fsmap learned FSMap version 10 2023-12-01T23:19:17.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.318+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x556ba49fe1f0 con 0x556ba4ae34d0 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mon.2 v2:172.21.15.102:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556ba49f8b50 con 0x556ba4ae34d0 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mon.2 v2:172.21.15.102:3301/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f15e4003cf0 con 0x556ba4ae34d0 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 10 client.4577 fetch_fsmap finished waiting for FSMap version 10 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 10 client.4577 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 20 client.4577 populate_metadata read hostname 'smithi096' 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4ac0690 0x556ba4aee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 4 client.4577 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-01T23:19:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.334+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 --> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ba49f8870 con 0x556ba4ac0690 2023-12-01T23:19:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.335+0000 7f15f259c640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4ac0690 0x556ba4aee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.338+0000 7f15f259c640 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4ac0690 0x556ba4aee2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753bed7e8ddc2290 server_cookie=19e4041aaa035d04 in_seq=0 out_seq=0 2023-12-01T23:19:17.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.338+0000 7f15d1ffb640 10 client.4577 ms_handle_connect on v2:172.21.15.102:6832/2956212258 2023-12-01T23:19:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.356+0000 7f15d1ffb640 1 -- 172.21.15.96:0/3303101568 <== mds.0 v2:172.21.15.102:6832/2956212258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556ba49f8870 con 0x556ba4ac0690 2023-12-01T23:19:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.356+0000 7f15d1ffb640 10 client.4577 handle_command_reply: tid=0 2023-12-01T23:19:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.356+0000 7f15fbe1a740 1 client.4577 shutdown 2023-12-01T23:19:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 msgr2=0x556ba4adeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15e4014e30 tx=0x7f15e4012670 comp rx=0 tx=0).stop 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 shutdown_connections 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4ac0690 0x556ba4aee2a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4ad7620 0x556ba4ac0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4adeb00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/3303101568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4a99650 0x556ba4ad4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15d1ffb640 0 client.4577 ms_handle_reset on v2:172.21.15.102:6832/2956212258 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 >> 172.21.15.96:0/3303101568 conn(0x556ba4a980b0 msgr2=0x556ba4a92bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 shutdown_connections 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 1 -- 172.21.15.96:0/3303101568 wait complete. 2023-12-01T23:19:17.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.357+0000 7f15fbe1a740 20 client.4577 trim_cache size 0 max 16384 2023-12-01T23:19:17.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.372+0000 7f15fbe1a740 1 Processor -- start 2023-12-01T23:19:17.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.372+0000 7f15fbe1a740 1 -- start start 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ad7620 0x556ba4ad3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4ad3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba497f270 con 0x556ba4a99650 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba4ac2db0 con 0x556ba4ad7620 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.373+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ba4a8fa10 con 0x556ba4ae34d0 2023-12-01T23:19:17.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.374+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.374+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45212/0 (socket says 172.21.15.96:45212) 2023-12-01T23:19:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.374+0000 7f15f2d9d640 1 -- 172.21.15.96:0/4194217982 learned_addr learned my addr 172.21.15.96:0/4194217982 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.374+0000 7f15f359e640 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4ad3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.374+0000 7f15f259c640 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ad7620 0x556ba4ad3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.376+0000 7f15f2d9d640 1 -- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 msgr2=0x556ba4ad3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.376+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4ad3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.376+0000 7f15f2d9d640 1 -- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ad7620 msgr2=0x556ba4ad3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.376+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ad7620 0x556ba4ad3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.376+0000 7f15f2d9d640 1 -- 172.21.15.96:0/4194217982 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ba4adf880 con 0x556ba4a99650 2023-12-01T23:19:17.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.378+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009c80 tx=0x7f15e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ea922e7e9cb722 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.381+0000 7f15d97fa640 1 -- 172.21.15.96:0/4194217982 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400e070 con 0x556ba4a99650 2023-12-01T23:19:17.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.381+0000 7f15d97fa640 1 -- 172.21.15.96:0/4194217982 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400f040 con 0x556ba4a99650 2023-12-01T23:19:17.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.381+0000 7f15d97fa640 1 -- 172.21.15.96:0/4194217982 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40149c0 con 0x556ba4a99650 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 -- 172.21.15.96:0/4194217982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 msgr2=0x556ba4aee370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009c80 tx=0x7f15e4019000 comp rx=0 tx=0).stop 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 -- 172.21.15.96:0/4194217982 shutdown_connections 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ae34d0 0x556ba4ad3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ad7620 0x556ba4ad3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/4194217982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4aee370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 -- 172.21.15.96:0/4194217982 >> 172.21.15.96:0/4194217982 conn(0x556ba4a980b0 msgr2=0x556ba4ad58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 -- 172.21.15.96:0/4194217982 shutdown_connections 2023-12-01T23:19:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.382+0000 7f15fbe1a740 1 -- 172.21.15.96:0/4194217982 wait complete. 2023-12-01T23:19:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 -- start start 2023-12-01T23:19:17.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 Processor -- start 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ad7620 0x556ba4af1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4ad3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba4ac14a0 con 0x556ba4a99650 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ba4b49370 con 0x556ba4ae34d0 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x556ba4b48ea0 con 0x556ba4ad7620 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.383+0000 7f15fbe1a740 10 client.0 _ll_register_callbacks cb 0x7f15ec001220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.384+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.384+0000 7f15f259c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ad7620 0x556ba4af1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.384+0000 7f15f359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4ad3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.384+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45214/0 (socket says 172.21.15.96:45214) 2023-12-01T23:19:17.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.384+0000 7f15f2d9d640 1 -- 172.21.15.96:0/1337647785 learned_addr learned my addr 172.21.15.96:0/1337647785 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.387+0000 7f15f2d9d640 1 -- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ad7620 msgr2=0x556ba4af1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.387+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ad7620 0x556ba4af1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.387+0000 7f15f2d9d640 1 -- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 msgr2=0x556ba4ad3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:19:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.387+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4ad3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.387+0000 7f15f2d9d640 1 -- 172.21.15.96:0/1337647785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ba49fe1f0 con 0x556ba4a99650 2023-12-01T23:19:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.389+0000 7f15f2d9d640 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009c80 tx=0x7f15e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8728ffdf8ccbab4a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.389+0000 7f15d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-12-01T23:19:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.392+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4035070 con 0x556ba4a99650 2023-12-01T23:19:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.392+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15e4020aa0 con 0x556ba4a99650 2023-12-01T23:19:17.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.392+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15ec005230 con 0x556ba4a99650 2023-12-01T23:19:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.394+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e400e040 con 0x556ba4a99650 2023-12-01T23:19:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.394+0000 7f15fbe1a740 10 client.4716 fetch_fsmap learned FSMap version 10 2023-12-01T23:19:17.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.394+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x556ba499bd00 con 0x556ba4a99650 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec005230 con 0x556ba4a99650 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 10) v1 ==== 4452+0+0 (secure 0 0 0) 0x7f15e402f020 con 0x556ba4a99650 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 10 client.4716 fetch_fsmap finished waiting for FSMap version 10 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 10 client.4716 resolve_mds: resolved name 'f' to daemon mds.f 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 20 client.4716 populate_metadata read hostname 'smithi096' 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4abf210 0x556ba4abf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 4 client.4716 mds_command: new command op to 4255 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-01T23:19:17.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.398+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 --> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556ba47006c0 con 0x556ba4abf210 2023-12-01T23:19:17.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.399+0000 7f15f259c640 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4abf210 0x556ba4abf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.401+0000 7f15f259c640 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4abf210 0x556ba4abf5f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65fd66462696d18 server_cookie=f8429f50dacc5134 in_seq=0 out_seq=0 2023-12-01T23:19:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.401+0000 7f15d1ffb640 10 client.4716 ms_handle_connect on v2:172.21.15.102:6832/2956212258 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.404+0000 7f15d1ffb640 1 -- 172.21.15.96:0/1337647785 <== mds.0 v2:172.21.15.102:6832/2956212258 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556ba47006c0 con 0x556ba4abf210 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.404+0000 7f15d1ffb640 10 client.4716 handle_command_reply: tid=0 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.404+0000 7f15fbe1a740 1 client.4716 shutdown 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 msgr2=0x556ba4b48960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009c80 tx=0x7f15e4004a40 comp rx=0 tx=0).stop 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 shutdown_connections 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:6832/2956212258,v1:172.21.15.102:6833/2956212258] conn(0x556ba4abf210 0x556ba4abf5f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556ba4ae34d0 0x556ba4ad3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15d1ffb640 0 client.4716 ms_handle_reset on v2:172.21.15.102:6832/2956212258 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x556ba4ad7620 0x556ba4af1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 --2- 172.21.15.96:0/1337647785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x556ba4a99650 0x556ba4b48960 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 >> 172.21.15.96:0/1337647785 conn(0x556ba4a980b0 msgr2=0x556ba4a92bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 shutdown_connections 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 1 -- 172.21.15.96:0/1337647785 wait complete. 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15fbe1a740 20 client.4716 trim_cache size 0 max 16384 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "427efaec-98ee-4c98-922b-5db70b583575", 2023-12-01T23:19:17.407 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4255, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 47.934874731000001, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 10, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 29, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 27, 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 57.027298187 2023-12-01T23:19:17.408 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:19:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 msgr2=0x7f15e006d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 0x7f15e006d2c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15ec008fd0 tx=0x7f15ec005000 comp rx=0 tx=0).stop 2023-12-01T23:19:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 msgr2=0x7f15f41516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f15e8000c00 tx=0x7f15e80046c0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 shutdown_connections 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f15e006ae00 0x7f15e006d2c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f15f4153c70 0x7f15f40c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15f4153890 0x7f15f41516e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 --2- 172.21.15.96:0/3709561894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15f40ceef0 0x7f15f41f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 >> 172.21.15.96:0/3709561894 conn(0x7f15f406ba00 msgr2=0x7f15f4158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 shutdown_connections 2023-12-01T23:19:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.405+0000 7f15f91b0640 1 -- 172.21.15.96:0/3709561894 wait complete. 2023-12-01T23:19:17.417 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-01T23:19:17.430 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-01T23:19:17.430 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-12-01T23:19:17.430 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-01T23:19:17.431 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-01T23:19:17.431 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:17.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:17.431 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-12-01T23:19:17.446 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-01T23:19:17.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:17.447 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-01T23:19:17.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:17.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2023-12-01T23:19:17.615 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-01T23:19:17.615 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-01T23:19:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.715+0000 7f4370c26640 1 Processor -- start 2023-12-01T23:19:17.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.715+0000 7f4370c26640 1 -- start start 2023-12-01T23:19:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.716+0000 7f4370c26640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f436c15d950 0x7f436c15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.716+0000 7f4370c26640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c15a700 con 0x7f436c153890 2023-12-01T23:19:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.716+0000 7f4370c26640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0ca870 con 0x7f436c153c70 2023-12-01T23:19:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.716+0000 7f4370c26640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c15dd60 con 0x7f436c15d950 2023-12-01T23:19:17.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.717+0000 7f436a59c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f436c153890 0x7f436c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:37798/0 (socket says 172.21.15.96:37798) 2023-12-01T23:19:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.717+0000 7f436a59c640 1 -- 172.21.15.96:0/366519367 learned_addr learned my addr 172.21.15.96:0/366519367 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:19:17.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.717+0000 7f436ad9d640 1 --2- 172.21.15.96:0/366519367 >> v2:172.21.15.102:3300/0 conn(0x7f436c15d950 0x7f436c15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.719+0000 7f436959a640 1 -- 172.21.15.96:0/366519367 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549845620 0 0) 0x7f436c15a700 con 0x7f436c153890 2023-12-01T23:19:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.719+0000 7f436959a640 1 -- 172.21.15.96:0/366519367 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4354003520 con 0x7f436c153890 2023-12-01T23:19:17.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.720+0000 7f436ad9d640 1 -- 172.21.15.96:0/366519367 >> v1:172.21.15.102:6789/0 conn(0x7f436c153c70 legacy=0x7f436c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.720+0000 7f436ad9d640 1 -- 172.21.15.96:0/366519367 >> v1:172.21.15.96:6789/0 conn(0x7f436c153890 legacy=0x7f436c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.720+0000 7f436ad9d640 1 -- 172.21.15.96:0/366519367 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c159af0 con 0x7f436c15d950 2023-12-01T23:19:17.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.724+0000 7f436ad9d640 1 --2- 172.21.15.96:0/366519367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c15d950 0x7f436c15aed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43640097a0 tx=0x7f436402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f749664d0a94c90c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.728+0000 7f436959a640 1 -- 172.21.15.96:0/366519367 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436402f810 con 0x7f436c15d950 2023-12-01T23:19:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.728+0000 7f436959a640 1 -- 172.21.15.96:0/366519367 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436402f970 con 0x7f436c15d950 2023-12-01T23:19:17.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.728+0000 7f436959a640 1 -- 172.21.15.96:0/366519367 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436402fd00 con 0x7f436c15d950 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 -- 172.21.15.96:0/366519367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c15d950 msgr2=0x7f436c15aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 --2- 172.21.15.96:0/366519367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c15d950 0x7f436c15aed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f43640097a0 tx=0x7f436402b9f0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 -- 172.21.15.96:0/366519367 shutdown_connections 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 --2- 172.21.15.96:0/366519367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c15d950 0x7f436c15aed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 -- 172.21.15.96:0/366519367 >> 172.21.15.96:0/366519367 conn(0x7f436c06ba00 msgr2=0x7f436c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 -- 172.21.15.96:0/366519367 shutdown_connections 2023-12-01T23:19:17.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.729+0000 7f4370c26640 1 -- 172.21.15.96:0/366519367 wait complete. 2023-12-01T23:19:17.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.730+0000 7f4370c26640 1 Processor -- start 2023-12-01T23:19:17.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.730+0000 7f4370c26640 1 -- start start 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f436c153890 0x7f436c1eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f436c15d950 0x7f436c15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1efab0 con 0x7f436c153890 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1f3620 con 0x7f436c153c70 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4370c26640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c1ef4a0 con 0x7f436c15d950 2023-12-01T23:19:17.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f436a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f436c153890 0x7f436c1eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.731+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f436c15d950 0x7f436c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.732+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:35348/0 (socket says 172.21.15.96:35348) 2023-12-01T23:19:17.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.732+0000 7f4369d9b640 1 -- 172.21.15.96:0/1893101297 learned_addr learned my addr 172.21.15.96:0/1893101297 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:19:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.735+0000 7f4369d9b640 1 -- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f436c15d950 msgr2=0x7f436c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.735+0000 7f4369d9b640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f436c15d950 0x7f436c15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.735+0000 7f4369d9b640 1 -- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f436c153890 msgr2=0x7f436c1eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.735+0000 7f4369d9b640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f436c153890 0x7f436c1eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:17.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.735+0000 7f4369d9b640 1 -- 172.21.15.96:0/1893101297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009400 con 0x7f436c153c70 2023-12-01T23:19:17.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.737+0000 7f4369d9b640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f436000c450 tx=0x7f436000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.741+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43600052d0 con 0x7f436c153c70 2023-12-01T23:19:17.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.741+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360005430 con 0x7f436c153c70 2023-12-01T23:19:17.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.741+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360012870 con 0x7f436c153c70 2023-12-01T23:19:17.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.741+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c0c5a90 con 0x7f436c153c70 2023-12-01T23:19:17.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.741+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0c5d70 con 0x7f436c153c70 2023-12-01T23:19:17.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.742+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c1efc20 con 0x7f436c153c70 2023-12-01T23:19:17.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.761+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f43600129d0 con 0x7f436c153c70 2023-12-01T23:19:17.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.761+0000 7f435affd640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 0x7f434c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:19:17.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.762+0000 7f436a59c640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 0x7f434c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:19:17.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.762+0000 7f436a59c640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 0x7f434c06d380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f435c001560 tx=0x7f435c0019f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:19:17.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.765+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4360058850 con 0x7f436c153c70 2023-12-01T23:19:17.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:17.995+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4360054b90 con 0x7f436c153c70 2023-12-01T23:19:18.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.196+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f436c067500 con 0x7f436c153c70 2023-12-01T23:19:18.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.202+0000 7f435affd640 1 -- 172.21.15.96:0/1893101297 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f43600581b0 con 0x7f436c153c70 2023-12-01T23:19:18.203 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-01T23:19:18.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 msgr2=0x7f434c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:18.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 0x7f434c06d380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f435c001560 tx=0x7f435c0019f0 comp rx=0 tx=0).stop 2023-12-01T23:19:18.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 msgr2=0x7f436c0b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:19:18.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f436000c450 tx=0x7f436000c910 comp rx=0 tx=0).stop 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 shutdown_connections 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f434c06aec0 0x7f434c06d380 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f436c15d950 0x7f436c15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f436c153c70 0x7f436c0b31b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 --2- 172.21.15.96:0/1893101297 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f436c153890 0x7f436c1eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 >> 172.21.15.96:0/1893101297 conn(0x7f436c06ba00 msgr2=0x7f436c1e2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 shutdown_connections 2023-12-01T23:19:18.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:18.204+0000 7f4370c26640 1 -- 172.21.15.96:0/1893101297 wait complete. 2023-12-01T23:19:18.216 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-01T23:19:18.216 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-01T23:19:18.216 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-01T23:19:18.217 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-01T23:19:18.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.217 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-12-01T23:19:18.232 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42257sec preferred_lft 42257sec 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2023-12-01T23:19:18.233 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-12-01T23:19:18.234 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-01T23:19:18.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-01T23:19:18.234 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:19:18.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.341 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-01T23:19:18.367 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-12-01T23:19:18.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.369 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-12-01T23:19:18.424 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-12-01T23:19:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-01T23:19:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-01T23:19:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-01T23:19:18.425 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-01T23:19:18.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.425 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:19:18.425 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:19:18.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-01T23:19:18.425 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-01T23:19:18.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-01T23:19:18.426 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:19:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.522 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-12-01T23:19:18.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.537 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-12-01T23:19:18.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.593 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:19:18.593 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:19:18.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:18.593 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-01T23:19:18.593 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:19:18.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-01T23:19:18.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-01T23:19:18.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-01T23:19:18.677 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:19:18.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:18.800 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-12-01T23:19:18.800 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-12-01T23:19:18.800 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-12-01T23:19:18.801 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2023-12-01T23:19:18.801 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-12-01T23:19:18.842 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2023-12-01T23:19:18.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T23:19:18.842 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:18.896 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-01T23:19:18.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T23:19:18.897 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:18.951 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-12-01T23:19:18.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:19.021 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:19.077 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:19.077 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:19.080 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:19.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:19.080 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:19.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-01T23:19:19.133 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-01T23:19:19.175 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:19.201 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:19.257 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:19.257 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:19.257 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:19.258 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:19.259 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:19.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:19.260 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:20.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:20.443 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:20.498 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:20.498 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:20.501 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:20.501 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:20.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:20.502 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:21.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:21.685 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:21.741 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:21.742 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:21.743 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:21.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:21.744 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:22.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:22.925 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:22.981 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:22.983 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:22.984 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:22.985 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:22.986 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:22.986 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:22.986 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:22.986 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:22.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:22.987 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:24.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:24.165 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:24.220 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:24.220 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:24.220 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:24.221 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:24.222 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:24.223 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:24.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:24.223 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:24.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[2023-12-01T23:19:24.729+0000 64d2100 -1 init, newargv = 0x81d2270 newargc=15 2023-12-01T23:19:24.844 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:97755]: starting ceph client 2023-12-01T23:19:25.379 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-12-01T23:19:25.407 DEBUG:teuthology.orchestra.run.smithi096:> cat /proc/self/mounts | awk '{print $2}' 2023-12-01T23:19:25.463 INFO:teuthology.orchestra.run.smithi096.stdout:/proc 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/sys 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/dev 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/security 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/shm 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/pts 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/run 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/cgroup 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/pstore 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/bpf 2023-12-01T23:19:25.464 INFO:teuthology.orchestra.run.smithi096.stdout:/ 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/selinux 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/proc/sys/fs/binfmt_misc 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/hugepages 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/dev/mqueue 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/debug 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/tracing 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/fs/fuse/connections 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/sys/kernel/config 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-sysctl.service 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-01T23:19:25.465 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/nfs/rpc_pipefs 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/run/user/1000 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-0 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-1 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-2 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/var/lib/ceph/osd/ceph-3 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run.smithi096.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:19:25.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:25.467 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-12-01T23:19:25.486 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[97755]: starting fuse 2023-12-01T23:19:25.500 INFO:teuthology.orchestra.run.smithi096.stdout:41 2023-12-01T23:19:25.500 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-01T23:19:25.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-12-01T23:19:25.500 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-12-01T23:19:25.500 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-12-01T23:19:25.500 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-12-01T23:19:25.500 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-12-01T23:19:25.501 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2023-12-01T23:19:25.502 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-12-01T23:19:25.621 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.97755.asok 2023-12-01T23:19:25.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:19:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-01T23:19:25.631 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.97755.asok 2023-12-01T23:19:25.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:25.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.97755.asok status 2023-12-01T23:19:25.865 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "bed7681480ccb0192b91a35e691658867e1e96b7", 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-7631-gbed76814 (bed7681480ccb0192b91a35e691658867e1e96b7) reef (dev)", 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-01T23:19:25.866 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "97755", 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4728, 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-12-01T23:19:25.867 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4728 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-12-01T23:19:25.868 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3601963477 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.96:0", 2023-12-01T23:19:25.869 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3601963477 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4728 172.21.15.96:0/3601963477", 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "172.21.15.96:0/3601963477", 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 10, 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 29, 2023-12-01T23:19:25.870 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-12-01T23:19:25.871 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-12-01T23:19:25.871 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-12-01T23:19:25.871 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:19:25.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:25.875 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-12-01T23:19:25.875 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:25.920 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-12-01T23:19:25.920 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:25.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:19:25.921 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:26.015 INFO:teuthology.run_tasks:Running task workunit... 2023-12-01T23:19:26.030 INFO:tasks.workunit:Pulling workunits from ref bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:19:26.031 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-01T23:19:26.031 INFO:tasks.workunit:timeout=3h 2023-12-01T23:19:26.031 INFO:tasks.workunit:cleanup=True 2023-12-01T23:19:26.031 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 29h/41d Inode: 1 Links: 2 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:fusefs_t:s0 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-12-01 23:18:29.753782195 +0000 2023-12-01T23:19:26.047 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-12-01 23:18:44.885954116 +0000 2023-12-01T23:19:26.048 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-12-01T23:19:26.048 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-01T23:19:26.048 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-01T23:19:26.445 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bed7681480ccb0192b91a35e691658867e1e96b7 2023-12-01T23:19:26.460 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-01T23:19:35.480 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:19:35.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:20:05.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:20:05.640 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:20:19.248 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to 'bed7681480ccb0192b91a35e691658867e1e96b7'. 2023-12-01T23:20:19.248 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2023-12-01T23:20:19.249 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.250 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-01T23:20:19.250 INFO:tasks.workunit.client.0.smithi096.stderr: 2023-12-01T23:20:19.250 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at bed7681480c Merge pull request #54648 from rhcs-dashboard/fs-rename-fix 2023-12-01T23:20:19.254 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-01T23:20:19.273 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-01T23:20:19.275 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T23:20:19.275 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-01T23:20:19.922 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-01T23:20:20.002 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-01T23:20:20.044 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T23:20:20.045 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T23:20:20.046 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-01T23:20:20.084 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T23:20:20.087 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:20:20.088 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-01T23:20:20.143 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-12-01T23:20:20.144 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-12-01T23:20:20.145 DEBUG:teuthology.orchestra.run.smithi096:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bed7681480ccb0192b91a35e691658867e1e96b7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-12-01T23:20:20.406 INFO:tasks.workunit.client.0.smithi096.stderr:+ dbench 1 2023-12-01T23:20:20.416 INFO:tasks.workunit.client.0.smithi096.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-01T23:20:20.416 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:20:20.416 INFO:tasks.workunit.client.0.smithi096.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-01T23:20:20.421 INFO:tasks.workunit.client.0.smithi096.stdout:0 of 1 processes prepared for launch 0 sec 2023-12-01T23:20:20.522 INFO:tasks.workunit.client.0.smithi096.stdout:1 of 1 processes prepared for launch 0 sec 2023-12-01T23:20:20.522 INFO:tasks.workunit.client.0.smithi096.stdout:releasing clients 2023-12-01T23:20:21.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 31 1.05 MB/sec warmup 1 sec latency 44.209 ms 2023-12-01T23:20:22.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 113 2.62 MB/sec warmup 2 sec latency 198.675 ms 2023-12-01T23:20:23.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 157 2.18 MB/sec warmup 3 sec latency 164.610 ms 2023-12-01T23:20:24.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 202 1.96 MB/sec warmup 4 sec latency 173.814 ms 2023-12-01T23:20:25.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 247 1.88 MB/sec warmup 5 sec latency 159.110 ms 2023-12-01T23:20:26.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 289 1.78 MB/sec warmup 6 sec latency 246.389 ms 2023-12-01T23:20:27.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 331 1.71 MB/sec warmup 7 sec latency 189.101 ms 2023-12-01T23:20:28.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 373 1.66 MB/sec warmup 8 sec latency 255.076 ms 2023-12-01T23:20:29.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 413 1.62 MB/sec warmup 9 sec latency 303.267 ms 2023-12-01T23:20:30.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 453 1.59 MB/sec warmup 10 sec latency 274.057 ms 2023-12-01T23:20:31.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 485 1.54 MB/sec warmup 11 sec latency 326.707 ms 2023-12-01T23:20:32.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 522 1.50 MB/sec warmup 12 sec latency 295.429 ms 2023-12-01T23:20:33.522 INFO:tasks.workunit.client.0.smithi096.stdout: 1 609 1.61 MB/sec warmup 13 sec latency 288.791 ms 2023-12-01T23:20:34.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 644 1.50 MB/sec warmup 14 sec latency 364.818 ms 2023-12-01T23:20:35.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 653 1.40 MB/sec warmup 15 sec latency 391.116 ms 2023-12-01T23:20:35.710 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:20:35.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:20:36.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 680 1.32 MB/sec warmup 16 sec latency 430.167 ms 2023-12-01T23:20:37.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 709 1.25 MB/sec warmup 17 sec latency 385.473 ms 2023-12-01T23:20:38.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 740 1.18 MB/sec warmup 18 sec latency 327.195 ms 2023-12-01T23:20:39.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 769 1.12 MB/sec warmup 19 sec latency 302.944 ms 2023-12-01T23:20:40.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 812 1.07 MB/sec warmup 20 sec latency 217.999 ms 2023-12-01T23:20:41.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 818 1.02 MB/sec warmup 21 sec latency 465.300 ms 2023-12-01T23:20:42.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 854 0.98 MB/sec warmup 22 sec latency 296.858 ms 2023-12-01T23:20:43.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 863 0.94 MB/sec warmup 23 sec latency 384.196 ms 2023-12-01T23:20:44.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 902 0.90 MB/sec warmup 24 sec latency 295.580 ms 2023-12-01T23:20:45.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 928 0.87 MB/sec warmup 25 sec latency 281.935 ms 2023-12-01T23:20:46.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 933 0.84 MB/sec warmup 26 sec latency 302.654 ms 2023-12-01T23:20:47.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 964 0.81 MB/sec warmup 27 sec latency 298.501 ms 2023-12-01T23:20:48.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 994 0.78 MB/sec warmup 28 sec latency 240.876 ms 2023-12-01T23:20:49.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1033 0.79 MB/sec warmup 29 sec latency 312.514 ms 2023-12-01T23:20:50.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1047 0.76 MB/sec warmup 30 sec latency 311.714 ms 2023-12-01T23:20:51.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1062 0.74 MB/sec warmup 31 sec latency 322.152 ms 2023-12-01T23:20:52.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1099 0.72 MB/sec warmup 32 sec latency 303.050 ms 2023-12-01T23:20:53.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1118 0.70 MB/sec warmup 33 sec latency 299.849 ms 2023-12-01T23:20:54.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1157 0.68 MB/sec warmup 34 sec latency 178.821 ms 2023-12-01T23:20:55.523 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1170 0.66 MB/sec warmup 35 sec latency 325.305 ms 2023-12-01T23:20:56.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1181 0.64 MB/sec warmup 36 sec latency 305.499 ms 2023-12-01T23:20:57.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1215 0.62 MB/sec warmup 37 sec latency 286.739 ms 2023-12-01T23:20:58.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1248 0.61 MB/sec warmup 38 sec latency 277.266 ms 2023-12-01T23:20:59.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1280 0.59 MB/sec warmup 39 sec latency 302.432 ms 2023-12-01T23:21:00.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1296 0.59 MB/sec warmup 40 sec latency 345.882 ms 2023-12-01T23:21:01.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1379 0.63 MB/sec warmup 41 sec latency 424.496 ms 2023-12-01T23:21:02.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1395 0.62 MB/sec warmup 42 sec latency 294.469 ms 2023-12-01T23:21:03.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1418 0.61 MB/sec warmup 43 sec latency 305.428 ms 2023-12-01T23:21:04.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1448 0.59 MB/sec warmup 44 sec latency 176.356 ms 2023-12-01T23:21:05.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1466 0.58 MB/sec warmup 45 sec latency 362.654 ms 2023-12-01T23:21:05.776 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:21:05.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:21:06.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1490 0.57 MB/sec warmup 46 sec latency 318.868 ms 2023-12-01T23:21:07.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1523 0.56 MB/sec warmup 47 sec latency 308.822 ms 2023-12-01T23:21:08.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1551 0.54 MB/sec warmup 48 sec latency 295.084 ms 2023-12-01T23:21:09.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1576 0.53 MB/sec warmup 49 sec latency 295.828 ms 2023-12-01T23:21:10.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1603 0.52 MB/sec warmup 50 sec latency 303.460 ms 2023-12-01T23:21:11.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1615 0.51 MB/sec warmup 51 sec latency 305.054 ms 2023-12-01T23:21:12.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1643 0.50 MB/sec warmup 52 sec latency 309.275 ms 2023-12-01T23:21:13.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1680 0.49 MB/sec warmup 53 sec latency 310.385 ms 2023-12-01T23:21:14.524 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1701 0.49 MB/sec warmup 54 sec latency 237.030 ms 2023-12-01T23:21:15.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1769 0.48 MB/sec warmup 55 sec latency 286.801 ms 2023-12-01T23:21:16.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1803 0.47 MB/sec warmup 56 sec latency 291.768 ms 2023-12-01T23:21:17.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1822 0.46 MB/sec warmup 57 sec latency 333.775 ms 2023-12-01T23:21:18.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1841 0.45 MB/sec warmup 58 sec latency 282.027 ms 2023-12-01T23:21:19.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1862 0.45 MB/sec warmup 59 sec latency 327.495 ms 2023-12-01T23:21:20.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1898 0.44 MB/sec warmup 60 sec latency 325.602 ms 2023-12-01T23:21:21.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1912 0.43 MB/sec warmup 61 sec latency 395.790 ms 2023-12-01T23:21:22.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1963 0.43 MB/sec warmup 62 sec latency 293.244 ms 2023-12-01T23:21:23.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 1997 0.42 MB/sec warmup 63 sec latency 282.032 ms 2023-12-01T23:21:24.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2034 0.42 MB/sec warmup 64 sec latency 286.991 ms 2023-12-01T23:21:25.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2053 0.41 MB/sec warmup 65 sec latency 294.082 ms 2023-12-01T23:21:26.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2079 0.40 MB/sec warmup 66 sec latency 301.580 ms 2023-12-01T23:21:27.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2093 0.40 MB/sec warmup 67 sec latency 326.567 ms 2023-12-01T23:21:28.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2138 0.39 MB/sec warmup 68 sec latency 324.614 ms 2023-12-01T23:21:29.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2173 0.39 MB/sec warmup 69 sec latency 333.836 ms 2023-12-01T23:21:30.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2183 0.38 MB/sec warmup 70 sec latency 306.499 ms 2023-12-01T23:21:31.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2220 0.38 MB/sec warmup 71 sec latency 316.456 ms 2023-12-01T23:21:32.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2292 0.39 MB/sec warmup 72 sec latency 300.962 ms 2023-12-01T23:21:33.525 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2306 0.38 MB/sec warmup 73 sec latency 302.965 ms 2023-12-01T23:21:34.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2324 0.38 MB/sec warmup 74 sec latency 413.251 ms 2023-12-01T23:21:35.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2337 0.37 MB/sec warmup 75 sec latency 311.127 ms 2023-12-01T23:21:36.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:21:36.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:21:36.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2361 0.37 MB/sec warmup 76 sec latency 288.006 ms 2023-12-01T23:21:37.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2367 0.36 MB/sec warmup 77 sec latency 307.572 ms 2023-12-01T23:21:38.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2386 0.36 MB/sec warmup 78 sec latency 519.586 ms 2023-12-01T23:21:39.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2400 0.35 MB/sec warmup 79 sec latency 310.043 ms 2023-12-01T23:21:40.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2428 0.35 MB/sec warmup 80 sec latency 329.182 ms 2023-12-01T23:21:41.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2434 0.35 MB/sec warmup 81 sec latency 520.736 ms 2023-12-01T23:21:42.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2454 0.34 MB/sec warmup 82 sec latency 140.672 ms 2023-12-01T23:21:43.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2490 0.35 MB/sec warmup 83 sec latency 291.007 ms 2023-12-01T23:21:44.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2504 0.34 MB/sec warmup 84 sec latency 304.265 ms 2023-12-01T23:21:45.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2554 0.34 MB/sec warmup 85 sec latency 308.365 ms 2023-12-01T23:21:46.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2576 0.34 MB/sec warmup 86 sec latency 289.541 ms 2023-12-01T23:21:47.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2590 0.33 MB/sec warmup 87 sec latency 329.445 ms 2023-12-01T23:21:48.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2606 0.33 MB/sec warmup 88 sec latency 306.311 ms 2023-12-01T23:21:49.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2618 0.33 MB/sec warmup 89 sec latency 332.729 ms 2023-12-01T23:21:50.526 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2718 0.35 MB/sec warmup 90 sec latency 323.328 ms 2023-12-01T23:21:51.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2759 0.35 MB/sec warmup 91 sec latency 444.028 ms 2023-12-01T23:21:52.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2779 0.35 MB/sec warmup 92 sec latency 300.017 ms 2023-12-01T23:21:53.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2876 0.35 MB/sec warmup 93 sec latency 293.862 ms 2023-12-01T23:21:54.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2909 0.35 MB/sec warmup 94 sec latency 176.090 ms 2023-12-01T23:21:55.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2938 0.35 MB/sec warmup 95 sec latency 230.734 ms 2023-12-01T23:21:56.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2974 0.35 MB/sec warmup 96 sec latency 306.789 ms 2023-12-01T23:21:57.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 2994 0.35 MB/sec warmup 97 sec latency 322.981 ms 2023-12-01T23:21:58.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3018 0.34 MB/sec warmup 98 sec latency 274.461 ms 2023-12-01T23:21:59.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3167 0.34 MB/sec warmup 99 sec latency 299.247 ms 2023-12-01T23:22:00.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3188 0.34 MB/sec warmup 100 sec latency 298.143 ms 2023-12-01T23:22:01.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3237 0.34 MB/sec warmup 101 sec latency 302.569 ms 2023-12-01T23:22:02.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3280 0.35 MB/sec warmup 102 sec latency 283.717 ms 2023-12-01T23:22:03.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3283 0.34 MB/sec warmup 103 sec latency 308.914 ms 2023-12-01T23:22:04.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3287 0.34 MB/sec warmup 104 sec latency 305.451 ms 2023-12-01T23:22:05.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3292 0.34 MB/sec warmup 105 sec latency 368.329 ms 2023-12-01T23:22:06.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:22:06.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:22:06.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3295 0.33 MB/sec warmup 106 sec latency 389.640 ms 2023-12-01T23:22:07.527 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3303 0.33 MB/sec warmup 107 sec latency 420.540 ms 2023-12-01T23:22:08.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3308 0.33 MB/sec warmup 108 sec latency 323.028 ms 2023-12-01T23:22:09.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3312 0.32 MB/sec warmup 109 sec latency 301.582 ms 2023-12-01T23:22:10.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3316 0.32 MB/sec warmup 110 sec latency 317.136 ms 2023-12-01T23:22:11.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3319 0.32 MB/sec warmup 111 sec latency 383.338 ms 2023-12-01T23:22:12.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3323 0.32 MB/sec warmup 112 sec latency 300.065 ms 2023-12-01T23:22:13.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3327 0.31 MB/sec warmup 113 sec latency 294.087 ms 2023-12-01T23:22:14.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3332 0.31 MB/sec warmup 114 sec latency 290.592 ms 2023-12-01T23:22:15.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3336 0.31 MB/sec warmup 115 sec latency 292.738 ms 2023-12-01T23:22:16.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3353 0.31 MB/sec warmup 116 sec latency 280.043 ms 2023-12-01T23:22:17.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3378 0.30 MB/sec warmup 117 sec latency 148.229 ms 2023-12-01T23:22:18.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3395 0.30 MB/sec warmup 118 sec latency 316.714 ms 2023-12-01T23:22:19.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3507 0.32 MB/sec warmup 119 sec latency 289.959 ms 2023-12-01T23:22:21.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3558 0.04 MB/sec execute 1 sec latency 339.669 ms 2023-12-01T23:22:22.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3582 0.03 MB/sec execute 2 sec latency 371.000 ms 2023-12-01T23:22:23.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3628 0.07 MB/sec execute 3 sec latency 277.312 ms 2023-12-01T23:22:24.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3650 0.06 MB/sec execute 4 sec latency 300.799 ms 2023-12-01T23:22:25.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3673 0.07 MB/sec execute 5 sec latency 392.568 ms 2023-12-01T23:22:26.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3695 0.06 MB/sec execute 6 sec latency 364.476 ms 2023-12-01T23:22:27.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3723 0.06 MB/sec execute 7 sec latency 123.086 ms 2023-12-01T23:22:28.528 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3771 0.17 MB/sec execute 8 sec latency 290.772 ms 2023-12-01T23:22:29.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3785 0.15 MB/sec execute 9 sec latency 203.385 ms 2023-12-01T23:22:30.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3796 0.14 MB/sec execute 10 sec latency 231.538 ms 2023-12-01T23:22:31.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3812 0.13 MB/sec execute 11 sec latency 185.218 ms 2023-12-01T23:22:32.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3828 0.12 MB/sec execute 12 sec latency 150.437 ms 2023-12-01T23:22:33.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3845 0.11 MB/sec execute 13 sec latency 177.804 ms 2023-12-01T23:22:34.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3863 0.10 MB/sec execute 14 sec latency 171.431 ms 2023-12-01T23:22:35.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3876 0.09 MB/sec execute 15 sec latency 292.498 ms 2023-12-01T23:22:36.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:22:36.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:22:36.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3896 0.10 MB/sec execute 16 sec latency 324.664 ms 2023-12-01T23:22:37.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3914 0.10 MB/sec execute 17 sec latency 314.640 ms 2023-12-01T23:22:38.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3928 0.09 MB/sec execute 18 sec latency 282.208 ms 2023-12-01T23:22:39.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3939 0.09 MB/sec execute 19 sec latency 182.440 ms 2023-12-01T23:22:40.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3955 0.08 MB/sec execute 20 sec latency 179.663 ms 2023-12-01T23:22:41.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3974 0.08 MB/sec execute 21 sec latency 155.334 ms 2023-12-01T23:22:42.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 3991 0.08 MB/sec execute 22 sec latency 150.022 ms 2023-12-01T23:22:43.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4006 0.07 MB/sec execute 23 sec latency 195.021 ms 2023-12-01T23:22:44.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4026 0.07 MB/sec execute 24 sec latency 146.170 ms 2023-12-01T23:22:45.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4034 0.07 MB/sec execute 25 sec latency 305.520 ms 2023-12-01T23:22:46.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4046 0.06 MB/sec execute 26 sec latency 304.679 ms 2023-12-01T23:22:47.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4063 0.06 MB/sec execute 27 sec latency 314.549 ms 2023-12-01T23:22:48.529 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4082 0.06 MB/sec execute 28 sec latency 297.021 ms 2023-12-01T23:22:49.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4112 0.06 MB/sec execute 29 sec latency 292.934 ms 2023-12-01T23:22:50.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4133 0.06 MB/sec execute 30 sec latency 216.406 ms 2023-12-01T23:22:51.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4155 0.06 MB/sec execute 31 sec latency 259.464 ms 2023-12-01T23:22:52.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4173 0.05 MB/sec execute 32 sec latency 216.242 ms 2023-12-01T23:22:53.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4181 0.05 MB/sec execute 33 sec latency 318.536 ms 2023-12-01T23:22:54.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4217 0.05 MB/sec execute 34 sec latency 310.148 ms 2023-12-01T23:22:55.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4236 0.05 MB/sec execute 35 sec latency 349.522 ms 2023-12-01T23:22:56.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4257 0.05 MB/sec execute 36 sec latency 438.316 ms 2023-12-01T23:22:57.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4304 0.06 MB/sec execute 37 sec latency 221.968 ms 2023-12-01T23:22:58.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4340 0.06 MB/sec execute 38 sec latency 306.592 ms 2023-12-01T23:22:59.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4379 0.06 MB/sec execute 39 sec latency 229.375 ms 2023-12-01T23:23:00.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4388 0.06 MB/sec execute 40 sec latency 302.329 ms 2023-12-01T23:23:01.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4424 0.06 MB/sec execute 41 sec latency 309.145 ms 2023-12-01T23:23:02.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4434 0.06 MB/sec execute 42 sec latency 337.501 ms 2023-12-01T23:23:03.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4472 0.06 MB/sec execute 43 sec latency 291.128 ms 2023-12-01T23:23:04.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4498 0.06 MB/sec execute 44 sec latency 294.965 ms 2023-12-01T23:23:05.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4505 0.06 MB/sec execute 45 sec latency 298.559 ms 2023-12-01T23:23:06.418 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:23:06.421 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:23:06.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4535 0.06 MB/sec execute 46 sec latency 375.186 ms 2023-12-01T23:23:07.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4563 0.06 MB/sec execute 47 sec latency 241.202 ms 2023-12-01T23:23:08.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4602 0.08 MB/sec execute 48 sec latency 307.954 ms 2023-12-01T23:23:09.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4616 0.07 MB/sec execute 49 sec latency 315.217 ms 2023-12-01T23:23:10.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4648 0.07 MB/sec execute 50 sec latency 284.440 ms 2023-12-01T23:23:11.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4668 0.07 MB/sec execute 51 sec latency 286.834 ms 2023-12-01T23:23:12.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4702 0.07 MB/sec execute 52 sec latency 286.198 ms 2023-12-01T23:23:13.530 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4734 0.07 MB/sec execute 53 sec latency 274.840 ms 2023-12-01T23:23:14.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4739 0.07 MB/sec execute 54 sec latency 308.277 ms 2023-12-01T23:23:15.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4770 0.07 MB/sec execute 55 sec latency 182.450 ms 2023-12-01T23:23:16.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4799 0.07 MB/sec execute 56 sec latency 344.598 ms 2023-12-01T23:23:17.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4834 0.07 MB/sec execute 57 sec latency 316.752 ms 2023-12-01T23:23:18.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4847 0.07 MB/sec execute 58 sec latency 289.630 ms 2023-12-01T23:23:19.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4942 0.11 MB/sec execute 59 sec latency 360.834 ms 2023-12-01T23:23:20.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4951 0.11 MB/sec execute 60 sec latency 297.143 ms 2023-12-01T23:23:21.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 4969 0.11 MB/sec execute 61 sec latency 337.860 ms 2023-12-01T23:23:22.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5007 0.11 MB/sec execute 62 sec latency 292.723 ms 2023-12-01T23:23:23.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5030 0.11 MB/sec execute 63 sec latency 282.718 ms 2023-12-01T23:23:24.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5052 0.11 MB/sec execute 64 sec latency 325.980 ms 2023-12-01T23:23:25.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5075 0.10 MB/sec execute 65 sec latency 320.943 ms 2023-12-01T23:23:26.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5096 0.10 MB/sec execute 66 sec latency 332.859 ms 2023-12-01T23:23:27.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5123 0.10 MB/sec execute 67 sec latency 298.169 ms 2023-12-01T23:23:28.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5154 0.10 MB/sec execute 68 sec latency 126.894 ms 2023-12-01T23:23:29.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5175 0.10 MB/sec execute 69 sec latency 317.355 ms 2023-12-01T23:23:30.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5203 0.10 MB/sec execute 70 sec latency 335.370 ms 2023-12-01T23:23:31.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5218 0.10 MB/sec execute 71 sec latency 330.778 ms 2023-12-01T23:23:32.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5263 0.10 MB/sec execute 72 sec latency 255.542 ms 2023-12-01T23:23:33.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5280 0.10 MB/sec execute 73 sec latency 296.362 ms 2023-12-01T23:23:34.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5337 0.09 MB/sec execute 74 sec latency 277.744 ms 2023-12-01T23:23:35.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5379 0.09 MB/sec execute 75 sec latency 321.494 ms 2023-12-01T23:23:36.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:23:36.517 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:23:36.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5391 0.09 MB/sec execute 76 sec latency 358.113 ms 2023-12-01T23:23:37.531 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5420 0.09 MB/sec execute 77 sec latency 309.222 ms 2023-12-01T23:23:38.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5433 0.09 MB/sec execute 78 sec latency 294.563 ms 2023-12-01T23:23:39.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5468 0.09 MB/sec execute 79 sec latency 306.834 ms 2023-12-01T23:23:40.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5485 0.09 MB/sec execute 80 sec latency 310.842 ms 2023-12-01T23:23:41.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5540 0.09 MB/sec execute 81 sec latency 290.909 ms 2023-12-01T23:23:42.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5583 0.09 MB/sec execute 82 sec latency 296.546 ms 2023-12-01T23:23:43.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5613 0.09 MB/sec execute 83 sec latency 297.235 ms 2023-12-01T23:23:44.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5623 0.09 MB/sec execute 84 sec latency 302.518 ms 2023-12-01T23:23:45.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5643 0.09 MB/sec execute 85 sec latency 321.890 ms 2023-12-01T23:23:46.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5658 0.09 MB/sec execute 86 sec latency 460.325 ms 2023-12-01T23:23:47.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5707 0.09 MB/sec execute 87 sec latency 308.629 ms 2023-12-01T23:23:48.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5737 0.09 MB/sec execute 88 sec latency 318.930 ms 2023-12-01T23:23:49.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5756 0.08 MB/sec execute 89 sec latency 318.915 ms 2023-12-01T23:23:50.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5808 0.08 MB/sec execute 90 sec latency 283.265 ms 2023-12-01T23:23:51.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5858 0.09 MB/sec execute 91 sec latency 296.964 ms 2023-12-01T23:23:52.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5867 0.09 MB/sec execute 92 sec latency 298.514 ms 2023-12-01T23:23:53.532 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5889 0.09 MB/sec execute 93 sec latency 426.043 ms 2023-12-01T23:23:54.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5900 0.09 MB/sec execute 94 sec latency 305.319 ms 2023-12-01T23:23:55.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5922 0.09 MB/sec execute 95 sec latency 293.337 ms 2023-12-01T23:23:56.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5926 0.09 MB/sec execute 96 sec latency 758.965 ms 2023-12-01T23:23:57.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5949 0.09 MB/sec execute 97 sec latency 322.838 ms 2023-12-01T23:23:58.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5967 0.09 MB/sec execute 98 sec latency 277.334 ms 2023-12-01T23:23:59.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 5991 0.09 MB/sec execute 99 sec latency 340.799 ms 2023-12-01T23:24:00.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6000 0.09 MB/sec execute 100 sec latency 307.596 ms 2023-12-01T23:24:01.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6030 0.09 MB/sec execute 101 sec latency 152.972 ms 2023-12-01T23:24:02.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6052 0.09 MB/sec execute 102 sec latency 350.220 ms 2023-12-01T23:24:03.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6064 0.09 MB/sec execute 103 sec latency 306.146 ms 2023-12-01T23:24:04.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6117 0.09 MB/sec execute 104 sec latency 317.945 ms 2023-12-01T23:24:05.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6138 0.09 MB/sec execute 105 sec latency 293.277 ms 2023-12-01T23:24:06.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6154 0.09 MB/sec execute 106 sec latency 321.924 ms 2023-12-01T23:24:06.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:24:06.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:24:07.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6166 0.09 MB/sec execute 107 sec latency 304.732 ms 2023-12-01T23:24:08.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6176 0.09 MB/sec execute 108 sec latency 317.361 ms 2023-12-01T23:24:09.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6276 0.12 MB/sec execute 109 sec latency 330.177 ms 2023-12-01T23:24:10.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6316 0.12 MB/sec execute 110 sec latency 290.705 ms 2023-12-01T23:24:11.533 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6336 0.11 MB/sec execute 111 sec latency 318.614 ms 2023-12-01T23:24:12.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6435 0.12 MB/sec execute 112 sec latency 295.852 ms 2023-12-01T23:24:13.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6474 0.13 MB/sec execute 113 sec latency 143.792 ms 2023-12-01T23:24:14.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6521 0.12 MB/sec execute 114 sec latency 299.797 ms 2023-12-01T23:24:15.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6530 0.12 MB/sec execute 115 sec latency 317.746 ms 2023-12-01T23:24:16.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6549 0.12 MB/sec execute 116 sec latency 204.710 ms 2023-12-01T23:24:17.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6574 0.12 MB/sec execute 117 sec latency 274.861 ms 2023-12-01T23:24:18.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6722 0.13 MB/sec execute 118 sec latency 312.018 ms 2023-12-01T23:24:19.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6744 0.13 MB/sec execute 119 sec latency 298.143 ms 2023-12-01T23:24:20.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6820 0.13 MB/sec execute 120 sec latency 233.462 ms 2023-12-01T23:24:21.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6834 0.13 MB/sec execute 121 sec latency 301.610 ms 2023-12-01T23:24:22.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6837 0.13 MB/sec execute 122 sec latency 307.436 ms 2023-12-01T23:24:23.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6844 0.13 MB/sec execute 123 sec latency 323.829 ms 2023-12-01T23:24:24.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6847 0.13 MB/sec execute 124 sec latency 349.900 ms 2023-12-01T23:24:25.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6851 0.13 MB/sec execute 125 sec latency 359.732 ms 2023-12-01T23:24:26.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6858 0.13 MB/sec execute 126 sec latency 463.699 ms 2023-12-01T23:24:27.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6863 0.13 MB/sec execute 127 sec latency 337.271 ms 2023-12-01T23:24:28.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6867 0.13 MB/sec execute 128 sec latency 302.995 ms 2023-12-01T23:24:29.534 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6871 0.12 MB/sec execute 129 sec latency 314.129 ms 2023-12-01T23:24:30.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6874 0.12 MB/sec execute 130 sec latency 306.908 ms 2023-12-01T23:24:31.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6879 0.12 MB/sec execute 131 sec latency 319.676 ms 2023-12-01T23:24:32.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6882 0.12 MB/sec execute 132 sec latency 295.888 ms 2023-12-01T23:24:33.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6887 0.12 MB/sec execute 133 sec latency 306.101 ms 2023-12-01T23:24:34.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6891 0.12 MB/sec execute 134 sec latency 292.900 ms 2023-12-01T23:24:35.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6908 0.12 MB/sec execute 135 sec latency 300.049 ms 2023-12-01T23:24:36.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6932 0.12 MB/sec execute 136 sec latency 215.984 ms 2023-12-01T23:24:36.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:24:36.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:24:37.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 6949 0.12 MB/sec execute 137 sec latency 314.478 ms 2023-12-01T23:24:38.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7057 0.14 MB/sec execute 138 sec latency 297.983 ms 2023-12-01T23:24:39.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7085 0.14 MB/sec execute 139 sec latency 284.032 ms 2023-12-01T23:24:40.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7109 0.14 MB/sec execute 140 sec latency 307.366 ms 2023-12-01T23:24:41.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7130 0.14 MB/sec execute 141 sec latency 293.422 ms 2023-12-01T23:24:42.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7174 0.14 MB/sec execute 142 sec latency 378.384 ms 2023-12-01T23:24:43.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7194 0.14 MB/sec execute 143 sec latency 309.204 ms 2023-12-01T23:24:44.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7219 0.14 MB/sec execute 144 sec latency 347.315 ms 2023-12-01T23:24:45.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7240 0.13 MB/sec execute 145 sec latency 288.901 ms 2023-12-01T23:24:46.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7266 0.13 MB/sec execute 146 sec latency 158.213 ms 2023-12-01T23:24:47.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7312 0.14 MB/sec execute 147 sec latency 321.459 ms 2023-12-01T23:24:48.535 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7329 0.14 MB/sec execute 148 sec latency 178.058 ms 2023-12-01T23:24:49.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7340 0.14 MB/sec execute 149 sec latency 173.719 ms 2023-12-01T23:24:50.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7356 0.14 MB/sec execute 150 sec latency 192.798 ms 2023-12-01T23:24:51.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7372 0.14 MB/sec execute 151 sec latency 163.413 ms 2023-12-01T23:24:52.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7389 0.13 MB/sec execute 152 sec latency 142.376 ms 2023-12-01T23:24:53.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7405 0.13 MB/sec execute 153 sec latency 256.966 ms 2023-12-01T23:24:54.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7420 0.13 MB/sec execute 154 sec latency 293.150 ms 2023-12-01T23:24:55.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7440 0.13 MB/sec execute 155 sec latency 273.148 ms 2023-12-01T23:24:56.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7458 0.13 MB/sec execute 156 sec latency 292.316 ms 2023-12-01T23:24:57.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7472 0.13 MB/sec execute 157 sec latency 290.008 ms 2023-12-01T23:24:58.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7483 0.13 MB/sec execute 158 sec latency 178.947 ms 2023-12-01T23:24:59.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7498 0.13 MB/sec execute 159 sec latency 187.034 ms 2023-12-01T23:25:00.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7515 0.13 MB/sec execute 160 sec latency 143.869 ms 2023-12-01T23:25:01.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7533 0.13 MB/sec execute 161 sec latency 186.240 ms 2023-12-01T23:25:02.536 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7550 0.13 MB/sec execute 162 sec latency 146.040 ms 2023-12-01T23:25:03.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7567 0.13 MB/sec execute 163 sec latency 145.715 ms 2023-12-01T23:25:04.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7577 0.13 MB/sec execute 164 sec latency 321.613 ms 2023-12-01T23:25:05.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7591 0.13 MB/sec execute 165 sec latency 284.952 ms 2023-12-01T23:25:06.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7607 0.13 MB/sec execute 166 sec latency 296.573 ms 2023-12-01T23:25:06.963 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:25:06.966 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:25:07.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7626 0.12 MB/sec execute 167 sec latency 315.210 ms 2023-12-01T23:25:08.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7654 0.12 MB/sec execute 168 sec latency 288.688 ms 2023-12-01T23:25:09.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7676 0.12 MB/sec execute 169 sec latency 241.349 ms 2023-12-01T23:25:10.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7695 0.12 MB/sec execute 170 sec latency 392.512 ms 2023-12-01T23:25:11.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7715 0.12 MB/sec execute 171 sec latency 395.334 ms 2023-12-01T23:25:12.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7728 0.12 MB/sec execute 172 sec latency 293.376 ms 2023-12-01T23:25:13.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7759 0.12 MB/sec execute 173 sec latency 344.698 ms 2023-12-01T23:25:14.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7780 0.12 MB/sec execute 174 sec latency 340.228 ms 2023-12-01T23:25:15.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7812 0.12 MB/sec execute 175 sec latency 280.532 ms 2023-12-01T23:25:16.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7851 0.12 MB/sec execute 176 sec latency 211.240 ms 2023-12-01T23:25:17.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7882 0.12 MB/sec execute 177 sec latency 317.280 ms 2023-12-01T23:25:18.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7923 0.12 MB/sec execute 178 sec latency 221.811 ms 2023-12-01T23:25:19.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7930 0.12 MB/sec execute 179 sec latency 294.079 ms 2023-12-01T23:25:20.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7966 0.12 MB/sec execute 180 sec latency 300.400 ms 2023-12-01T23:25:21.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7982 0.12 MB/sec execute 181 sec latency 425.718 ms 2023-12-01T23:25:22.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8014 0.12 MB/sec execute 182 sec latency 290.404 ms 2023-12-01T23:25:23.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8040 0.12 MB/sec execute 183 sec latency 292.802 ms 2023-12-01T23:25:24.537 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8048 0.12 MB/sec execute 184 sec latency 299.398 ms 2023-12-01T23:25:25.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8080 0.12 MB/sec execute 185 sec latency 301.806 ms 2023-12-01T23:25:26.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8105 0.12 MB/sec execute 186 sec latency 352.448 ms 2023-12-01T23:25:27.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8144 0.12 MB/sec execute 187 sec latency 467.387 ms 2023-12-01T23:25:28.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8158 0.12 MB/sec execute 188 sec latency 331.683 ms 2023-12-01T23:25:29.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8183 0.12 MB/sec execute 189 sec latency 304.367 ms 2023-12-01T23:25:30.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8210 0.12 MB/sec execute 190 sec latency 297.876 ms 2023-12-01T23:25:31.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8243 0.12 MB/sec execute 191 sec latency 285.012 ms 2023-12-01T23:25:32.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8271 0.12 MB/sec execute 192 sec latency 271.045 ms 2023-12-01T23:25:33.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8280 0.12 MB/sec execute 193 sec latency 326.488 ms 2023-12-01T23:25:34.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8310 0.12 MB/sec execute 194 sec latency 223.339 ms 2023-12-01T23:25:35.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8339 0.12 MB/sec execute 195 sec latency 290.581 ms 2023-12-01T23:25:36.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8360 0.12 MB/sec execute 196 sec latency 496.645 ms 2023-12-01T23:25:37.094 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:25:37.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:25:37.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8388 0.12 MB/sec execute 197 sec latency 349.498 ms 2023-12-01T23:25:38.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8485 0.13 MB/sec execute 198 sec latency 320.967 ms 2023-12-01T23:25:39.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8491 0.13 MB/sec execute 199 sec latency 282.895 ms 2023-12-01T23:25:40.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8506 0.13 MB/sec execute 200 sec latency 275.735 ms 2023-12-01T23:25:41.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8537 0.13 MB/sec execute 201 sec latency 300.629 ms 2023-12-01T23:25:42.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8570 0.13 MB/sec execute 202 sec latency 369.165 ms 2023-12-01T23:25:43.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8594 0.13 MB/sec execute 203 sec latency 319.252 ms 2023-12-01T23:25:44.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8609 0.13 MB/sec execute 204 sec latency 315.481 ms 2023-12-01T23:25:45.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8636 0.13 MB/sec execute 205 sec latency 283.146 ms 2023-12-01T23:25:46.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8663 0.13 MB/sec execute 206 sec latency 291.031 ms 2023-12-01T23:25:47.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8696 0.13 MB/sec execute 207 sec latency 284.052 ms 2023-12-01T23:25:48.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8718 0.13 MB/sec execute 208 sec latency 290.227 ms 2023-12-01T23:25:49.538 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8740 0.12 MB/sec execute 209 sec latency 330.738 ms 2023-12-01T23:25:50.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8761 0.12 MB/sec execute 210 sec latency 300.604 ms 2023-12-01T23:25:51.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8797 0.12 MB/sec execute 211 sec latency 350.276 ms 2023-12-01T23:25:52.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8815 0.12 MB/sec execute 212 sec latency 297.182 ms 2023-12-01T23:25:53.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8880 0.12 MB/sec execute 213 sec latency 292.505 ms 2023-12-01T23:25:54.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8914 0.12 MB/sec execute 214 sec latency 288.872 ms 2023-12-01T23:25:55.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8936 0.12 MB/sec execute 215 sec latency 321.423 ms 2023-12-01T23:25:56.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8960 0.12 MB/sec execute 216 sec latency 458.907 ms 2023-12-01T23:25:57.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 8976 0.12 MB/sec execute 217 sec latency 294.908 ms 2023-12-01T23:25:58.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9007 0.12 MB/sec execute 218 sec latency 291.325 ms 2023-12-01T23:25:59.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9029 0.12 MB/sec execute 219 sec latency 286.612 ms 2023-12-01T23:26:00.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9082 0.12 MB/sec execute 220 sec latency 289.312 ms 2023-12-01T23:26:01.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9111 0.12 MB/sec execute 221 sec latency 293.123 ms 2023-12-01T23:26:02.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9149 0.12 MB/sec execute 222 sec latency 293.001 ms 2023-12-01T23:26:03.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9165 0.12 MB/sec execute 223 sec latency 289.813 ms 2023-12-01T23:26:04.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9187 0.12 MB/sec execute 224 sec latency 313.776 ms 2023-12-01T23:26:05.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9202 0.12 MB/sec execute 225 sec latency 327.825 ms 2023-12-01T23:26:06.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9246 0.12 MB/sec execute 226 sec latency 318.636 ms 2023-12-01T23:26:07.284 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:26:07.287 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:26:07.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9280 0.12 MB/sec execute 227 sec latency 387.323 ms 2023-12-01T23:26:08.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9288 0.12 MB/sec execute 228 sec latency 307.042 ms 2023-12-01T23:26:09.539 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9331 0.12 MB/sec execute 229 sec latency 333.746 ms 2023-12-01T23:26:10.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9400 0.12 MB/sec execute 230 sec latency 295.661 ms 2023-12-01T23:26:11.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9411 0.12 MB/sec execute 231 sec latency 432.052 ms 2023-12-01T23:26:12.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9431 0.12 MB/sec execute 232 sec latency 307.928 ms 2023-12-01T23:26:13.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9444 0.12 MB/sec execute 233 sec latency 300.684 ms 2023-12-01T23:26:14.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9466 0.12 MB/sec execute 234 sec latency 299.670 ms 2023-12-01T23:26:15.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9472 0.12 MB/sec execute 235 sec latency 298.564 ms 2023-12-01T23:26:16.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9495 0.12 MB/sec execute 236 sec latency 314.073 ms 2023-12-01T23:26:17.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9511 0.12 MB/sec execute 237 sec latency 302.447 ms 2023-12-01T23:26:18.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9535 0.12 MB/sec execute 238 sec latency 324.406 ms 2023-12-01T23:26:19.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9544 0.12 MB/sec execute 239 sec latency 324.096 ms 2023-12-01T23:26:20.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9574 0.12 MB/sec execute 240 sec latency 184.335 ms 2023-12-01T23:26:21.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9598 0.12 MB/sec execute 241 sec latency 317.107 ms 2023-12-01T23:26:22.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9651 0.12 MB/sec execute 242 sec latency 328.131 ms 2023-12-01T23:26:23.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9662 0.12 MB/sec execute 243 sec latency 301.755 ms 2023-12-01T23:26:24.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9682 0.12 MB/sec execute 244 sec latency 277.808 ms 2023-12-01T23:26:25.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9702 0.12 MB/sec execute 245 sec latency 287.249 ms 2023-12-01T23:26:26.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9717 0.12 MB/sec execute 246 sec latency 283.839 ms 2023-12-01T23:26:27.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9723 0.12 MB/sec execute 247 sec latency 309.182 ms 2023-12-01T23:26:28.540 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9846 0.13 MB/sec execute 248 sec latency 287.179 ms 2023-12-01T23:26:29.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9864 0.13 MB/sec execute 249 sec latency 316.419 ms 2023-12-01T23:26:30.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9898 0.13 MB/sec execute 250 sec latency 284.109 ms 2023-12-01T23:26:31.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 9996 0.13 MB/sec execute 251 sec latency 289.448 ms 2023-12-01T23:26:32.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10030 0.13 MB/sec execute 252 sec latency 134.924 ms 2023-12-01T23:26:33.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10066 0.13 MB/sec execute 253 sec latency 315.512 ms 2023-12-01T23:26:34.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10081 0.13 MB/sec execute 254 sec latency 328.937 ms 2023-12-01T23:26:35.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10104 0.13 MB/sec execute 255 sec latency 323.036 ms 2023-12-01T23:26:36.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10123 0.13 MB/sec execute 256 sec latency 217.541 ms 2023-12-01T23:26:37.365 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:26:37.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:26:37.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10270 0.13 MB/sec execute 257 sec latency 322.475 ms 2023-12-01T23:26:38.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10303 0.13 MB/sec execute 258 sec latency 279.987 ms 2023-12-01T23:26:39.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10365 0.14 MB/sec execute 259 sec latency 267.979 ms 2023-12-01T23:26:40.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10380 0.14 MB/sec execute 260 sec latency 297.658 ms 2023-12-01T23:26:41.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10384 0.13 MB/sec execute 261 sec latency 302.314 ms 2023-12-01T23:26:42.214 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:01.121 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.270 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:01.176 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.307 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:01.159 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.309 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:01.161 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.362 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:01.214 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.363 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:01.215 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10389 0.13 MB/sec execute 262 sec latency 297.482 ms 2023-12-01T23:26:42.621 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:01.527 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.735 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:01.587 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:42.738 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:01.589 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:26:43.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10391 0.13 MB/sec execute 263 sec latency 410.518 ms 2023-12-01T23:26:44.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10394 0.13 MB/sec execute 264 sec latency 409.359 ms 2023-12-01T23:26:45.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10402 0.13 MB/sec execute 265 sec latency 413.628 ms 2023-12-01T23:26:46.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10407 0.13 MB/sec execute 266 sec latency 350.682 ms 2023-12-01T23:26:47.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10410 0.13 MB/sec execute 267 sec latency 293.176 ms 2023-12-01T23:26:48.541 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10415 0.13 MB/sec execute 268 sec latency 295.947 ms 2023-12-01T23:26:49.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10418 0.13 MB/sec execute 269 sec latency 289.513 ms 2023-12-01T23:26:50.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10423 0.13 MB/sec execute 270 sec latency 295.787 ms 2023-12-01T23:26:51.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10426 0.13 MB/sec execute 271 sec latency 309.448 ms 2023-12-01T23:26:52.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10431 0.13 MB/sec execute 272 sec latency 297.463 ms 2023-12-01T23:26:53.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10435 0.13 MB/sec execute 273 sec latency 289.445 ms 2023-12-01T23:26:54.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10451 0.13 MB/sec execute 274 sec latency 285.141 ms 2023-12-01T23:26:55.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10477 0.13 MB/sec execute 275 sec latency 138.524 ms 2023-12-01T23:26:56.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10493 0.13 MB/sec execute 276 sec latency 326.037 ms 2023-12-01T23:26:57.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10605 0.14 MB/sec execute 277 sec latency 296.370 ms 2023-12-01T23:26:58.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10636 0.14 MB/sec execute 278 sec latency 307.886 ms 2023-12-01T23:26:59.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10656 0.14 MB/sec execute 279 sec latency 302.197 ms 2023-12-01T23:27:00.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10680 0.14 MB/sec execute 280 sec latency 283.320 ms 2023-12-01T23:27:01.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10725 0.14 MB/sec execute 281 sec latency 387.170 ms 2023-12-01T23:27:02.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10754 0.14 MB/sec execute 282 sec latency 314.298 ms 2023-12-01T23:27:03.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10767 0.14 MB/sec execute 283 sec latency 327.511 ms 2023-12-01T23:27:04.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10786 0.14 MB/sec execute 284 sec latency 290.242 ms 2023-12-01T23:27:05.542 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10819 0.14 MB/sec execute 285 sec latency 145.629 ms 2023-12-01T23:27:06.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10863 0.14 MB/sec execute 286 sec latency 286.392 ms 2023-12-01T23:27:07.478 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:27:07.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:27:07.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10878 0.14 MB/sec execute 287 sec latency 202.350 ms 2023-12-01T23:27:08.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10887 0.14 MB/sec execute 288 sec latency 186.530 ms 2023-12-01T23:27:09.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10903 0.14 MB/sec execute 289 sec latency 202.218 ms 2023-12-01T23:27:10.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10921 0.14 MB/sec execute 290 sec latency 141.102 ms 2023-12-01T23:27:11.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10937 0.14 MB/sec execute 291 sec latency 218.849 ms 2023-12-01T23:27:12.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10954 0.14 MB/sec execute 292 sec latency 184.740 ms 2023-12-01T23:27:13.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10966 0.14 MB/sec execute 293 sec latency 276.387 ms 2023-12-01T23:27:14.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 10986 0.14 MB/sec execute 294 sec latency 299.237 ms 2023-12-01T23:27:15.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11004 0.14 MB/sec execute 295 sec latency 284.995 ms 2023-12-01T23:27:16.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11022 0.13 MB/sec execute 296 sec latency 268.044 ms 2023-12-01T23:27:17.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11033 0.13 MB/sec execute 297 sec latency 181.681 ms 2023-12-01T23:27:18.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11049 0.13 MB/sec execute 298 sec latency 188.743 ms 2023-12-01T23:27:19.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11066 0.13 MB/sec execute 299 sec latency 143.434 ms 2023-12-01T23:27:20.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11083 0.13 MB/sec execute 300 sec latency 190.488 ms 2023-12-01T23:27:21.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11096 0.13 MB/sec execute 301 sec latency 287.212 ms 2023-12-01T23:27:22.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11116 0.13 MB/sec execute 302 sec latency 293.305 ms 2023-12-01T23:27:23.307 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:42.213 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.316 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:42.222 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.326 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:42.178 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.326 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:42.178 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.328 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:42.181 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.330 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:42.182 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.363 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:09:42.269 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.395 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:09:42.247 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.395 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:09:42.248 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:27:23.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11124 0.13 MB/sec execute 303 sec latency 359.486 ms 2023-12-01T23:27:24.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11137 0.13 MB/sec execute 304 sec latency 305.273 ms 2023-12-01T23:27:25.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11154 0.13 MB/sec execute 305 sec latency 284.536 ms 2023-12-01T23:27:26.543 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11173 0.13 MB/sec execute 306 sec latency 326.108 ms 2023-12-01T23:27:27.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11202 0.13 MB/sec execute 307 sec latency 170.158 ms 2023-12-01T23:27:28.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11223 0.13 MB/sec execute 308 sec latency 231.789 ms 2023-12-01T23:27:29.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11244 0.13 MB/sec execute 309 sec latency 350.179 ms 2023-12-01T23:27:30.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11262 0.13 MB/sec execute 310 sec latency 202.696 ms 2023-12-01T23:27:31.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11270 0.13 MB/sec execute 311 sec latency 338.651 ms 2023-12-01T23:27:32.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11306 0.13 MB/sec execute 312 sec latency 447.989 ms 2023-12-01T23:27:33.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11316 0.13 MB/sec execute 313 sec latency 360.780 ms 2023-12-01T23:27:34.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11352 0.13 MB/sec execute 314 sec latency 290.143 ms 2023-12-01T23:27:35.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11393 0.13 MB/sec execute 315 sec latency 204.886 ms 2023-12-01T23:27:36.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11429 0.13 MB/sec execute 316 sec latency 291.504 ms 2023-12-01T23:27:37.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11471 0.13 MB/sec execute 317 sec latency 222.152 ms 2023-12-01T23:27:37.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:27:37.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:27:38.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11477 0.13 MB/sec execute 318 sec latency 309.192 ms 2023-12-01T23:27:39.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11513 0.13 MB/sec execute 319 sec latency 295.384 ms 2023-12-01T23:27:40.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11529 0.13 MB/sec execute 320 sec latency 331.651 ms 2023-12-01T23:27:41.544 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11561 0.13 MB/sec execute 321 sec latency 289.792 ms 2023-12-01T23:27:42.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11587 0.13 MB/sec execute 322 sec latency 311.921 ms 2023-12-01T23:27:43.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11594 0.13 MB/sec execute 323 sec latency 310.372 ms 2023-12-01T23:27:44.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11627 0.13 MB/sec execute 324 sec latency 284.217 ms 2023-12-01T23:27:45.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11656 0.13 MB/sec execute 325 sec latency 310.755 ms 2023-12-01T23:27:46.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11694 0.13 MB/sec execute 326 sec latency 305.147 ms 2023-12-01T23:27:47.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11705 0.13 MB/sec execute 327 sec latency 322.269 ms 2023-12-01T23:27:48.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11739 0.13 MB/sec execute 328 sec latency 331.005 ms 2023-12-01T23:27:49.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11757 0.13 MB/sec execute 329 sec latency 282.070 ms 2023-12-01T23:27:50.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11792 0.13 MB/sec execute 330 sec latency 285.418 ms 2023-12-01T23:27:51.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11819 0.13 MB/sec execute 331 sec latency 355.413 ms 2023-12-01T23:27:52.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11829 0.13 MB/sec execute 332 sec latency 295.298 ms 2023-12-01T23:27:53.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11860 0.13 MB/sec execute 333 sec latency 144.055 ms 2023-12-01T23:27:54.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11889 0.13 MB/sec execute 334 sec latency 285.838 ms 2023-12-01T23:27:55.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11919 0.13 MB/sec execute 335 sec latency 308.407 ms 2023-12-01T23:27:56.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 11937 0.13 MB/sec execute 336 sec latency 423.222 ms 2023-12-01T23:27:57.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12032 0.13 MB/sec execute 337 sec latency 285.121 ms 2023-12-01T23:27:58.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12041 0.13 MB/sec execute 338 sec latency 303.592 ms 2023-12-01T23:27:59.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12059 0.13 MB/sec execute 339 sec latency 324.429 ms 2023-12-01T23:28:00.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12098 0.13 MB/sec execute 340 sec latency 317.450 ms 2023-12-01T23:28:01.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12120 0.13 MB/sec execute 341 sec latency 392.306 ms 2023-12-01T23:28:02.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12142 0.13 MB/sec execute 342 sec latency 303.194 ms 2023-12-01T23:28:03.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12165 0.13 MB/sec execute 343 sec latency 282.608 ms 2023-12-01T23:28:04.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12186 0.13 MB/sec execute 344 sec latency 288.566 ms 2023-12-01T23:28:05.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12217 0.13 MB/sec execute 345 sec latency 298.410 ms 2023-12-01T23:28:06.545 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12244 0.13 MB/sec execute 346 sec latency 158.746 ms 2023-12-01T23:28:07.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12265 0.13 MB/sec execute 347 sec latency 285.282 ms 2023-12-01T23:28:07.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:28:07.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:28:08.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12296 0.13 MB/sec execute 348 sec latency 327.071 ms 2023-12-01T23:28:09.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12310 0.13 MB/sec execute 349 sec latency 319.205 ms 2023-12-01T23:28:10.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12346 0.13 MB/sec execute 350 sec latency 420.123 ms 2023-12-01T23:28:11.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12364 0.13 MB/sec execute 351 sec latency 370.830 ms 2023-12-01T23:28:12.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12427 0.13 MB/sec execute 352 sec latency 239.023 ms 2023-12-01T23:28:13.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12464 0.13 MB/sec execute 353 sec latency 319.640 ms 2023-12-01T23:28:14.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12484 0.13 MB/sec execute 354 sec latency 297.707 ms 2023-12-01T23:28:15.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12513 0.13 MB/sec execute 355 sec latency 287.244 ms 2023-12-01T23:28:16.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12527 0.13 MB/sec execute 356 sec latency 286.132 ms 2023-12-01T23:28:17.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12561 0.13 MB/sec execute 357 sec latency 316.463 ms 2023-12-01T23:28:18.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12578 0.13 MB/sec execute 358 sec latency 296.028 ms 2023-12-01T23:28:19.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12633 0.13 MB/sec execute 359 sec latency 286.193 ms 2023-12-01T23:28:20.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12658 0.13 MB/sec execute 360 sec latency 312.069 ms 2023-12-01T23:28:21.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12698 0.13 MB/sec execute 361 sec latency 280.141 ms 2023-12-01T23:28:22.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12712 0.13 MB/sec execute 362 sec latency 296.717 ms 2023-12-01T23:28:23.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12736 0.13 MB/sec execute 363 sec latency 311.083 ms 2023-12-01T23:28:24.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12751 0.13 MB/sec execute 364 sec latency 321.464 ms 2023-12-01T23:28:25.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12795 0.13 MB/sec execute 365 sec latency 373.697 ms 2023-12-01T23:28:26.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12828 0.12 MB/sec execute 366 sec latency 328.520 ms 2023-12-01T23:28:27.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12837 0.12 MB/sec execute 367 sec latency 301.372 ms 2023-12-01T23:28:28.546 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12880 0.12 MB/sec execute 368 sec latency 305.378 ms 2023-12-01T23:28:29.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12950 0.13 MB/sec execute 369 sec latency 280.831 ms 2023-12-01T23:28:30.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12961 0.13 MB/sec execute 370 sec latency 420.144 ms 2023-12-01T23:28:31.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12980 0.13 MB/sec execute 371 sec latency 432.393 ms 2023-12-01T23:28:32.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 12994 0.13 MB/sec execute 372 sec latency 301.258 ms 2023-12-01T23:28:33.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13016 0.13 MB/sec execute 373 sec latency 309.575 ms 2023-12-01T23:28:34.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13021 0.13 MB/sec execute 374 sec latency 553.194 ms 2023-12-01T23:28:35.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13042 0.13 MB/sec execute 375 sec latency 299.201 ms 2023-12-01T23:28:36.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13060 0.13 MB/sec execute 376 sec latency 302.051 ms 2023-12-01T23:28:37.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13085 0.12 MB/sec execute 377 sec latency 289.166 ms 2023-12-01T23:28:37.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:28:37.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:28:38.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13094 0.12 MB/sec execute 378 sec latency 300.944 ms 2023-12-01T23:28:39.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13124 0.13 MB/sec execute 379 sec latency 183.626 ms 2023-12-01T23:28:40.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13146 0.13 MB/sec execute 380 sec latency 310.328 ms 2023-12-01T23:28:41.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13158 0.13 MB/sec execute 381 sec latency 291.068 ms 2023-12-01T23:28:42.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13211 0.13 MB/sec execute 382 sec latency 373.242 ms 2023-12-01T23:28:43.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13232 0.13 MB/sec execute 383 sec latency 297.295 ms 2023-12-01T23:28:44.547 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13248 0.12 MB/sec execute 384 sec latency 281.362 ms 2023-12-01T23:28:45.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13267 0.12 MB/sec execute 385 sec latency 293.781 ms 2023-12-01T23:28:46.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13273 0.12 MB/sec execute 386 sec latency 312.022 ms 2023-12-01T23:28:47.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13397 0.13 MB/sec execute 387 sec latency 311.379 ms 2023-12-01T23:28:48.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13414 0.13 MB/sec execute 388 sec latency 351.763 ms 2023-12-01T23:28:49.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13447 0.13 MB/sec execute 389 sec latency 274.783 ms 2023-12-01T23:28:50.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13547 0.13 MB/sec execute 390 sec latency 288.043 ms 2023-12-01T23:28:51.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13581 0.13 MB/sec execute 391 sec latency 139.355 ms 2023-12-01T23:28:52.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13616 0.13 MB/sec execute 392 sec latency 326.083 ms 2023-12-01T23:28:53.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13627 0.13 MB/sec execute 393 sec latency 405.977 ms 2023-12-01T23:28:54.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13647 0.13 MB/sec execute 394 sec latency 287.571 ms 2023-12-01T23:28:55.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13675 0.13 MB/sec execute 395 sec latency 209.388 ms 2023-12-01T23:28:56.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13821 0.13 MB/sec execute 396 sec latency 366.631 ms 2023-12-01T23:28:57.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13851 0.13 MB/sec execute 397 sec latency 313.440 ms 2023-12-01T23:28:58.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13915 0.14 MB/sec execute 398 sec latency 287.582 ms 2023-12-01T23:28:59.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13930 0.14 MB/sec execute 399 sec latency 292.819 ms 2023-12-01T23:29:00.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13934 0.14 MB/sec execute 400 sec latency 307.021 ms 2023-12-01T23:29:01.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13939 0.14 MB/sec execute 401 sec latency 360.236 ms 2023-12-01T23:29:02.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13943 0.14 MB/sec execute 402 sec latency 419.835 ms 2023-12-01T23:29:03.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13947 0.13 MB/sec execute 403 sec latency 367.183 ms 2023-12-01T23:29:04.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13955 0.13 MB/sec execute 404 sec latency 400.335 ms 2023-12-01T23:29:05.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13959 0.13 MB/sec execute 405 sec latency 304.488 ms 2023-12-01T23:29:06.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13962 0.13 MB/sec execute 406 sec latency 308.199 ms 2023-12-01T23:29:07.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13967 0.13 MB/sec execute 407 sec latency 299.231 ms 2023-12-01T23:29:07.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:29:07.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:29:08.548 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13971 0.13 MB/sec execute 408 sec latency 295.990 ms 2023-12-01T23:29:09.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13975 0.13 MB/sec execute 409 sec latency 310.694 ms 2023-12-01T23:29:10.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13980 0.13 MB/sec execute 410 sec latency 283.112 ms 2023-12-01T23:29:11.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13983 0.13 MB/sec execute 411 sec latency 299.611 ms 2023-12-01T23:29:12.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 13987 0.13 MB/sec execute 412 sec latency 373.628 ms 2023-12-01T23:29:13.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14014 0.13 MB/sec execute 413 sec latency 125.794 ms 2023-12-01T23:29:14.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14040 0.13 MB/sec execute 414 sec latency 195.226 ms 2023-12-01T23:29:15.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14047 0.13 MB/sec execute 415 sec latency 311.315 ms 2023-12-01T23:29:16.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14172 0.14 MB/sec execute 416 sec latency 303.007 ms 2023-12-01T23:29:17.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14197 0.14 MB/sec execute 417 sec latency 282.765 ms 2023-12-01T23:29:18.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14218 0.14 MB/sec execute 418 sec latency 293.707 ms 2023-12-01T23:29:19.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14259 0.14 MB/sec execute 419 sec latency 363.890 ms 2023-12-01T23:29:20.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14283 0.14 MB/sec execute 420 sec latency 148.367 ms 2023-12-01T23:29:21.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14313 0.14 MB/sec execute 421 sec latency 301.166 ms 2023-12-01T23:29:22.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14326 0.14 MB/sec execute 422 sec latency 388.184 ms 2023-12-01T23:29:23.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14347 0.14 MB/sec execute 423 sec latency 324.408 ms 2023-12-01T23:29:24.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14399 0.14 MB/sec execute 424 sec latency 280.284 ms 2023-12-01T23:29:25.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14419 0.14 MB/sec execute 425 sec latency 181.609 ms 2023-12-01T23:29:26.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14430 0.14 MB/sec execute 426 sec latency 178.124 ms 2023-12-01T23:29:27.549 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14444 0.14 MB/sec execute 427 sec latency 195.805 ms 2023-12-01T23:29:28.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14460 0.14 MB/sec execute 428 sec latency 183.170 ms 2023-12-01T23:29:29.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14477 0.14 MB/sec execute 429 sec latency 167.085 ms 2023-12-01T23:29:30.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14494 0.14 MB/sec execute 430 sec latency 162.449 ms 2023-12-01T23:29:31.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14509 0.14 MB/sec execute 431 sec latency 160.387 ms 2023-12-01T23:29:32.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14519 0.14 MB/sec execute 432 sec latency 400.385 ms 2023-12-01T23:29:33.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14537 0.14 MB/sec execute 433 sec latency 308.107 ms 2023-12-01T23:29:34.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14559 0.14 MB/sec execute 434 sec latency 296.581 ms 2023-12-01T23:29:35.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14576 0.14 MB/sec execute 435 sec latency 185.409 ms 2023-12-01T23:29:36.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14587 0.14 MB/sec execute 436 sec latency 180.569 ms 2023-12-01T23:29:37.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14602 0.14 MB/sec execute 437 sec latency 162.057 ms 2023-12-01T23:29:38.046 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:29:38.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:29:38.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14622 0.13 MB/sec execute 438 sec latency 138.913 ms 2023-12-01T23:29:39.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14638 0.13 MB/sec execute 439 sec latency 185.260 ms 2023-12-01T23:29:40.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14655 0.13 MB/sec execute 440 sec latency 190.778 ms 2023-12-01T23:29:41.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14667 0.13 MB/sec execute 441 sec latency 288.457 ms 2023-12-01T23:29:42.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14676 0.13 MB/sec execute 442 sec latency 296.599 ms 2023-12-01T23:29:43.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14697 0.13 MB/sec execute 443 sec latency 306.075 ms 2023-12-01T23:29:44.550 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14710 0.13 MB/sec execute 444 sec latency 301.860 ms 2023-12-01T23:29:45.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14736 0.13 MB/sec execute 445 sec latency 296.658 ms 2023-12-01T23:29:46.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14756 0.13 MB/sec execute 446 sec latency 242.893 ms 2023-12-01T23:29:47.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14789 0.13 MB/sec execute 447 sec latency 97.717 ms 2023-12-01T23:29:48.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14804 0.13 MB/sec execute 448 sec latency 412.359 ms 2023-12-01T23:29:49.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14816 0.13 MB/sec execute 449 sec latency 295.444 ms 2023-12-01T23:29:50.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14852 0.13 MB/sec execute 450 sec latency 352.830 ms 2023-12-01T23:29:51.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14861 0.13 MB/sec execute 451 sec latency 349.120 ms 2023-12-01T23:29:52.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14890 0.13 MB/sec execute 452 sec latency 461.518 ms 2023-12-01T23:29:53.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14923 0.13 MB/sec execute 453 sec latency 289.452 ms 2023-12-01T23:29:54.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 14953 0.13 MB/sec execute 454 sec latency 303.899 ms 2023-12-01T23:29:55.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15001 0.13 MB/sec execute 455 sec latency 290.190 ms 2023-12-01T23:29:56.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15022 0.13 MB/sec execute 456 sec latency 333.727 ms 2023-12-01T23:29:57.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15059 0.13 MB/sec execute 457 sec latency 301.202 ms 2023-12-01T23:29:58.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15069 0.13 MB/sec execute 458 sec latency 320.041 ms 2023-12-01T23:29:59.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15103 0.13 MB/sec execute 459 sec latency 276.939 ms 2023-12-01T23:30:00.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15133 0.13 MB/sec execute 460 sec latency 220.471 ms 2023-12-01T23:30:01.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15137 0.13 MB/sec execute 461 sec latency 308.903 ms 2023-12-01T23:30:02.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15154 0.13 MB/sec execute 462 sec latency 428.980 ms 2023-12-01T23:30:03.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15198 0.13 MB/sec execute 463 sec latency 238.351 ms 2023-12-01T23:30:04.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15233 0.13 MB/sec execute 464 sec latency 300.783 ms 2023-12-01T23:30:05.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15251 0.13 MB/sec execute 465 sec latency 350.866 ms 2023-12-01T23:30:06.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15264 0.13 MB/sec execute 466 sec latency 321.171 ms 2023-12-01T23:30:07.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15298 0.13 MB/sec execute 467 sec latency 295.421 ms 2023-12-01T23:30:08.182 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:30:08.184 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:30:08.551 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15320 0.13 MB/sec execute 468 sec latency 282.343 ms 2023-12-01T23:30:09.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15360 0.13 MB/sec execute 469 sec latency 175.412 ms 2023-12-01T23:30:10.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15371 0.13 MB/sec execute 470 sec latency 295.043 ms 2023-12-01T23:30:11.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15383 0.13 MB/sec execute 471 sec latency 285.428 ms 2023-12-01T23:30:12.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15416 0.13 MB/sec execute 472 sec latency 288.910 ms 2023-12-01T23:30:13.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15451 0.13 MB/sec execute 473 sec latency 186.307 ms 2023-12-01T23:30:14.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15480 0.13 MB/sec execute 474 sec latency 347.172 ms 2023-12-01T23:30:15.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15486 0.13 MB/sec execute 475 sec latency 330.796 ms 2023-12-01T23:30:16.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15580 0.13 MB/sec execute 476 sec latency 303.236 ms 2023-12-01T23:30:17.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15597 0.13 MB/sec execute 477 sec latency 301.482 ms 2023-12-01T23:30:18.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15620 0.13 MB/sec execute 478 sec latency 300.724 ms 2023-12-01T23:30:19.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15650 0.13 MB/sec execute 479 sec latency 164.021 ms 2023-12-01T23:30:20.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15676 0.13 MB/sec execute 480 sec latency 347.892 ms 2023-12-01T23:30:21.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15692 0.13 MB/sec execute 481 sec latency 298.262 ms 2023-12-01T23:30:22.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15725 0.13 MB/sec execute 482 sec latency 466.615 ms 2023-12-01T23:30:23.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15753 0.13 MB/sec execute 483 sec latency 288.500 ms 2023-12-01T23:30:24.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15775 0.13 MB/sec execute 484 sec latency 305.035 ms 2023-12-01T23:30:25.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15804 0.13 MB/sec execute 485 sec latency 285.421 ms 2023-12-01T23:30:26.552 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15817 0.13 MB/sec execute 486 sec latency 315.425 ms 2023-12-01T23:30:27.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15844 0.13 MB/sec execute 487 sec latency 311.450 ms 2023-12-01T23:30:28.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15885 0.13 MB/sec execute 488 sec latency 323.902 ms 2023-12-01T23:30:29.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15902 0.13 MB/sec execute 489 sec latency 309.224 ms 2023-12-01T23:30:30.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 15970 0.13 MB/sec execute 490 sec latency 284.947 ms 2023-12-01T23:30:31.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16002 0.13 MB/sec execute 491 sec latency 311.145 ms 2023-12-01T23:30:32.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16023 0.13 MB/sec execute 492 sec latency 294.855 ms 2023-12-01T23:30:33.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16042 0.13 MB/sec execute 493 sec latency 290.277 ms 2023-12-01T23:30:34.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16063 0.13 MB/sec execute 494 sec latency 304.151 ms 2023-12-01T23:30:35.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16089 0.13 MB/sec execute 495 sec latency 333.871 ms 2023-12-01T23:30:36.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16113 0.13 MB/sec execute 496 sec latency 318.612 ms 2023-12-01T23:30:37.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16162 0.13 MB/sec execute 497 sec latency 294.723 ms 2023-12-01T23:30:38.296 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:30:38.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:30:38.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16196 0.13 MB/sec execute 498 sec latency 290.834 ms 2023-12-01T23:30:39.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16233 0.13 MB/sec execute 499 sec latency 339.963 ms 2023-12-01T23:30:40.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16251 0.13 MB/sec execute 500 sec latency 303.095 ms 2023-12-01T23:30:41.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16274 0.13 MB/sec execute 501 sec latency 311.822 ms 2023-12-01T23:30:42.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16291 0.13 MB/sec execute 502 sec latency 336.585 ms 2023-12-01T23:30:43.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16336 0.13 MB/sec execute 503 sec latency 333.961 ms 2023-12-01T23:30:44.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16366 0.13 MB/sec execute 504 sec latency 345.411 ms 2023-12-01T23:30:45.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16379 0.13 MB/sec execute 505 sec latency 342.989 ms 2023-12-01T23:30:46.553 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16401 0.13 MB/sec execute 506 sec latency 320.158 ms 2023-12-01T23:30:47.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16482 0.13 MB/sec execute 507 sec latency 286.509 ms 2023-12-01T23:30:48.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16502 0.13 MB/sec execute 508 sec latency 287.493 ms 2023-12-01T23:30:49.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16520 0.13 MB/sec execute 509 sec latency 451.510 ms 2023-12-01T23:30:50.229 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:13:09.134 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.231 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:13:09.138 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.281 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:13:09.133 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.283 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:13:09.135 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.285 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:13:09.137 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.287 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:13:09.139 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.304 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:13:09.210 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.369 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:13:09.221 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.371 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:13:09.223 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:30:50.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16531 0.13 MB/sec execute 510 sec latency 300.154 ms 2023-12-01T23:30:51.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16557 0.13 MB/sec execute 511 sec latency 328.830 ms 2023-12-01T23:30:52.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16562 0.13 MB/sec execute 512 sec latency 368.894 ms 2023-12-01T23:30:53.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16572 0.13 MB/sec execute 513 sec latency 325.433 ms 2023-12-01T23:30:54.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16591 0.13 MB/sec execute 514 sec latency 325.237 ms 2023-12-01T23:30:55.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16612 0.13 MB/sec execute 515 sec latency 320.443 ms 2023-12-01T23:30:56.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16628 0.13 MB/sec execute 516 sec latency 325.653 ms 2023-12-01T23:30:57.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16649 0.13 MB/sec execute 517 sec latency 357.991 ms 2023-12-01T23:30:58.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16685 0.13 MB/sec execute 518 sec latency 306.037 ms 2023-12-01T23:30:59.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16695 0.13 MB/sec execute 519 sec latency 322.172 ms 2023-12-01T23:31:00.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16746 0.13 MB/sec execute 520 sec latency 291.043 ms 2023-12-01T23:31:01.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16766 0.13 MB/sec execute 521 sec latency 292.565 ms 2023-12-01T23:31:02.554 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16778 0.13 MB/sec execute 522 sec latency 299.915 ms 2023-12-01T23:31:03.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16798 0.13 MB/sec execute 523 sec latency 318.699 ms 2023-12-01T23:31:04.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16812 0.13 MB/sec execute 524 sec latency 315.856 ms 2023-12-01T23:31:05.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16912 0.13 MB/sec execute 525 sec latency 325.377 ms 2023-12-01T23:31:06.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16952 0.13 MB/sec execute 526 sec latency 314.393 ms 2023-12-01T23:31:07.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 16972 0.13 MB/sec execute 527 sec latency 279.281 ms 2023-12-01T23:31:08.415 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:31:08.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:31:08.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17068 0.13 MB/sec execute 528 sec latency 309.952 ms 2023-12-01T23:31:09.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17109 0.14 MB/sec execute 529 sec latency 152.240 ms 2023-12-01T23:31:10.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17130 0.14 MB/sec execute 530 sec latency 204.349 ms 2023-12-01T23:31:11.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17166 0.13 MB/sec execute 531 sec latency 306.320 ms 2023-12-01T23:31:12.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17185 0.13 MB/sec execute 532 sec latency 446.054 ms 2023-12-01T23:31:13.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17207 0.13 MB/sec execute 533 sec latency 294.937 ms 2023-12-01T23:31:14.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17359 0.14 MB/sec execute 534 sec latency 310.780 ms 2023-12-01T23:31:15.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17380 0.14 MB/sec execute 535 sec latency 285.041 ms 2023-12-01T23:31:16.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17424 0.14 MB/sec execute 536 sec latency 292.613 ms 2023-12-01T23:31:17.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17467 0.14 MB/sec execute 537 sec latency 316.867 ms 2023-12-01T23:31:18.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17475 0.14 MB/sec execute 538 sec latency 326.441 ms 2023-12-01T23:31:19.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17479 0.14 MB/sec execute 539 sec latency 305.690 ms 2023-12-01T23:31:20.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17484 0.14 MB/sec execute 540 sec latency 373.368 ms 2023-12-01T23:31:21.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17487 0.14 MB/sec execute 541 sec latency 361.027 ms 2023-12-01T23:31:22.555 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17495 0.14 MB/sec execute 542 sec latency 469.628 ms 2023-12-01T23:31:23.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17499 0.14 MB/sec execute 543 sec latency 368.196 ms 2023-12-01T23:31:24.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17503 0.14 MB/sec execute 544 sec latency 330.023 ms 2023-12-01T23:31:25.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17506 0.13 MB/sec execute 545 sec latency 336.561 ms 2023-12-01T23:31:26.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17510 0.13 MB/sec execute 546 sec latency 340.999 ms 2023-12-01T23:31:27.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17514 0.13 MB/sec execute 547 sec latency 306.836 ms 2023-12-01T23:31:28.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17518 0.13 MB/sec execute 548 sec latency 292.348 ms 2023-12-01T23:31:29.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17523 0.13 MB/sec execute 549 sec latency 294.980 ms 2023-12-01T23:31:30.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17527 0.13 MB/sec execute 550 sec latency 300.277 ms 2023-12-01T23:31:31.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17533 0.13 MB/sec execute 551 sec latency 294.949 ms 2023-12-01T23:31:32.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17558 0.13 MB/sec execute 552 sec latency 142.759 ms 2023-12-01T23:31:33.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17585 0.13 MB/sec execute 553 sec latency 277.455 ms 2023-12-01T23:31:34.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17684 0.14 MB/sec execute 554 sec latency 291.227 ms 2023-12-01T23:31:35.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17720 0.14 MB/sec execute 555 sec latency 129.762 ms 2023-12-01T23:31:36.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17746 0.14 MB/sec execute 556 sec latency 283.811 ms 2023-12-01T23:31:37.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17761 0.14 MB/sec execute 557 sec latency 354.902 ms 2023-12-01T23:31:38.544 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:31:38.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:31:38.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17802 0.14 MB/sec execute 558 sec latency 337.443 ms 2023-12-01T23:31:39.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17826 0.14 MB/sec execute 559 sec latency 220.882 ms 2023-12-01T23:31:40.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17856 0.14 MB/sec execute 560 sec latency 325.169 ms 2023-12-01T23:31:41.556 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17869 0.14 MB/sec execute 561 sec latency 308.414 ms 2023-12-01T23:31:42.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17891 0.14 MB/sec execute 562 sec latency 341.938 ms 2023-12-01T23:31:43.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17943 0.14 MB/sec execute 563 sec latency 279.735 ms 2023-12-01T23:31:44.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17963 0.14 MB/sec execute 564 sec latency 162.976 ms 2023-12-01T23:31:45.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17975 0.14 MB/sec execute 565 sec latency 169.458 ms 2023-12-01T23:31:46.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 17988 0.14 MB/sec execute 566 sec latency 219.874 ms 2023-12-01T23:31:47.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18004 0.14 MB/sec execute 567 sec latency 164.439 ms 2023-12-01T23:31:48.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18022 0.14 MB/sec execute 568 sec latency 149.032 ms 2023-12-01T23:31:49.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18038 0.14 MB/sec execute 569 sec latency 177.561 ms 2023-12-01T23:31:50.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18053 0.14 MB/sec execute 570 sec latency 189.521 ms 2023-12-01T23:31:51.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18067 0.14 MB/sec execute 571 sec latency 320.433 ms 2023-12-01T23:31:52.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18081 0.14 MB/sec execute 572 sec latency 323.508 ms 2023-12-01T23:31:53.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18104 0.14 MB/sec execute 573 sec latency 299.244 ms 2023-12-01T23:31:54.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18120 0.14 MB/sec execute 574 sec latency 191.330 ms 2023-12-01T23:31:55.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18131 0.14 MB/sec execute 575 sec latency 197.438 ms 2023-12-01T23:31:56.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18149 0.14 MB/sec execute 576 sec latency 164.593 ms 2023-12-01T23:31:57.557 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18166 0.14 MB/sec execute 577 sec latency 147.424 ms 2023-12-01T23:31:58.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18182 0.14 MB/sec execute 578 sec latency 152.592 ms 2023-12-01T23:31:59.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18201 0.13 MB/sec execute 579 sec latency 151.678 ms 2023-12-01T23:32:00.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18214 0.13 MB/sec execute 580 sec latency 325.957 ms 2023-12-01T23:32:01.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18223 0.13 MB/sec execute 581 sec latency 313.961 ms 2023-12-01T23:32:02.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18241 0.13 MB/sec execute 582 sec latency 312.980 ms 2023-12-01T23:32:03.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18256 0.13 MB/sec execute 583 sec latency 291.014 ms 2023-12-01T23:32:04.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18285 0.13 MB/sec execute 584 sec latency 278.895 ms 2023-12-01T23:32:05.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18304 0.13 MB/sec execute 585 sec latency 264.806 ms 2023-12-01T23:32:06.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18337 0.13 MB/sec execute 586 sec latency 81.041 ms 2023-12-01T23:32:07.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18350 0.13 MB/sec execute 587 sec latency 354.684 ms 2023-12-01T23:32:08.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18363 0.13 MB/sec execute 588 sec latency 334.105 ms 2023-12-01T23:32:08.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:32:08.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:32:09.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18400 0.13 MB/sec execute 589 sec latency 388.472 ms 2023-12-01T23:32:10.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18409 0.13 MB/sec execute 590 sec latency 297.535 ms 2023-12-01T23:32:11.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18438 0.13 MB/sec execute 591 sec latency 315.445 ms 2023-12-01T23:32:12.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18466 0.13 MB/sec execute 592 sec latency 390.658 ms 2023-12-01T23:32:13.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18501 0.13 MB/sec execute 593 sec latency 293.804 ms 2023-12-01T23:32:14.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18535 0.13 MB/sec execute 594 sec latency 279.495 ms 2023-12-01T23:32:15.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18568 0.13 MB/sec execute 595 sec latency 308.800 ms 2023-12-01T23:32:16.558 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18607 0.13 MB/sec execute 596 sec latency 304.034 ms 2023-12-01T23:32:17.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18616 0.13 MB/sec execute 597 sec latency 286.871 ms 2023-12-01T23:32:18.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18646 0.13 MB/sec execute 598 sec latency 305.833 ms 2023-12-01T23:32:19.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 18681 0.13 MB/sec execute 599 sec latency 228.728 ms 2023-12-01T23:32:20.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 600 sec 2023-12-01T23:32:21.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 601 sec 2023-12-01T23:32:22.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 602 sec 2023-12-01T23:32:23.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 603 sec 2023-12-01T23:32:24.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 604 sec 2023-12-01T23:32:25.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 605 sec 2023-12-01T23:32:26.559 INFO:tasks.workunit.client.0.smithi096.stdout: 1 cleanup 606 sec 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: 0 cleanup 607 sec 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: Operation Count AvgLat MaxLat 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: ---------------------------------------- 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: NTCreateX 2687 62.445 314.068 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: Close 1938 1.114 9.396 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: Rename 111 176.969 420.116 2023-12-01T23:32:27.206 INFO:tasks.workunit.client.0.smithi096.stdout: Unlink 573 67.784 182.944 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: Qpathinfo 2396 32.953 295.605 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: Qfileinfo 401 0.919 6.400 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: Qfsinfo 442 6.416 182.762 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: Sfileinfo 215 11.200 16.351 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: Find 910 300.028 758.959 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: WriteX 1288 3.831 109.383 2023-12-01T23:32:27.207 INFO:tasks.workunit.client.0.smithi096.stdout: ReadX 3981 0.022 2.893 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stdout: LockX 8 16.839 23.781 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stdout: UnlockX 8 15.688 18.717 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stdout: Flush 194 45.489 127.536 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stdout:Throughput 0.131873 MB/sec 1 clients 1 procs max_latency=758.965 ms 2023-12-01T23:32:27.208 INFO:tasks.workunit.client.0.smithi096.stderr:+ dbench 10 2023-12-01T23:32:27.209 INFO:tasks.workunit.client.0.smithi096.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-12-01T23:32:27.209 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:32:27.209 INFO:tasks.workunit.client.0.smithi096.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-12-01T23:32:27.209 INFO:tasks.workunit.client.0.smithi096.stdout:8 of 10 processes prepared for launch 0 sec 2023-12-01T23:32:27.307 INFO:tasks.workunit.client.0.smithi096.stdout:10 of 10 processes prepared for launch 0 sec 2023-12-01T23:32:27.307 INFO:tasks.workunit.client.0.smithi096.stdout:releasing clients 2023-12-01T23:32:28.307 INFO:tasks.workunit.client.0.smithi096.stdout: 0 3 0.00 MB/sec warmup 1 sec latency 999.839 ms 2023-12-01T23:32:29.307 INFO:tasks.workunit.client.0.smithi096.stdout: 1 7 0.52 MB/sec warmup 2 sec latency 1999.906 ms 2023-12-01T23:32:30.307 INFO:tasks.workunit.client.0.smithi096.stdout: 3 17 1.75 MB/sec warmup 3 sec latency 575.823 ms 2023-12-01T23:32:31.307 INFO:tasks.workunit.client.0.smithi096.stdout: 4 26 2.18 MB/sec warmup 4 sec latency 577.090 ms 2023-12-01T23:32:32.307 INFO:tasks.workunit.client.0.smithi096.stdout: 8 41 3.16 MB/sec warmup 5 sec latency 837.241 ms 2023-12-01T23:32:33.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 59 4.25 MB/sec warmup 6 sec latency 920.902 ms 2023-12-01T23:32:34.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 75 4.79 MB/sec warmup 7 sec latency 858.428 ms 2023-12-01T23:32:35.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 91 5.14 MB/sec warmup 8 sec latency 826.070 ms 2023-12-01T23:32:36.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 106 5.37 MB/sec warmup 9 sec latency 904.130 ms 2023-12-01T23:32:37.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 117 5.37 MB/sec warmup 10 sec latency 963.328 ms 2023-12-01T23:32:38.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 124 5.10 MB/sec warmup 11 sec latency 980.930 ms 2023-12-01T23:32:38.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:32:38.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:32:39.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 132 4.87 MB/sec warmup 12 sec latency 1032.732 ms 2023-12-01T23:32:40.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 139 4.67 MB/sec warmup 13 sec latency 1128.427 ms 2023-12-01T23:32:41.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 146 4.49 MB/sec warmup 14 sec latency 1177.678 ms 2023-12-01T23:32:42.307 INFO:tasks.workunit.client.0.smithi096.stdout: 10 149 4.22 MB/sec warmup 15 sec latency 1295.542 ms 2023-12-01T23:32:43.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 155 4.09 MB/sec warmup 16 sec latency 1792.115 ms 2023-12-01T23:32:44.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 161 3.96 MB/sec warmup 17 sec latency 1723.049 ms 2023-12-01T23:32:45.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 168 3.84 MB/sec warmup 18 sec latency 1519.776 ms 2023-12-01T23:32:46.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 174 3.73 MB/sec warmup 19 sec latency 1142.082 ms 2023-12-01T23:32:47.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 178 3.62 MB/sec warmup 20 sec latency 1558.284 ms 2023-12-01T23:32:48.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 183 3.52 MB/sec warmup 21 sec latency 1566.481 ms 2023-12-01T23:32:49.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 188 3.44 MB/sec warmup 22 sec latency 1631.081 ms 2023-12-01T23:32:50.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 194 3.36 MB/sec warmup 23 sec latency 1585.168 ms 2023-12-01T23:32:51.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 202 3.33 MB/sec warmup 24 sec latency 1629.545 ms 2023-12-01T23:32:52.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 208 3.27 MB/sec warmup 25 sec latency 1373.819 ms 2023-12-01T23:32:53.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 212 3.19 MB/sec warmup 26 sec latency 1390.809 ms 2023-12-01T23:32:54.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 218 3.14 MB/sec warmup 27 sec latency 1499.338 ms 2023-12-01T23:32:55.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 225 3.11 MB/sec warmup 28 sec latency 1274.833 ms 2023-12-01T23:32:56.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 230 3.05 MB/sec warmup 29 sec latency 1383.928 ms 2023-12-01T23:32:57.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 236 3.02 MB/sec warmup 30 sec latency 1573.345 ms 2023-12-01T23:32:58.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 241 2.96 MB/sec warmup 31 sec latency 1845.612 ms 2023-12-01T23:32:59.308 INFO:tasks.workunit.client.0.smithi096.stdout: 10 247 2.94 MB/sec warmup 32 sec latency 1224.879 ms 2023-12-01T23:33:00.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 255 2.93 MB/sec warmup 33 sec latency 1360.862 ms 2023-12-01T23:33:01.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 257 2.87 MB/sec warmup 34 sec latency 1526.736 ms 2023-12-01T23:33:02.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 263 2.84 MB/sec warmup 35 sec latency 2160.915 ms 2023-12-01T23:33:03.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 270 2.82 MB/sec warmup 36 sec latency 1714.744 ms 2023-12-01T23:33:04.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 274 2.77 MB/sec warmup 37 sec latency 1529.876 ms 2023-12-01T23:33:05.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 280 2.76 MB/sec warmup 38 sec latency 1469.327 ms 2023-12-01T23:33:06.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 285 2.72 MB/sec warmup 39 sec latency 1951.374 ms 2023-12-01T23:33:07.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 292 2.71 MB/sec warmup 40 sec latency 1496.038 ms 2023-12-01T23:33:08.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 296 2.67 MB/sec warmup 41 sec latency 1702.435 ms 2023-12-01T23:33:08.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:33:08.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:33:09.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 301 2.65 MB/sec warmup 42 sec latency 1959.678 ms 2023-12-01T23:33:10.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 307 2.62 MB/sec warmup 43 sec latency 1777.884 ms 2023-12-01T23:33:11.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 313 2.60 MB/sec warmup 44 sec latency 1230.834 ms 2023-12-01T23:33:12.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 319 2.59 MB/sec warmup 45 sec latency 1149.432 ms 2023-12-01T23:33:13.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 324 2.57 MB/sec warmup 46 sec latency 1450.078 ms 2023-12-01T23:33:14.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 331 2.55 MB/sec warmup 47 sec latency 1433.965 ms 2023-12-01T23:33:15.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 338 2.54 MB/sec warmup 48 sec latency 1493.028 ms 2023-12-01T23:33:16.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 344 2.53 MB/sec warmup 49 sec latency 1047.329 ms 2023-12-01T23:33:17.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 348 2.51 MB/sec warmup 50 sec latency 1186.305 ms 2023-12-01T23:33:18.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 352 2.48 MB/sec warmup 51 sec latency 1843.580 ms 2023-12-01T23:33:19.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 356 2.46 MB/sec warmup 52 sec latency 2136.822 ms 2023-12-01T23:33:20.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 363 2.45 MB/sec warmup 53 sec latency 1412.811 ms 2023-12-01T23:33:21.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 368 2.44 MB/sec warmup 54 sec latency 1277.759 ms 2023-12-01T23:33:22.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 374 2.43 MB/sec warmup 55 sec latency 1445.863 ms 2023-12-01T23:33:23.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 381 2.43 MB/sec warmup 56 sec latency 1581.571 ms 2023-12-01T23:33:24.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 387 2.42 MB/sec warmup 57 sec latency 1462.957 ms 2023-12-01T23:33:25.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 392 2.40 MB/sec warmup 58 sec latency 1389.471 ms 2023-12-01T23:33:26.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 398 2.40 MB/sec warmup 59 sec latency 1541.428 ms 2023-12-01T23:33:27.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 404 2.39 MB/sec warmup 60 sec latency 1660.712 ms 2023-12-01T23:33:28.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 407 2.36 MB/sec warmup 61 sec latency 1972.567 ms 2023-12-01T23:33:29.309 INFO:tasks.workunit.client.0.smithi096.stdout: 10 412 2.35 MB/sec warmup 62 sec latency 2197.896 ms 2023-12-01T23:33:30.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 415 2.33 MB/sec warmup 63 sec latency 2130.002 ms 2023-12-01T23:33:31.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 422 2.33 MB/sec warmup 64 sec latency 1515.346 ms 2023-12-01T23:33:32.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 427 2.32 MB/sec warmup 65 sec latency 1618.920 ms 2023-12-01T23:33:33.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 433 2.32 MB/sec warmup 66 sec latency 1727.237 ms 2023-12-01T23:33:34.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 437 2.30 MB/sec warmup 67 sec latency 1679.073 ms 2023-12-01T23:33:35.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 444 2.30 MB/sec warmup 68 sec latency 1711.078 ms 2023-12-01T23:33:36.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 449 2.29 MB/sec warmup 69 sec latency 1701.861 ms 2023-12-01T23:33:37.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 455 2.28 MB/sec warmup 70 sec latency 1744.345 ms 2023-12-01T23:33:38.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 458 2.26 MB/sec warmup 71 sec latency 1947.899 ms 2023-12-01T23:33:38.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:33:38.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:33:39.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 464 2.26 MB/sec warmup 72 sec latency 2252.398 ms 2023-12-01T23:33:40.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 469 2.25 MB/sec warmup 73 sec latency 1957.010 ms 2023-12-01T23:33:41.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 474 2.25 MB/sec warmup 74 sec latency 1783.529 ms 2023-12-01T23:33:42.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 486 2.27 MB/sec warmup 75 sec latency 1581.042 ms 2023-12-01T23:33:43.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 488 2.25 MB/sec warmup 76 sec latency 1793.217 ms 2023-12-01T23:33:44.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 495 2.25 MB/sec warmup 77 sec latency 2232.141 ms 2023-12-01T23:33:45.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 497 2.23 MB/sec warmup 78 sec latency 3232.219 ms 2023-12-01T23:33:46.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 504 2.23 MB/sec warmup 79 sec latency 4232.259 ms 2023-12-01T23:33:47.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 507 2.21 MB/sec warmup 80 sec latency 4587.038 ms 2023-12-01T23:33:48.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 510 2.19 MB/sec warmup 81 sec latency 1871.011 ms 2023-12-01T23:33:49.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 515 2.18 MB/sec warmup 82 sec latency 1873.980 ms 2023-12-01T23:33:50.310 INFO:tasks.workunit.client.0.smithi096.stdout: 10 518 2.17 MB/sec warmup 83 sec latency 1994.807 ms 2023-12-01T23:33:51.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 525 2.17 MB/sec warmup 84 sec latency 2994.834 ms 2023-12-01T23:33:52.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 537 2.19 MB/sec warmup 85 sec latency 3329.684 ms 2023-12-01T23:33:53.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 549 2.22 MB/sec warmup 86 sec latency 1590.372 ms 2023-12-01T23:33:54.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 574 2.28 MB/sec warmup 87 sec latency 2360.166 ms 2023-12-01T23:33:55.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 593 2.33 MB/sec warmup 88 sec latency 892.795 ms 2023-12-01T23:33:56.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 606 2.35 MB/sec warmup 89 sec latency 1658.895 ms 2023-12-01T23:33:57.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 610 2.33 MB/sec warmup 90 sec latency 2256.277 ms 2023-12-01T23:33:58.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 610 2.31 MB/sec warmup 91 sec latency 3256.325 ms 2023-12-01T23:33:59.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 612 2.28 MB/sec warmup 92 sec latency 3426.936 ms 2023-12-01T23:34:00.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 613 2.26 MB/sec warmup 93 sec latency 3273.521 ms 2023-12-01T23:34:01.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 616 2.23 MB/sec warmup 94 sec latency 3255.484 ms 2023-12-01T23:34:02.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 620 2.21 MB/sec warmup 95 sec latency 2404.424 ms 2023-12-01T23:34:03.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 629 2.19 MB/sec warmup 96 sec latency 2899.745 ms 2023-12-01T23:34:04.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 638 2.17 MB/sec warmup 97 sec latency 2729.267 ms 2023-12-01T23:34:05.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 644 2.15 MB/sec warmup 98 sec latency 2515.333 ms 2023-12-01T23:34:06.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 647 2.13 MB/sec warmup 99 sec latency 2572.338 ms 2023-12-01T23:34:07.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 648 2.11 MB/sec warmup 100 sec latency 2443.874 ms 2023-12-01T23:34:08.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 649 2.09 MB/sec warmup 101 sec latency 2551.209 ms 2023-12-01T23:34:08.945 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:34:08.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:34:09.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 651 2.07 MB/sec warmup 102 sec latency 2551.428 ms 2023-12-01T23:34:10.311 INFO:tasks.workunit.client.0.smithi096.stdout: 10 654 2.05 MB/sec warmup 103 sec latency 2820.759 ms 2023-12-01T23:34:11.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 655 2.03 MB/sec warmup 104 sec latency 2549.849 ms 2023-12-01T23:34:12.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 657 2.01 MB/sec warmup 105 sec latency 2980.630 ms 2023-12-01T23:34:13.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 663 1.99 MB/sec warmup 106 sec latency 2994.303 ms 2023-12-01T23:34:14.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 669 1.98 MB/sec warmup 107 sec latency 3174.434 ms 2023-12-01T23:34:15.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 675 1.96 MB/sec warmup 108 sec latency 2989.130 ms 2023-12-01T23:34:16.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 682 1.94 MB/sec warmup 109 sec latency 2456.246 ms 2023-12-01T23:34:17.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 686 1.93 MB/sec warmup 110 sec latency 2225.188 ms 2023-12-01T23:34:18.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 687 1.91 MB/sec warmup 111 sec latency 2771.101 ms 2023-12-01T23:34:18.439 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:16:37.345 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.440 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:16:37.346 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.493 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:16:37.345 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.497 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:16:37.350 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.500 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:16:37.352 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.502 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:16:37.354 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.522 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:16:37.428 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.580 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:16:37.431 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:18.602 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:16:37.454 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:34:19.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 690 1.89 MB/sec warmup 112 sec latency 2682.679 ms 2023-12-01T23:34:20.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 693 1.88 MB/sec warmup 113 sec latency 2771.056 ms 2023-12-01T23:34:21.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 699 1.86 MB/sec warmup 114 sec latency 2497.285 ms 2023-12-01T23:34:22.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 708 1.85 MB/sec warmup 115 sec latency 2416.905 ms 2023-12-01T23:34:23.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 714 1.83 MB/sec warmup 116 sec latency 3136.489 ms 2023-12-01T23:34:24.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 720 1.82 MB/sec warmup 117 sec latency 1423.068 ms 2023-12-01T23:34:25.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 722 1.80 MB/sec warmup 118 sec latency 1636.930 ms 2023-12-01T23:34:26.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 727 1.79 MB/sec warmup 119 sec latency 2637.013 ms 2023-12-01T23:34:28.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 738 0.14 MB/sec execute 1 sec latency 4207.128 ms 2023-12-01T23:34:29.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 747 0.15 MB/sec execute 2 sec latency 2783.386 ms 2023-12-01T23:34:30.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 749 0.11 MB/sec execute 3 sec latency 3529.366 ms 2023-12-01T23:34:31.312 INFO:tasks.workunit.client.0.smithi096.stdout: 10 753 0.09 MB/sec execute 4 sec latency 2860.363 ms 2023-12-01T23:34:32.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 755 0.07 MB/sec execute 5 sec latency 2858.250 ms 2023-12-01T23:34:33.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 758 0.07 MB/sec execute 6 sec latency 2829.955 ms 2023-12-01T23:34:34.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 760 0.07 MB/sec execute 7 sec latency 2488.025 ms 2023-12-01T23:34:35.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 768 0.08 MB/sec execute 8 sec latency 2708.678 ms 2023-12-01T23:34:36.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 781 0.11 MB/sec execute 9 sec latency 2100.244 ms 2023-12-01T23:34:37.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 786 0.10 MB/sec execute 10 sec latency 1722.525 ms 2023-12-01T23:34:38.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 788 0.09 MB/sec execute 11 sec latency 2722.635 ms 2023-12-01T23:34:39.254 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:34:39.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:34:39.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 789 0.08 MB/sec execute 12 sec latency 3036.202 ms 2023-12-01T23:34:40.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 794 0.09 MB/sec execute 13 sec latency 3804.168 ms 2023-12-01T23:34:41.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 802 0.12 MB/sec execute 14 sec latency 3804.830 ms 2023-12-01T23:34:42.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 808 0.12 MB/sec execute 15 sec latency 2093.558 ms 2023-12-01T23:34:43.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 815 0.12 MB/sec execute 16 sec latency 2880.218 ms 2023-12-01T23:34:44.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 817 0.11 MB/sec execute 17 sec latency 2664.632 ms 2023-12-01T23:34:45.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 818 0.11 MB/sec execute 18 sec latency 2960.865 ms 2023-12-01T23:34:46.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 818 0.10 MB/sec execute 19 sec latency 2376.348 ms 2023-12-01T23:34:47.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 823 0.10 MB/sec execute 20 sec latency 1937.804 ms 2023-12-01T23:34:48.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 824 0.09 MB/sec execute 21 sec latency 2428.873 ms 2023-12-01T23:34:49.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 829 0.09 MB/sec execute 22 sec latency 2395.487 ms 2023-12-01T23:34:50.313 INFO:tasks.workunit.client.0.smithi096.stdout: 10 831 0.09 MB/sec execute 23 sec latency 2509.589 ms 2023-12-01T23:34:51.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 833 0.09 MB/sec execute 24 sec latency 2096.092 ms 2023-12-01T23:34:52.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 838 0.09 MB/sec execute 25 sec latency 2107.099 ms 2023-12-01T23:34:53.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 850 0.10 MB/sec execute 26 sec latency 2350.177 ms 2023-12-01T23:34:54.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 857 0.10 MB/sec execute 27 sec latency 2494.697 ms 2023-12-01T23:34:55.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 857 0.10 MB/sec execute 28 sec latency 2470.899 ms 2023-12-01T23:34:56.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 861 0.10 MB/sec execute 29 sec latency 2508.924 ms 2023-12-01T23:34:57.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 863 0.10 MB/sec execute 30 sec latency 2433.270 ms 2023-12-01T23:34:58.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 865 0.10 MB/sec execute 31 sec latency 2655.004 ms 2023-12-01T23:34:59.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 870 0.10 MB/sec execute 32 sec latency 2758.143 ms 2023-12-01T23:35:00.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 873 0.09 MB/sec execute 33 sec latency 2651.135 ms 2023-12-01T23:35:01.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 875 0.09 MB/sec execute 34 sec latency 2857.529 ms 2023-12-01T23:35:02.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 879 0.09 MB/sec execute 35 sec latency 2897.290 ms 2023-12-01T23:35:03.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 882 0.09 MB/sec execute 36 sec latency 3138.810 ms 2023-12-01T23:35:03.463 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:17:22.369 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.467 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:17:22.373 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.494 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:17:22.400 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.520 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:17:22.372 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.523 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:17:22.375 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.540 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:17:22.392 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.543 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:17:22.395 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.550 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:17:22.402 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:03.569 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:17:22.421 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:35:04.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 886 0.10 MB/sec execute 37 sec latency 2984.933 ms 2023-12-01T23:35:05.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 893 0.10 MB/sec execute 38 sec latency 2881.354 ms 2023-12-01T23:35:06.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 896 0.10 MB/sec execute 39 sec latency 2773.391 ms 2023-12-01T23:35:07.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 899 0.10 MB/sec execute 40 sec latency 2632.149 ms 2023-12-01T23:35:08.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 905 0.10 MB/sec execute 41 sec latency 2850.511 ms 2023-12-01T23:35:09.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 910 0.10 MB/sec execute 42 sec latency 3148.224 ms 2023-12-01T23:35:09.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:35:09.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:35:10.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 913 0.10 MB/sec execute 43 sec latency 3285.054 ms 2023-12-01T23:35:11.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 916 0.10 MB/sec execute 44 sec latency 2121.629 ms 2023-12-01T23:35:12.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 921 0.10 MB/sec execute 45 sec latency 3121.669 ms 2023-12-01T23:35:13.314 INFO:tasks.workunit.client.0.smithi096.stdout: 10 922 0.10 MB/sec execute 46 sec latency 3423.642 ms 2023-12-01T23:35:14.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 928 0.10 MB/sec execute 47 sec latency 2914.935 ms 2023-12-01T23:35:15.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 928 0.10 MB/sec execute 48 sec latency 3045.139 ms 2023-12-01T23:35:16.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 929 0.10 MB/sec execute 49 sec latency 3215.435 ms 2023-12-01T23:35:17.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 930 0.09 MB/sec execute 50 sec latency 2548.034 ms 2023-12-01T23:35:18.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 931 0.09 MB/sec execute 51 sec latency 2311.553 ms 2023-12-01T23:35:19.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 935 0.09 MB/sec execute 52 sec latency 2301.275 ms 2023-12-01T23:35:20.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 936 0.09 MB/sec execute 53 sec latency 2295.241 ms 2023-12-01T23:35:21.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 940 0.09 MB/sec execute 54 sec latency 2321.516 ms 2023-12-01T23:35:22.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 943 0.09 MB/sec execute 55 sec latency 2456.027 ms 2023-12-01T23:35:23.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 943 0.09 MB/sec execute 56 sec latency 2466.356 ms 2023-12-01T23:35:24.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 949 0.09 MB/sec execute 57 sec latency 2711.012 ms 2023-12-01T23:35:25.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 953 0.09 MB/sec execute 58 sec latency 2610.486 ms 2023-12-01T23:35:26.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 956 0.10 MB/sec execute 59 sec latency 2625.499 ms 2023-12-01T23:35:27.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 962 0.10 MB/sec execute 60 sec latency 2470.126 ms 2023-12-01T23:35:28.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 967 0.11 MB/sec execute 61 sec latency 2517.897 ms 2023-12-01T23:35:29.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 973 0.12 MB/sec execute 62 sec latency 2420.982 ms 2023-12-01T23:35:30.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 976 0.12 MB/sec execute 63 sec latency 2734.014 ms 2023-12-01T23:35:31.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 985 0.12 MB/sec execute 64 sec latency 2940.033 ms 2023-12-01T23:35:32.315 INFO:tasks.workunit.client.0.smithi096.stdout: 10 993 0.13 MB/sec execute 65 sec latency 3072.931 ms 2023-12-01T23:35:33.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 995 0.13 MB/sec execute 66 sec latency 3205.886 ms 2023-12-01T23:35:34.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 999 0.13 MB/sec execute 67 sec latency 3656.193 ms 2023-12-01T23:35:35.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1004 0.14 MB/sec execute 68 sec latency 3758.705 ms 2023-12-01T23:35:36.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1011 0.15 MB/sec execute 69 sec latency 2498.075 ms 2023-12-01T23:35:37.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1018 0.17 MB/sec execute 70 sec latency 1731.389 ms 2023-12-01T23:35:38.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1018 0.17 MB/sec execute 71 sec latency 2731.461 ms 2023-12-01T23:35:39.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1019 0.17 MB/sec execute 72 sec latency 3020.027 ms 2023-12-01T23:35:39.466 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:35:39.469 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:35:40.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1033 0.22 MB/sec execute 73 sec latency 2800.366 ms 2023-12-01T23:35:41.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1035 0.21 MB/sec execute 74 sec latency 1942.957 ms 2023-12-01T23:35:42.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1036 0.21 MB/sec execute 75 sec latency 2227.366 ms 2023-12-01T23:35:43.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1039 0.21 MB/sec execute 76 sec latency 2515.739 ms 2023-12-01T23:35:44.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1044 0.21 MB/sec execute 77 sec latency 2476.111 ms 2023-12-01T23:35:45.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1045 0.20 MB/sec execute 78 sec latency 2056.305 ms 2023-12-01T23:35:46.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1047 0.20 MB/sec execute 79 sec latency 2722.950 ms 2023-12-01T23:35:47.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1051 0.20 MB/sec execute 80 sec latency 2777.534 ms 2023-12-01T23:35:48.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1054 0.20 MB/sec execute 81 sec latency 3300.529 ms 2023-12-01T23:35:49.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1056 0.19 MB/sec execute 82 sec latency 3329.643 ms 2023-12-01T23:35:50.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1058 0.19 MB/sec execute 83 sec latency 3124.466 ms 2023-12-01T23:35:51.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1058 0.19 MB/sec execute 84 sec latency 2595.458 ms 2023-12-01T23:35:52.316 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1064 0.19 MB/sec execute 85 sec latency 2460.922 ms 2023-12-01T23:35:53.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1067 0.19 MB/sec execute 86 sec latency 2639.036 ms 2023-12-01T23:35:54.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1068 0.18 MB/sec execute 87 sec latency 1980.554 ms 2023-12-01T23:35:55.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1071 0.18 MB/sec execute 88 sec latency 2711.305 ms 2023-12-01T23:35:56.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1078 0.18 MB/sec execute 89 sec latency 3026.204 ms 2023-12-01T23:35:57.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1084 0.18 MB/sec execute 90 sec latency 1817.598 ms 2023-12-01T23:35:58.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1085 0.18 MB/sec execute 91 sec latency 2365.583 ms 2023-12-01T23:35:59.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1088 0.18 MB/sec execute 92 sec latency 2954.098 ms 2023-12-01T23:36:00.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1092 0.18 MB/sec execute 93 sec latency 3434.586 ms 2023-12-01T23:36:01.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1102 0.18 MB/sec execute 94 sec latency 3397.292 ms 2023-12-01T23:36:02.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1105 0.17 MB/sec execute 95 sec latency 2349.287 ms 2023-12-01T23:36:03.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1108 0.17 MB/sec execute 96 sec latency 2832.207 ms 2023-12-01T23:36:04.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1109 0.17 MB/sec execute 97 sec latency 3105.591 ms 2023-12-01T23:36:05.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1112 0.17 MB/sec execute 98 sec latency 3271.380 ms 2023-12-01T23:36:06.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1119 0.17 MB/sec execute 99 sec latency 2957.271 ms 2023-12-01T23:36:07.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1122 0.17 MB/sec execute 100 sec latency 2673.971 ms 2023-12-01T23:36:08.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1124 0.17 MB/sec execute 101 sec latency 2952.573 ms 2023-12-01T23:36:09.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1128 0.16 MB/sec execute 102 sec latency 3149.213 ms 2023-12-01T23:36:09.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:36:09.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:36:10.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1136 0.16 MB/sec execute 103 sec latency 2845.761 ms 2023-12-01T23:36:11.317 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1138 0.16 MB/sec execute 104 sec latency 2229.012 ms 2023-12-01T23:36:12.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1142 0.16 MB/sec execute 105 sec latency 2601.150 ms 2023-12-01T23:36:13.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1146 0.16 MB/sec execute 106 sec latency 2387.731 ms 2023-12-01T23:36:14.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1149 0.16 MB/sec execute 107 sec latency 2415.415 ms 2023-12-01T23:36:15.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1154 0.16 MB/sec execute 108 sec latency 2982.970 ms 2023-12-01T23:36:16.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1159 0.16 MB/sec execute 109 sec latency 2758.747 ms 2023-12-01T23:36:17.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1164 0.16 MB/sec execute 110 sec latency 2317.154 ms 2023-12-01T23:36:18.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1168 0.15 MB/sec execute 111 sec latency 2749.922 ms 2023-12-01T23:36:19.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1168 0.15 MB/sec execute 112 sec latency 2993.407 ms 2023-12-01T23:36:20.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1170 0.15 MB/sec execute 113 sec latency 2889.249 ms 2023-12-01T23:36:21.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1173 0.15 MB/sec execute 114 sec latency 2443.007 ms 2023-12-01T23:36:22.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1176 0.15 MB/sec execute 115 sec latency 2716.000 ms 2023-12-01T23:36:23.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1180 0.15 MB/sec execute 116 sec latency 3196.492 ms 2023-12-01T23:36:24.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1182 0.15 MB/sec execute 117 sec latency 2853.759 ms 2023-12-01T23:36:25.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1185 0.15 MB/sec execute 118 sec latency 2951.506 ms 2023-12-01T23:36:26.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1189 0.15 MB/sec execute 119 sec latency 3057.885 ms 2023-12-01T23:36:27.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1192 0.14 MB/sec execute 120 sec latency 2370.434 ms 2023-12-01T23:36:28.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1194 0.14 MB/sec execute 121 sec latency 2514.806 ms 2023-12-01T23:36:29.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1198 0.14 MB/sec execute 122 sec latency 2784.261 ms 2023-12-01T23:36:30.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1203 0.14 MB/sec execute 123 sec latency 3139.090 ms 2023-12-01T23:36:31.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1206 0.14 MB/sec execute 124 sec latency 3219.889 ms 2023-12-01T23:36:32.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1210 0.14 MB/sec execute 125 sec latency 3246.820 ms 2023-12-01T23:36:33.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1214 0.14 MB/sec execute 126 sec latency 2301.885 ms 2023-12-01T23:36:34.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1219 0.14 MB/sec execute 127 sec latency 3301.393 ms 2023-12-01T23:36:35.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1222 0.14 MB/sec execute 128 sec latency 3320.916 ms 2023-12-01T23:36:36.318 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1227 0.14 MB/sec execute 129 sec latency 2185.332 ms 2023-12-01T23:36:37.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1233 0.14 MB/sec execute 130 sec latency 2628.118 ms 2023-12-01T23:36:38.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1236 0.14 MB/sec execute 131 sec latency 2587.020 ms 2023-12-01T23:36:39.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1240 0.14 MB/sec execute 132 sec latency 2505.409 ms 2023-12-01T23:36:39.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:36:39.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:36:40.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1244 0.13 MB/sec execute 133 sec latency 3256.164 ms 2023-12-01T23:36:41.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1247 0.14 MB/sec execute 134 sec latency 3357.754 ms 2023-12-01T23:36:42.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1259 0.15 MB/sec execute 135 sec latency 3310.338 ms 2023-12-01T23:36:43.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1264 0.15 MB/sec execute 136 sec latency 3081.900 ms 2023-12-01T23:36:44.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1267 0.15 MB/sec execute 137 sec latency 3012.116 ms 2023-12-01T23:36:45.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1275 0.15 MB/sec execute 138 sec latency 2668.264 ms 2023-12-01T23:36:46.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1276 0.15 MB/sec execute 139 sec latency 3130.026 ms 2023-12-01T23:36:47.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1288 0.17 MB/sec execute 140 sec latency 2999.173 ms 2023-12-01T23:36:48.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1289 0.17 MB/sec execute 141 sec latency 3148.172 ms 2023-12-01T23:36:49.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1290 0.17 MB/sec execute 142 sec latency 3058.701 ms 2023-12-01T23:36:50.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1292 0.17 MB/sec execute 143 sec latency 3096.254 ms 2023-12-01T23:36:51.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1297 0.17 MB/sec execute 144 sec latency 2926.121 ms 2023-12-01T23:36:52.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1301 0.17 MB/sec execute 145 sec latency 2383.421 ms 2023-12-01T23:36:53.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1319 0.20 MB/sec execute 146 sec latency 2712.569 ms 2023-12-01T23:36:54.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1320 0.20 MB/sec execute 147 sec latency 3158.815 ms 2023-12-01T23:36:55.319 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1321 0.20 MB/sec execute 148 sec latency 2637.408 ms 2023-12-01T23:36:56.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1332 0.22 MB/sec execute 149 sec latency 2222.126 ms 2023-12-01T23:36:57.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1341 0.24 MB/sec execute 150 sec latency 2133.361 ms 2023-12-01T23:36:58.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1343 0.24 MB/sec execute 151 sec latency 2433.173 ms 2023-12-01T23:36:59.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1353 0.25 MB/sec execute 152 sec latency 2524.450 ms 2023-12-01T23:37:00.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1355 0.25 MB/sec execute 153 sec latency 2852.064 ms 2023-12-01T23:37:01.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1356 0.25 MB/sec execute 154 sec latency 2690.464 ms 2023-12-01T23:37:02.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1358 0.25 MB/sec execute 155 sec latency 2272.067 ms 2023-12-01T23:37:03.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1387 0.30 MB/sec execute 156 sec latency 2188.351 ms 2023-12-01T23:37:04.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1391 0.30 MB/sec execute 157 sec latency 2586.208 ms 2023-12-01T23:37:05.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1393 0.30 MB/sec execute 158 sec latency 2479.390 ms 2023-12-01T23:37:06.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1394 0.30 MB/sec execute 159 sec latency 2545.146 ms 2023-12-01T23:37:07.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1396 0.29 MB/sec execute 160 sec latency 2203.299 ms 2023-12-01T23:37:08.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1400 0.29 MB/sec execute 161 sec latency 2484.803 ms 2023-12-01T23:37:09.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1404 0.29 MB/sec execute 162 sec latency 2039.432 ms 2023-12-01T23:37:09.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:37:09.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:37:10.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1407 0.29 MB/sec execute 163 sec latency 2700.040 ms 2023-12-01T23:37:11.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1408 0.29 MB/sec execute 164 sec latency 2793.416 ms 2023-12-01T23:37:12.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1413 0.29 MB/sec execute 165 sec latency 2456.940 ms 2023-12-01T23:37:13.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1418 0.28 MB/sec execute 166 sec latency 2054.235 ms 2023-12-01T23:37:14.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1423 0.28 MB/sec execute 167 sec latency 2332.257 ms 2023-12-01T23:37:15.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1426 0.28 MB/sec execute 168 sec latency 2765.955 ms 2023-12-01T23:37:16.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1429 0.28 MB/sec execute 169 sec latency 2741.268 ms 2023-12-01T23:37:17.320 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1433 0.28 MB/sec execute 170 sec latency 2294.050 ms 2023-12-01T23:37:18.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1438 0.28 MB/sec execute 171 sec latency 2143.794 ms 2023-12-01T23:37:19.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1441 0.27 MB/sec execute 172 sec latency 2501.676 ms 2023-12-01T23:37:20.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1445 0.27 MB/sec execute 173 sec latency 2559.313 ms 2023-12-01T23:37:21.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1451 0.27 MB/sec execute 174 sec latency 2253.923 ms 2023-12-01T23:37:22.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1454 0.27 MB/sec execute 175 sec latency 2455.287 ms 2023-12-01T23:37:23.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1460 0.27 MB/sec execute 176 sec latency 2373.894 ms 2023-12-01T23:37:24.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1462 0.27 MB/sec execute 177 sec latency 2684.926 ms 2023-12-01T23:37:25.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1467 0.27 MB/sec execute 178 sec latency 2494.673 ms 2023-12-01T23:37:26.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1472 0.26 MB/sec execute 179 sec latency 2808.005 ms 2023-12-01T23:37:27.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1478 0.26 MB/sec execute 180 sec latency 2902.695 ms 2023-12-01T23:37:28.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1481 0.26 MB/sec execute 181 sec latency 2602.589 ms 2023-12-01T23:37:29.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1481 0.26 MB/sec execute 182 sec latency 2040.347 ms 2023-12-01T23:37:30.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1483 0.26 MB/sec execute 183 sec latency 2622.622 ms 2023-12-01T23:37:31.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1491 0.26 MB/sec execute 184 sec latency 2618.831 ms 2023-12-01T23:37:32.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1493 0.26 MB/sec execute 185 sec latency 1335.039 ms 2023-12-01T23:37:33.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1499 0.26 MB/sec execute 186 sec latency 2015.802 ms 2023-12-01T23:37:34.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1501 0.25 MB/sec execute 187 sec latency 2897.971 ms 2023-12-01T23:37:35.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1503 0.25 MB/sec execute 188 sec latency 3003.260 ms 2023-12-01T23:37:36.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1506 0.25 MB/sec execute 189 sec latency 3007.631 ms 2023-12-01T23:37:37.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1514 0.25 MB/sec execute 190 sec latency 2978.365 ms 2023-12-01T23:37:38.321 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1520 0.25 MB/sec execute 191 sec latency 2606.935 ms 2023-12-01T23:37:39.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1522 0.25 MB/sec execute 192 sec latency 2088.504 ms 2023-12-01T23:37:39.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:37:39.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:37:40.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1524 0.25 MB/sec execute 193 sec latency 2892.888 ms 2023-12-01T23:37:41.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1526 0.25 MB/sec execute 194 sec latency 2990.705 ms 2023-12-01T23:37:42.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1533 0.25 MB/sec execute 195 sec latency 2993.004 ms 2023-12-01T23:37:43.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1535 0.24 MB/sec execute 196 sec latency 1482.429 ms 2023-12-01T23:37:44.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1536 0.24 MB/sec execute 197 sec latency 2482.554 ms 2023-12-01T23:37:45.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1538 0.24 MB/sec execute 198 sec latency 3196.804 ms 2023-12-01T23:37:46.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1545 0.24 MB/sec execute 199 sec latency 3221.655 ms 2023-12-01T23:37:47.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1548 0.24 MB/sec execute 200 sec latency 2870.461 ms 2023-12-01T23:37:48.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1551 0.24 MB/sec execute 201 sec latency 2386.328 ms 2023-12-01T23:37:49.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1556 0.24 MB/sec execute 202 sec latency 2640.186 ms 2023-12-01T23:37:50.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1560 0.24 MB/sec execute 203 sec latency 3313.235 ms 2023-12-01T23:37:51.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1566 0.24 MB/sec execute 204 sec latency 3713.832 ms 2023-12-01T23:37:52.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1569 0.24 MB/sec execute 205 sec latency 2616.247 ms 2023-12-01T23:37:53.322 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1571 0.23 MB/sec execute 206 sec latency 2426.696 ms 2023-12-01T23:37:54.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1574 0.23 MB/sec execute 207 sec latency 2524.603 ms 2023-12-01T23:37:55.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1578 0.23 MB/sec execute 208 sec latency 2681.929 ms 2023-12-01T23:37:56.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1582 0.23 MB/sec execute 209 sec latency 2298.009 ms 2023-12-01T23:37:57.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1587 0.23 MB/sec execute 210 sec latency 2355.573 ms 2023-12-01T23:37:58.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1589 0.23 MB/sec execute 211 sec latency 3129.968 ms 2023-12-01T23:37:59.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1595 0.23 MB/sec execute 212 sec latency 2793.276 ms 2023-12-01T23:38:00.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1598 0.23 MB/sec execute 213 sec latency 2842.908 ms 2023-12-01T23:38:01.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1601 0.23 MB/sec execute 214 sec latency 1808.393 ms 2023-12-01T23:38:02.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1605 0.23 MB/sec execute 215 sec latency 2557.994 ms 2023-12-01T23:38:03.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1610 0.22 MB/sec execute 216 sec latency 2593.014 ms 2023-12-01T23:38:04.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1614 0.22 MB/sec execute 217 sec latency 1978.229 ms 2023-12-01T23:38:05.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1616 0.22 MB/sec execute 218 sec latency 2624.553 ms 2023-12-01T23:38:06.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1621 0.22 MB/sec execute 219 sec latency 2962.051 ms 2023-12-01T23:38:07.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1622 0.22 MB/sec execute 220 sec latency 3068.603 ms 2023-12-01T23:38:08.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1627 0.22 MB/sec execute 221 sec latency 2890.080 ms 2023-12-01T23:38:09.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1632 0.22 MB/sec execute 222 sec latency 2530.820 ms 2023-12-01T23:38:10.015 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:38:10.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:38:10.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1637 0.22 MB/sec execute 223 sec latency 2731.718 ms 2023-12-01T23:38:11.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1641 0.22 MB/sec execute 224 sec latency 2640.276 ms 2023-12-01T23:38:12.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1643 0.22 MB/sec execute 225 sec latency 2397.075 ms 2023-12-01T23:38:13.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1646 0.22 MB/sec execute 226 sec latency 2748.735 ms 2023-12-01T23:38:14.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1651 0.22 MB/sec execute 227 sec latency 2751.261 ms 2023-12-01T23:38:15.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1654 0.21 MB/sec execute 228 sec latency 2783.360 ms 2023-12-01T23:38:16.323 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1658 0.21 MB/sec execute 229 sec latency 2708.213 ms 2023-12-01T23:38:17.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1666 0.21 MB/sec execute 230 sec latency 3114.739 ms 2023-12-01T23:38:18.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1670 0.21 MB/sec execute 231 sec latency 3168.584 ms 2023-12-01T23:38:19.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1678 0.21 MB/sec execute 232 sec latency 3100.787 ms 2023-12-01T23:38:20.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1682 0.21 MB/sec execute 233 sec latency 1825.418 ms 2023-12-01T23:38:21.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1687 0.21 MB/sec execute 234 sec latency 2825.471 ms 2023-12-01T23:38:22.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1690 0.21 MB/sec execute 235 sec latency 3502.472 ms 2023-12-01T23:38:23.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1693 0.21 MB/sec execute 236 sec latency 2675.077 ms 2023-12-01T23:38:24.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1693 0.21 MB/sec execute 237 sec latency 3491.674 ms 2023-12-01T23:38:25.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1699 0.21 MB/sec execute 238 sec latency 3741.612 ms 2023-12-01T23:38:26.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1702 0.21 MB/sec execute 239 sec latency 3994.051 ms 2023-12-01T23:38:27.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1704 0.21 MB/sec execute 240 sec latency 3011.606 ms 2023-12-01T23:38:28.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1708 0.20 MB/sec execute 241 sec latency 3056.280 ms 2023-12-01T23:38:29.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1713 0.20 MB/sec execute 242 sec latency 2598.237 ms 2023-12-01T23:38:30.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1715 0.20 MB/sec execute 243 sec latency 2438.224 ms 2023-12-01T23:38:31.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1718 0.20 MB/sec execute 244 sec latency 3123.370 ms 2023-12-01T23:38:32.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1722 0.20 MB/sec execute 245 sec latency 3596.343 ms 2023-12-01T23:38:33.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1731 0.20 MB/sec execute 246 sec latency 3690.852 ms 2023-12-01T23:38:34.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1742 0.20 MB/sec execute 247 sec latency 3009.921 ms 2023-12-01T23:38:35.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1747 0.20 MB/sec execute 248 sec latency 2522.414 ms 2023-12-01T23:38:36.324 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1752 0.20 MB/sec execute 249 sec latency 3133.602 ms 2023-12-01T23:38:37.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1755 0.20 MB/sec execute 250 sec latency 3654.556 ms 2023-12-01T23:38:38.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1758 0.20 MB/sec execute 251 sec latency 2671.908 ms 2023-12-01T23:38:39.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1761 0.20 MB/sec execute 252 sec latency 3526.248 ms 2023-12-01T23:38:40.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:38:40.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:38:40.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1763 0.20 MB/sec execute 253 sec latency 4312.655 ms 2023-12-01T23:38:41.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1765 0.20 MB/sec execute 254 sec latency 4644.458 ms 2023-12-01T23:38:42.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1767 0.20 MB/sec execute 255 sec latency 5009.011 ms 2023-12-01T23:38:43.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1772 0.19 MB/sec execute 256 sec latency 4363.927 ms 2023-12-01T23:38:44.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1777 0.19 MB/sec execute 257 sec latency 4830.776 ms 2023-12-01T23:38:45.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1780 0.19 MB/sec execute 258 sec latency 3331.095 ms 2023-12-01T23:38:46.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1786 0.19 MB/sec execute 259 sec latency 1840.800 ms 2023-12-01T23:38:47.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1790 0.19 MB/sec execute 260 sec latency 2817.475 ms 2023-12-01T23:38:48.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1793 0.19 MB/sec execute 261 sec latency 2161.788 ms 2023-12-01T23:38:49.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1796 0.19 MB/sec execute 262 sec latency 2701.615 ms 2023-12-01T23:38:50.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1802 0.19 MB/sec execute 263 sec latency 2913.841 ms 2023-12-01T23:38:51.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1810 0.19 MB/sec execute 264 sec latency 3195.569 ms 2023-12-01T23:38:52.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1814 0.19 MB/sec execute 265 sec latency 2193.334 ms 2023-12-01T23:38:53.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1817 0.19 MB/sec execute 266 sec latency 2879.079 ms 2023-12-01T23:38:54.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1819 0.19 MB/sec execute 267 sec latency 2844.068 ms 2023-12-01T23:38:55.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1821 0.19 MB/sec execute 268 sec latency 2429.895 ms 2023-12-01T23:38:56.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1829 0.19 MB/sec execute 269 sec latency 2140.477 ms 2023-12-01T23:38:57.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1834 0.19 MB/sec execute 270 sec latency 1773.966 ms 2023-12-01T23:38:58.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1838 0.19 MB/sec execute 271 sec latency 1418.252 ms 2023-12-01T23:38:59.325 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1840 0.19 MB/sec execute 272 sec latency 1686.096 ms 2023-12-01T23:39:00.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1841 0.19 MB/sec execute 273 sec latency 2107.204 ms 2023-12-01T23:39:01.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1845 0.18 MB/sec execute 274 sec latency 2684.110 ms 2023-12-01T23:39:02.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1853 0.18 MB/sec execute 275 sec latency 2631.128 ms 2023-12-01T23:39:03.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1857 0.18 MB/sec execute 276 sec latency 1897.573 ms 2023-12-01T23:39:04.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1858 0.18 MB/sec execute 277 sec latency 2479.227 ms 2023-12-01T23:39:05.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1860 0.18 MB/sec execute 278 sec latency 2308.572 ms 2023-12-01T23:39:06.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1863 0.18 MB/sec execute 279 sec latency 1903.489 ms 2023-12-01T23:39:07.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1864 0.18 MB/sec execute 280 sec latency 1899.351 ms 2023-12-01T23:39:08.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1867 0.18 MB/sec execute 281 sec latency 2312.819 ms 2023-12-01T23:39:09.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1874 0.18 MB/sec execute 282 sec latency 2344.203 ms 2023-12-01T23:39:10.234 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:39:10.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:39:10.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1877 0.18 MB/sec execute 283 sec latency 2623.047 ms 2023-12-01T23:39:11.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1882 0.18 MB/sec execute 284 sec latency 2311.373 ms 2023-12-01T23:39:12.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1887 0.18 MB/sec execute 285 sec latency 2580.252 ms 2023-12-01T23:39:13.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1898 0.18 MB/sec execute 286 sec latency 2266.195 ms 2023-12-01T23:39:14.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1904 0.18 MB/sec execute 287 sec latency 1879.247 ms 2023-12-01T23:39:15.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1905 0.18 MB/sec execute 288 sec latency 2322.374 ms 2023-12-01T23:39:16.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1907 0.18 MB/sec execute 289 sec latency 2619.360 ms 2023-12-01T23:39:17.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1911 0.18 MB/sec execute 290 sec latency 2771.432 ms 2023-12-01T23:39:18.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1913 0.18 MB/sec execute 291 sec latency 2157.606 ms 2023-12-01T23:39:19.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1916 0.18 MB/sec execute 292 sec latency 2700.469 ms 2023-12-01T23:39:20.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1918 0.18 MB/sec execute 293 sec latency 3089.107 ms 2023-12-01T23:39:21.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1923 0.17 MB/sec execute 294 sec latency 3209.029 ms 2023-12-01T23:39:22.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1926 0.17 MB/sec execute 295 sec latency 2290.683 ms 2023-12-01T23:39:23.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1933 0.17 MB/sec execute 296 sec latency 2113.347 ms 2023-12-01T23:39:24.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1939 0.17 MB/sec execute 297 sec latency 2587.771 ms 2023-12-01T23:39:25.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1946 0.17 MB/sec execute 298 sec latency 2818.949 ms 2023-12-01T23:39:26.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1955 0.17 MB/sec execute 299 sec latency 2770.407 ms 2023-12-01T23:39:27.326 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1965 0.17 MB/sec execute 300 sec latency 2623.796 ms 2023-12-01T23:39:28.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1969 0.17 MB/sec execute 301 sec latency 2532.438 ms 2023-12-01T23:39:29.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1970 0.17 MB/sec execute 302 sec latency 2635.781 ms 2023-12-01T23:39:30.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1970 0.17 MB/sec execute 303 sec latency 3606.262 ms 2023-12-01T23:39:31.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1972 0.17 MB/sec execute 304 sec latency 4216.152 ms 2023-12-01T23:39:32.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1975 0.17 MB/sec execute 305 sec latency 4252.586 ms 2023-12-01T23:39:33.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1977 0.17 MB/sec execute 306 sec latency 4777.653 ms 2023-12-01T23:39:34.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1979 0.17 MB/sec execute 307 sec latency 4963.131 ms 2023-12-01T23:39:35.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1984 0.17 MB/sec execute 308 sec latency 3649.528 ms 2023-12-01T23:39:36.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1990 0.17 MB/sec execute 309 sec latency 3087.374 ms 2023-12-01T23:39:37.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1994 0.17 MB/sec execute 310 sec latency 2260.784 ms 2023-12-01T23:39:38.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 1997 0.17 MB/sec execute 311 sec latency 2654.864 ms 2023-12-01T23:39:39.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2001 0.17 MB/sec execute 312 sec latency 2890.160 ms 2023-12-01T23:39:40.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2005 0.17 MB/sec execute 313 sec latency 3201.465 ms 2023-12-01T23:39:40.350 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:39:40.354 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:39:41.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2008 0.17 MB/sec execute 314 sec latency 3259.450 ms 2023-12-01T23:39:42.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2011 0.17 MB/sec execute 315 sec latency 3508.269 ms 2023-12-01T23:39:43.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2018 0.17 MB/sec execute 316 sec latency 3612.309 ms 2023-12-01T23:39:44.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2028 0.17 MB/sec execute 317 sec latency 2683.916 ms 2023-12-01T23:39:45.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2030 0.17 MB/sec execute 318 sec latency 2665.786 ms 2023-12-01T23:39:46.327 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2032 0.16 MB/sec execute 319 sec latency 2616.153 ms 2023-12-01T23:39:47.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2036 0.16 MB/sec execute 320 sec latency 2675.557 ms 2023-12-01T23:39:48.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2041 0.16 MB/sec execute 321 sec latency 2117.507 ms 2023-12-01T23:39:49.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2044 0.16 MB/sec execute 322 sec latency 2177.274 ms 2023-12-01T23:39:50.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2045 0.16 MB/sec execute 323 sec latency 2772.832 ms 2023-12-01T23:39:51.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2047 0.16 MB/sec execute 324 sec latency 3532.756 ms 2023-12-01T23:39:52.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2048 0.16 MB/sec execute 325 sec latency 3644.018 ms 2023-12-01T23:39:53.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2050 0.16 MB/sec execute 326 sec latency 3544.965 ms 2023-12-01T23:39:54.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2053 0.16 MB/sec execute 327 sec latency 2870.389 ms 2023-12-01T23:39:55.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2056 0.16 MB/sec execute 328 sec latency 1762.601 ms 2023-12-01T23:39:56.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2063 0.16 MB/sec execute 329 sec latency 2324.628 ms 2023-12-01T23:39:57.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2068 0.16 MB/sec execute 330 sec latency 2455.834 ms 2023-12-01T23:39:58.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2073 0.16 MB/sec execute 331 sec latency 2204.850 ms 2023-12-01T23:39:59.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2078 0.16 MB/sec execute 332 sec latency 2368.689 ms 2023-12-01T23:40:00.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2079 0.16 MB/sec execute 333 sec latency 2603.249 ms 2023-12-01T23:40:01.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2083 0.16 MB/sec execute 334 sec latency 2576.770 ms 2023-12-01T23:40:02.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2084 0.16 MB/sec execute 335 sec latency 3029.501 ms 2023-12-01T23:40:03.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2086 0.16 MB/sec execute 336 sec latency 2923.366 ms 2023-12-01T23:40:04.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2089 0.16 MB/sec execute 337 sec latency 3290.438 ms 2023-12-01T23:40:05.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2092 0.16 MB/sec execute 338 sec latency 3274.922 ms 2023-12-01T23:40:06.328 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2095 0.16 MB/sec execute 339 sec latency 2922.120 ms 2023-12-01T23:40:07.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2097 0.16 MB/sec execute 340 sec latency 2909.261 ms 2023-12-01T23:40:08.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2100 0.16 MB/sec execute 341 sec latency 2408.752 ms 2023-12-01T23:40:09.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2106 0.16 MB/sec execute 342 sec latency 2204.821 ms 2023-12-01T23:40:10.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2107 0.16 MB/sec execute 343 sec latency 2448.066 ms 2023-12-01T23:40:10.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:40:10.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:40:11.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2112 0.16 MB/sec execute 344 sec latency 2442.654 ms 2023-12-01T23:40:12.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2118 0.16 MB/sec execute 345 sec latency 2519.680 ms 2023-12-01T23:40:13.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2123 0.16 MB/sec execute 346 sec latency 2117.105 ms 2023-12-01T23:40:14.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2133 0.15 MB/sec execute 347 sec latency 2283.325 ms 2023-12-01T23:40:15.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2135 0.15 MB/sec execute 348 sec latency 2113.118 ms 2023-12-01T23:40:16.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2138 0.15 MB/sec execute 349 sec latency 2673.938 ms 2023-12-01T23:40:17.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2142 0.15 MB/sec execute 350 sec latency 3053.154 ms 2023-12-01T23:40:18.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2142 0.15 MB/sec execute 351 sec latency 3613.306 ms 2023-12-01T23:40:19.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2144 0.15 MB/sec execute 352 sec latency 3756.256 ms 2023-12-01T23:40:20.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2145 0.15 MB/sec execute 353 sec latency 4213.364 ms 2023-12-01T23:40:21.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2149 0.15 MB/sec execute 354 sec latency 4876.864 ms 2023-12-01T23:40:22.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2157 0.15 MB/sec execute 355 sec latency 4055.765 ms 2023-12-01T23:40:23.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2161 0.15 MB/sec execute 356 sec latency 3703.697 ms 2023-12-01T23:40:24.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2172 0.15 MB/sec execute 357 sec latency 2286.423 ms 2023-12-01T23:40:25.329 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2175 0.15 MB/sec execute 358 sec latency 1928.579 ms 2023-12-01T23:40:26.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2179 0.16 MB/sec execute 359 sec latency 2341.568 ms 2023-12-01T23:40:27.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2179 0.16 MB/sec execute 360 sec latency 2990.547 ms 2023-12-01T23:40:28.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2182 0.16 MB/sec execute 361 sec latency 2664.676 ms 2023-12-01T23:40:29.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2189 0.16 MB/sec execute 362 sec latency 2118.028 ms 2023-12-01T23:40:30.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2193 0.16 MB/sec execute 363 sec latency 2077.813 ms 2023-12-01T23:40:31.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2194 0.15 MB/sec execute 364 sec latency 3077.845 ms 2023-12-01T23:40:32.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2198 0.15 MB/sec execute 365 sec latency 3420.883 ms 2023-12-01T23:40:33.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2202 0.15 MB/sec execute 366 sec latency 3328.235 ms 2023-12-01T23:40:34.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2206 0.15 MB/sec execute 367 sec latency 2163.309 ms 2023-12-01T23:40:35.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2213 0.15 MB/sec execute 368 sec latency 2331.479 ms 2023-12-01T23:40:36.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2215 0.15 MB/sec execute 369 sec latency 2689.586 ms 2023-12-01T23:40:37.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2221 0.16 MB/sec execute 370 sec latency 3423.486 ms 2023-12-01T23:40:38.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2226 0.16 MB/sec execute 371 sec latency 3256.533 ms 2023-12-01T23:40:39.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2233 0.15 MB/sec execute 372 sec latency 3355.649 ms 2023-12-01T23:40:40.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2238 0.16 MB/sec execute 373 sec latency 3253.598 ms 2023-12-01T23:40:40.595 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:40:40.598 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:40:41.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2245 0.16 MB/sec execute 374 sec latency 3756.033 ms 2023-12-01T23:40:42.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2253 0.16 MB/sec execute 375 sec latency 3466.870 ms 2023-12-01T23:40:43.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2259 0.16 MB/sec execute 376 sec latency 3139.623 ms 2023-12-01T23:40:44.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2263 0.16 MB/sec execute 377 sec latency 2515.273 ms 2023-12-01T23:40:45.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2267 0.16 MB/sec execute 378 sec latency 2713.539 ms 2023-12-01T23:40:46.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2269 0.16 MB/sec execute 379 sec latency 2944.358 ms 2023-12-01T23:40:47.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2272 0.16 MB/sec execute 380 sec latency 2238.172 ms 2023-12-01T23:40:48.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2274 0.16 MB/sec execute 381 sec latency 3018.859 ms 2023-12-01T23:40:49.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2275 0.16 MB/sec execute 382 sec latency 3131.192 ms 2023-12-01T23:40:50.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2277 0.16 MB/sec execute 383 sec latency 2527.130 ms 2023-12-01T23:40:51.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2280 0.16 MB/sec execute 384 sec latency 2991.600 ms 2023-12-01T23:40:52.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2283 0.16 MB/sec execute 385 sec latency 3119.362 ms 2023-12-01T23:40:53.330 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2290 0.16 MB/sec execute 386 sec latency 2263.090 ms 2023-12-01T23:40:54.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2298 0.16 MB/sec execute 387 sec latency 2460.667 ms 2023-12-01T23:40:55.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2301 0.16 MB/sec execute 388 sec latency 2513.834 ms 2023-12-01T23:40:56.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2304 0.16 MB/sec execute 389 sec latency 2701.008 ms 2023-12-01T23:40:57.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2310 0.16 MB/sec execute 390 sec latency 2503.078 ms 2023-12-01T23:40:58.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2319 0.16 MB/sec execute 391 sec latency 2538.171 ms 2023-12-01T23:40:59.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2321 0.16 MB/sec execute 392 sec latency 3004.430 ms 2023-12-01T23:41:00.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2324 0.17 MB/sec execute 393 sec latency 3305.697 ms 2023-12-01T23:41:01.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2326 0.17 MB/sec execute 394 sec latency 3258.626 ms 2023-12-01T23:41:02.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2327 0.17 MB/sec execute 395 sec latency 2714.892 ms 2023-12-01T23:41:03.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2329 0.16 MB/sec execute 396 sec latency 2624.634 ms 2023-12-01T23:41:04.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2330 0.16 MB/sec execute 397 sec latency 3057.289 ms 2023-12-01T23:41:05.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2333 0.16 MB/sec execute 398 sec latency 3258.235 ms 2023-12-01T23:41:06.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2335 0.16 MB/sec execute 399 sec latency 3538.599 ms 2023-12-01T23:41:07.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2337 0.16 MB/sec execute 400 sec latency 2756.397 ms 2023-12-01T23:41:08.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2340 0.16 MB/sec execute 401 sec latency 2682.254 ms 2023-12-01T23:41:09.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2342 0.16 MB/sec execute 402 sec latency 2360.905 ms 2023-12-01T23:41:10.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2344 0.16 MB/sec execute 403 sec latency 2261.478 ms 2023-12-01T23:41:10.669 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:41:10.673 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:41:11.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2347 0.16 MB/sec execute 404 sec latency 2937.173 ms 2023-12-01T23:41:12.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2352 0.16 MB/sec execute 405 sec latency 2926.986 ms 2023-12-01T23:41:12.469 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:23:31.375 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.475 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:23:31.381 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.483 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:23:31.335 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.483 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:23:31.335 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.485 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:23:31.337 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.486 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:23:31.338 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.602 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:23:31.508 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.617 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:23:31.469 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:12.643 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:23:31.491 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:13.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2354 0.16 MB/sec execute 406 sec latency 2605.709 ms 2023-12-01T23:41:14.331 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2357 0.16 MB/sec execute 407 sec latency 2653.133 ms 2023-12-01T23:41:15.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2358 0.16 MB/sec execute 408 sec latency 2791.660 ms 2023-12-01T23:41:16.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2360 0.16 MB/sec execute 409 sec latency 2814.607 ms 2023-12-01T23:41:17.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2361 0.16 MB/sec execute 410 sec latency 2883.399 ms 2023-12-01T23:41:18.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2364 0.16 MB/sec execute 411 sec latency 2298.348 ms 2023-12-01T23:41:19.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2366 0.16 MB/sec execute 412 sec latency 2600.911 ms 2023-12-01T23:41:20.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2368 0.16 MB/sec execute 413 sec latency 2646.828 ms 2023-12-01T23:41:21.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2369 0.16 MB/sec execute 414 sec latency 2917.833 ms 2023-12-01T23:41:22.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2374 0.16 MB/sec execute 415 sec latency 3011.795 ms 2023-12-01T23:41:23.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2376 0.16 MB/sec execute 416 sec latency 2927.740 ms 2023-12-01T23:41:24.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2379 0.16 MB/sec execute 417 sec latency 2724.743 ms 2023-12-01T23:41:25.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2380 0.16 MB/sec execute 418 sec latency 2697.720 ms 2023-12-01T23:41:26.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2384 0.16 MB/sec execute 419 sec latency 2771.898 ms 2023-12-01T23:41:27.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2388 0.16 MB/sec execute 420 sec latency 2569.591 ms 2023-12-01T23:41:28.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2390 0.16 MB/sec execute 421 sec latency 2449.093 ms 2023-12-01T23:41:29.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2393 0.16 MB/sec execute 422 sec latency 2919.351 ms 2023-12-01T23:41:30.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2395 0.16 MB/sec execute 423 sec latency 2800.127 ms 2023-12-01T23:41:31.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2397 0.16 MB/sec execute 424 sec latency 2879.597 ms 2023-12-01T23:41:32.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2399 0.16 MB/sec execute 425 sec latency 2956.109 ms 2023-12-01T23:41:33.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2404 0.16 MB/sec execute 426 sec latency 2845.378 ms 2023-12-01T23:41:34.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2407 0.16 MB/sec execute 427 sec latency 2636.955 ms 2023-12-01T23:41:35.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2410 0.16 MB/sec execute 428 sec latency 2732.354 ms 2023-12-01T23:41:36.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2412 0.16 MB/sec execute 429 sec latency 3100.846 ms 2023-12-01T23:41:37.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2415 0.16 MB/sec execute 430 sec latency 3173.974 ms 2023-12-01T23:41:38.332 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2417 0.16 MB/sec execute 431 sec latency 2764.055 ms 2023-12-01T23:41:39.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2423 0.16 MB/sec execute 432 sec latency 2760.798 ms 2023-12-01T23:41:40.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2425 0.16 MB/sec execute 433 sec latency 3057.237 ms 2023-12-01T23:41:40.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:41:40.977 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:41:41.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2427 0.16 MB/sec execute 434 sec latency 3467.445 ms 2023-12-01T23:41:42.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2428 0.16 MB/sec execute 435 sec latency 3267.693 ms 2023-12-01T23:41:43.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2431 0.16 MB/sec execute 436 sec latency 3137.056 ms 2023-12-01T23:41:44.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2434 0.16 MB/sec execute 437 sec latency 2552.458 ms 2023-12-01T23:41:45.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2437 0.16 MB/sec execute 438 sec latency 2314.101 ms 2023-12-01T23:41:46.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2439 0.16 MB/sec execute 439 sec latency 2684.944 ms 2023-12-01T23:41:47.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2443 0.16 MB/sec execute 440 sec latency 1118.074 ms 2023-12-01T23:41:48.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2447 0.16 MB/sec execute 441 sec latency 2118.100 ms 2023-12-01T23:41:49.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2450 0.16 MB/sec execute 442 sec latency 2849.996 ms 2023-12-01T23:41:50.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2457 0.16 MB/sec execute 443 sec latency 2489.825 ms 2023-12-01T23:41:51.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2459 0.16 MB/sec execute 444 sec latency 3280.432 ms 2023-12-01T23:41:52.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2467 0.16 MB/sec execute 445 sec latency 3207.794 ms 2023-12-01T23:41:53.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2472 0.16 MB/sec execute 446 sec latency 3645.065 ms 2023-12-01T23:41:54.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2475 0.16 MB/sec execute 447 sec latency 3138.216 ms 2023-12-01T23:41:55.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2476 0.16 MB/sec execute 448 sec latency 3041.575 ms 2023-12-01T23:41:56.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2478 0.16 MB/sec execute 449 sec latency 2748.131 ms 2023-12-01T23:41:57.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2485 0.16 MB/sec execute 450 sec latency 2654.047 ms 2023-12-01T23:41:58.333 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2487 0.16 MB/sec execute 451 sec latency 2874.622 ms 2023-12-01T23:41:59.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2488 0.16 MB/sec execute 452 sec latency 3123.157 ms 2023-12-01T23:41:59.557 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:24:18.463 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.560 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:24:18.466 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.589 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:24:18.496 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.614 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:24:18.466 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.617 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:24:18.469 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.619 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:24:18.471 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.623 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:24:18.475 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.648 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:24:18.500 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:41:59.664 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:24:18.515 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:42:00.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2490 0.16 MB/sec execute 453 sec latency 3186.839 ms 2023-12-01T23:42:01.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2493 0.16 MB/sec execute 454 sec latency 3115.220 ms 2023-12-01T23:42:02.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2495 0.16 MB/sec execute 455 sec latency 3009.954 ms 2023-12-01T23:42:03.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2497 0.16 MB/sec execute 456 sec latency 2264.081 ms 2023-12-01T23:42:04.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2510 0.16 MB/sec execute 457 sec latency 2296.576 ms 2023-12-01T23:42:05.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2512 0.16 MB/sec execute 458 sec latency 2162.515 ms 2023-12-01T23:42:06.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2514 0.16 MB/sec execute 459 sec latency 2284.804 ms 2023-12-01T23:42:07.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2517 0.16 MB/sec execute 460 sec latency 2497.251 ms 2023-12-01T23:42:08.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2521 0.16 MB/sec execute 461 sec latency 2577.227 ms 2023-12-01T23:42:09.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2527 0.16 MB/sec execute 462 sec latency 2796.832 ms 2023-12-01T23:42:10.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2537 0.16 MB/sec execute 463 sec latency 2775.824 ms 2023-12-01T23:42:11.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:42:11.032 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:42:11.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2539 0.16 MB/sec execute 464 sec latency 2917.428 ms 2023-12-01T23:42:12.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2541 0.16 MB/sec execute 465 sec latency 2857.477 ms 2023-12-01T23:42:13.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2545 0.16 MB/sec execute 466 sec latency 2968.213 ms 2023-12-01T23:42:14.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2548 0.16 MB/sec execute 467 sec latency 2791.626 ms 2023-12-01T23:42:15.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2551 0.16 MB/sec execute 468 sec latency 2863.508 ms 2023-12-01T23:42:16.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2554 0.16 MB/sec execute 469 sec latency 2592.841 ms 2023-12-01T23:42:17.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2555 0.16 MB/sec execute 470 sec latency 2905.948 ms 2023-12-01T23:42:18.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2556 0.16 MB/sec execute 471 sec latency 2817.277 ms 2023-12-01T23:42:19.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2562 0.16 MB/sec execute 472 sec latency 2792.252 ms 2023-12-01T23:42:20.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2566 0.16 MB/sec execute 473 sec latency 2213.901 ms 2023-12-01T23:42:21.334 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2568 0.16 MB/sec execute 474 sec latency 2775.050 ms 2023-12-01T23:42:22.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2571 0.16 MB/sec execute 475 sec latency 2943.594 ms 2023-12-01T23:42:23.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2573 0.16 MB/sec execute 476 sec latency 2761.221 ms 2023-12-01T23:42:24.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2583 0.16 MB/sec execute 477 sec latency 2960.319 ms 2023-12-01T23:42:25.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2584 0.16 MB/sec execute 478 sec latency 2367.416 ms 2023-12-01T23:42:26.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2585 0.16 MB/sec execute 479 sec latency 2446.690 ms 2023-12-01T23:42:27.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2597 0.17 MB/sec execute 480 sec latency 2511.193 ms 2023-12-01T23:42:28.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2600 0.17 MB/sec execute 481 sec latency 2333.792 ms 2023-12-01T23:42:29.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2602 0.17 MB/sec execute 482 sec latency 2914.650 ms 2023-12-01T23:42:30.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2615 0.17 MB/sec execute 483 sec latency 2880.525 ms 2023-12-01T23:42:31.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2619 0.17 MB/sec execute 484 sec latency 2861.822 ms 2023-12-01T23:42:32.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2620 0.17 MB/sec execute 485 sec latency 2740.408 ms 2023-12-01T23:42:33.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2622 0.17 MB/sec execute 486 sec latency 2759.983 ms 2023-12-01T23:42:34.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2628 0.17 MB/sec execute 487 sec latency 2114.635 ms 2023-12-01T23:42:35.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2631 0.17 MB/sec execute 488 sec latency 2074.735 ms 2023-12-01T23:42:36.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2633 0.17 MB/sec execute 489 sec latency 3009.835 ms 2023-12-01T23:42:37.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2634 0.17 MB/sec execute 490 sec latency 3254.129 ms 2023-12-01T23:42:38.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2636 0.17 MB/sec execute 491 sec latency 2882.718 ms 2023-12-01T23:42:39.335 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2647 0.17 MB/sec execute 492 sec latency 2611.819 ms 2023-12-01T23:42:40.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2657 0.18 MB/sec execute 493 sec latency 2606.125 ms 2023-12-01T23:42:41.170 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:42:41.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:42:41.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2659 0.18 MB/sec execute 494 sec latency 2780.656 ms 2023-12-01T23:42:42.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2662 0.18 MB/sec execute 495 sec latency 2707.525 ms 2023-12-01T23:42:43.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2667 0.18 MB/sec execute 496 sec latency 2983.339 ms 2023-12-01T23:42:44.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2672 0.18 MB/sec execute 497 sec latency 2931.555 ms 2023-12-01T23:42:45.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2675 0.18 MB/sec execute 498 sec latency 2831.027 ms 2023-12-01T23:42:46.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2702 0.19 MB/sec execute 499 sec latency 2672.520 ms 2023-12-01T23:42:47.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2715 0.20 MB/sec execute 500 sec latency 2371.523 ms 2023-12-01T23:42:48.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2725 0.20 MB/sec execute 501 sec latency 2448.360 ms 2023-12-01T23:42:49.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2730 0.20 MB/sec execute 502 sec latency 2548.051 ms 2023-12-01T23:42:50.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2736 0.20 MB/sec execute 503 sec latency 2546.351 ms 2023-12-01T23:42:51.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2739 0.20 MB/sec execute 504 sec latency 2497.132 ms 2023-12-01T23:42:52.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2742 0.20 MB/sec execute 505 sec latency 2595.508 ms 2023-12-01T23:42:53.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2748 0.20 MB/sec execute 506 sec latency 2716.718 ms 2023-12-01T23:42:54.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2750 0.20 MB/sec execute 507 sec latency 2656.316 ms 2023-12-01T23:42:55.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2756 0.20 MB/sec execute 508 sec latency 2542.219 ms 2023-12-01T23:42:56.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2764 0.20 MB/sec execute 509 sec latency 2848.605 ms 2023-12-01T23:42:57.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2769 0.20 MB/sec execute 510 sec latency 2906.970 ms 2023-12-01T23:42:58.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2787 0.20 MB/sec execute 511 sec latency 2632.602 ms 2023-12-01T23:42:59.336 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2795 0.21 MB/sec execute 512 sec latency 2598.568 ms 2023-12-01T23:43:00.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2813 0.21 MB/sec execute 513 sec latency 2743.473 ms 2023-12-01T23:43:01.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2817 0.21 MB/sec execute 514 sec latency 2992.361 ms 2023-12-01T23:43:02.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2819 0.21 MB/sec execute 515 sec latency 2947.854 ms 2023-12-01T23:43:03.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2831 0.21 MB/sec execute 516 sec latency 2417.920 ms 2023-12-01T23:43:04.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2843 0.22 MB/sec execute 517 sec latency 2075.745 ms 2023-12-01T23:43:05.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2853 0.22 MB/sec execute 518 sec latency 2281.859 ms 2023-12-01T23:43:06.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2864 0.22 MB/sec execute 519 sec latency 2845.478 ms 2023-12-01T23:43:07.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2869 0.22 MB/sec execute 520 sec latency 2645.940 ms 2023-12-01T23:43:08.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2872 0.22 MB/sec execute 521 sec latency 2742.536 ms 2023-12-01T23:43:09.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2876 0.22 MB/sec execute 522 sec latency 2530.926 ms 2023-12-01T23:43:10.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2880 0.22 MB/sec execute 523 sec latency 3047.119 ms 2023-12-01T23:43:11.226 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:43:11.232 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:43:11.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2882 0.22 MB/sec execute 524 sec latency 3263.185 ms 2023-12-01T23:43:12.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2887 0.22 MB/sec execute 525 sec latency 3141.016 ms 2023-12-01T23:43:13.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2893 0.22 MB/sec execute 526 sec latency 2566.222 ms 2023-12-01T23:43:14.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2900 0.22 MB/sec execute 527 sec latency 2550.626 ms 2023-12-01T23:43:15.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2913 0.22 MB/sec execute 528 sec latency 2747.741 ms 2023-12-01T23:43:16.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2915 0.22 MB/sec execute 529 sec latency 2382.196 ms 2023-12-01T23:43:17.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2918 0.22 MB/sec execute 530 sec latency 2761.427 ms 2023-12-01T23:43:18.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2921 0.22 MB/sec execute 531 sec latency 2917.705 ms 2023-12-01T23:43:19.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2926 0.22 MB/sec execute 532 sec latency 2827.856 ms 2023-12-01T23:43:20.337 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2945 0.22 MB/sec execute 533 sec latency 2677.361 ms 2023-12-01T23:43:21.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2951 0.22 MB/sec execute 534 sec latency 2559.143 ms 2023-12-01T23:43:22.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2956 0.22 MB/sec execute 535 sec latency 2722.783 ms 2023-12-01T23:43:23.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2959 0.22 MB/sec execute 536 sec latency 2471.459 ms 2023-12-01T23:43:24.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2977 0.22 MB/sec execute 537 sec latency 2390.832 ms 2023-12-01T23:43:24.865 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:25:43.771 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.868 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:25:43.775 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.883 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:25:43.735 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.886 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:25:43.738 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.904 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:25:43.811 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.919 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:25:43.771 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.926 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:25:43.778 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.949 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:25:43.801 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:24.992 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:25:43.844 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:43:25.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2980 0.22 MB/sec execute 538 sec latency 2800.530 ms 2023-12-01T23:43:26.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2983 0.23 MB/sec execute 539 sec latency 3136.713 ms 2023-12-01T23:43:27.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 2999 0.23 MB/sec execute 540 sec latency 3236.340 ms 2023-12-01T23:43:28.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3002 0.23 MB/sec execute 541 sec latency 3326.479 ms 2023-12-01T23:43:29.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3008 0.23 MB/sec execute 542 sec latency 2591.715 ms 2023-12-01T23:43:30.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3011 0.23 MB/sec execute 543 sec latency 2109.731 ms 2023-12-01T23:43:31.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3015 0.23 MB/sec execute 544 sec latency 2957.109 ms 2023-12-01T23:43:32.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3020 0.23 MB/sec execute 545 sec latency 3343.154 ms 2023-12-01T23:43:33.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3024 0.23 MB/sec execute 546 sec latency 3479.246 ms 2023-12-01T23:43:34.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3027 0.23 MB/sec execute 547 sec latency 2760.616 ms 2023-12-01T23:43:35.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3031 0.23 MB/sec execute 548 sec latency 2606.187 ms 2023-12-01T23:43:36.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3033 0.23 MB/sec execute 549 sec latency 3046.726 ms 2023-12-01T23:43:37.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3053 0.23 MB/sec execute 550 sec latency 3271.047 ms 2023-12-01T23:43:38.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3075 0.23 MB/sec execute 551 sec latency 2829.450 ms 2023-12-01T23:43:39.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3078 0.23 MB/sec execute 552 sec latency 1965.744 ms 2023-12-01T23:43:40.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3080 0.23 MB/sec execute 553 sec latency 2856.666 ms 2023-12-01T23:43:41.307 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:43:41.309 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:43:41.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3085 0.23 MB/sec execute 554 sec latency 2950.866 ms 2023-12-01T23:43:42.338 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3091 0.23 MB/sec execute 555 sec latency 3025.918 ms 2023-12-01T23:43:43.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3106 0.23 MB/sec execute 556 sec latency 3085.992 ms 2023-12-01T23:43:44.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3123 0.23 MB/sec execute 557 sec latency 2753.843 ms 2023-12-01T23:43:45.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3124 0.23 MB/sec execute 558 sec latency 2624.550 ms 2023-12-01T23:43:46.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3126 0.23 MB/sec execute 559 sec latency 2559.059 ms 2023-12-01T23:43:47.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3144 0.23 MB/sec execute 560 sec latency 2698.876 ms 2023-12-01T23:43:48.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3151 0.23 MB/sec execute 561 sec latency 2962.278 ms 2023-12-01T23:43:49.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3157 0.23 MB/sec execute 562 sec latency 2935.364 ms 2023-12-01T23:43:50.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3160 0.23 MB/sec execute 563 sec latency 2997.639 ms 2023-12-01T23:43:51.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3163 0.23 MB/sec execute 564 sec latency 3068.163 ms 2023-12-01T23:43:52.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3169 0.23 MB/sec execute 565 sec latency 3102.333 ms 2023-12-01T23:43:53.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3173 0.23 MB/sec execute 566 sec latency 2707.623 ms 2023-12-01T23:43:54.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3189 0.23 MB/sec execute 567 sec latency 2594.238 ms 2023-12-01T23:43:55.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3194 0.23 MB/sec execute 568 sec latency 3078.457 ms 2023-12-01T23:43:56.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3199 0.23 MB/sec execute 569 sec latency 2031.000 ms 2023-12-01T23:43:57.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3204 0.23 MB/sec execute 570 sec latency 2925.772 ms 2023-12-01T23:43:58.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3209 0.24 MB/sec execute 571 sec latency 2930.655 ms 2023-12-01T23:43:59.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3213 0.24 MB/sec execute 572 sec latency 2659.101 ms 2023-12-01T23:44:00.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3218 0.24 MB/sec execute 573 sec latency 2521.352 ms 2023-12-01T23:44:01.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3245 0.24 MB/sec execute 574 sec latency 2479.283 ms 2023-12-01T23:44:02.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3246 0.24 MB/sec execute 575 sec latency 2476.489 ms 2023-12-01T23:44:03.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3248 0.24 MB/sec execute 576 sec latency 2573.596 ms 2023-12-01T23:44:04.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3251 0.24 MB/sec execute 577 sec latency 2484.762 ms 2023-12-01T23:44:05.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3253 0.24 MB/sec execute 578 sec latency 2476.797 ms 2023-12-01T23:44:06.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3258 0.24 MB/sec execute 579 sec latency 2958.245 ms 2023-12-01T23:44:07.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3262 0.24 MB/sec execute 580 sec latency 2840.980 ms 2023-12-01T23:44:08.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3263 0.24 MB/sec execute 581 sec latency 2796.024 ms 2023-12-01T23:44:09.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3267 0.24 MB/sec execute 582 sec latency 2186.866 ms 2023-12-01T23:44:10.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3269 0.24 MB/sec execute 583 sec latency 2526.037 ms 2023-12-01T23:44:11.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3273 0.24 MB/sec execute 584 sec latency 2671.430 ms 2023-12-01T23:44:11.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:44:11.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:44:12.339 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3280 0.24 MB/sec execute 585 sec latency 2721.889 ms 2023-12-01T23:44:13.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3281 0.24 MB/sec execute 586 sec latency 2674.779 ms 2023-12-01T23:44:14.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3283 0.24 MB/sec execute 587 sec latency 2385.569 ms 2023-12-01T23:44:15.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3283 0.24 MB/sec execute 588 sec latency 2069.079 ms 2023-12-01T23:44:16.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3284 0.24 MB/sec execute 589 sec latency 2022.682 ms 2023-12-01T23:44:17.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3286 0.24 MB/sec execute 590 sec latency 2170.793 ms 2023-12-01T23:44:18.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3287 0.24 MB/sec execute 591 sec latency 2396.843 ms 2023-12-01T23:44:19.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3288 0.24 MB/sec execute 592 sec latency 2357.803 ms 2023-12-01T23:44:20.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3288 0.24 MB/sec execute 593 sec latency 2173.406 ms 2023-12-01T23:44:21.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3289 0.24 MB/sec execute 594 sec latency 2448.736 ms 2023-12-01T23:44:22.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3290 0.24 MB/sec execute 595 sec latency 2437.641 ms 2023-12-01T23:44:23.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3290 0.24 MB/sec execute 596 sec latency 2284.682 ms 2023-12-01T23:44:24.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3291 0.24 MB/sec execute 597 sec latency 2146.707 ms 2023-12-01T23:44:25.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3292 0.23 MB/sec execute 598 sec latency 2190.518 ms 2023-12-01T23:44:26.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 3293 0.23 MB/sec execute 599 sec latency 2043.078 ms 2023-12-01T23:44:27.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 600 sec 2023-12-01T23:44:28.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 601 sec 2023-12-01T23:44:29.340 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 602 sec 2023-12-01T23:44:30.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 603 sec 2023-12-01T23:44:31.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 604 sec 2023-12-01T23:44:32.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 605 sec 2023-12-01T23:44:33.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 606 sec 2023-12-01T23:44:34.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 607 sec 2023-12-01T23:44:35.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 608 sec 2023-12-01T23:44:36.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 609 sec 2023-12-01T23:44:37.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 610 sec 2023-12-01T23:44:38.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 611 sec 2023-12-01T23:44:38.427 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:26:57.334 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.434 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:26:57.340 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.440 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:26:57.292 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.441 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:26:57.293 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.442 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:26:57.294 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.444 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:26:57.296 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.478 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:26:57.384 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.487 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:26:57.339 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:38.487 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:26:57.339 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:44:39.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 612 sec 2023-12-01T23:44:40.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 613 sec 2023-12-01T23:44:41.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 614 sec 2023-12-01T23:44:41.695 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:44:41.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:44:42.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 615 sec 2023-12-01T23:44:43.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 616 sec 2023-12-01T23:44:44.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 617 sec 2023-12-01T23:44:45.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 618 sec 2023-12-01T23:44:46.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 619 sec 2023-12-01T23:44:47.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 620 sec 2023-12-01T23:44:48.341 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 621 sec 2023-12-01T23:44:49.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 622 sec 2023-12-01T23:44:50.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 623 sec 2023-12-01T23:44:51.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 624 sec 2023-12-01T23:44:52.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 625 sec 2023-12-01T23:44:53.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 626 sec 2023-12-01T23:44:54.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 627 sec 2023-12-01T23:44:55.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 628 sec 2023-12-01T23:44:56.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 629 sec 2023-12-01T23:44:57.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 630 sec 2023-12-01T23:44:58.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 631 sec 2023-12-01T23:44:59.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 632 sec 2023-12-01T23:45:00.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 633 sec 2023-12-01T23:45:01.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 634 sec 2023-12-01T23:45:02.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 635 sec 2023-12-01T23:45:03.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 636 sec 2023-12-01T23:45:04.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 637 sec 2023-12-01T23:45:05.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 638 sec 2023-12-01T23:45:06.342 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 639 sec 2023-12-01T23:45:07.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 640 sec 2023-12-01T23:45:08.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 641 sec 2023-12-01T23:45:09.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 642 sec 2023-12-01T23:45:10.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 643 sec 2023-12-01T23:45:11.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 644 sec 2023-12-01T23:45:11.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:45:11.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:45:12.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 645 sec 2023-12-01T23:45:13.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 646 sec 2023-12-01T23:45:14.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 647 sec 2023-12-01T23:45:15.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 648 sec 2023-12-01T23:45:16.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 649 sec 2023-12-01T23:45:17.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 650 sec 2023-12-01T23:45:18.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 651 sec 2023-12-01T23:45:19.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 652 sec 2023-12-01T23:45:20.344 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 653 sec 2023-12-01T23:45:21.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 654 sec 2023-12-01T23:45:22.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 655 sec 2023-12-01T23:45:23.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 656 sec 2023-12-01T23:45:24.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 657 sec 2023-12-01T23:45:25.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 658 sec 2023-12-01T23:45:26.343 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 659 sec 2023-12-01T23:45:27.344 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 660 sec 2023-12-01T23:45:28.345 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 661 sec 2023-12-01T23:45:29.344 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 662 sec 2023-12-01T23:45:30.344 INFO:tasks.workunit.client.0.smithi096.stdout: 10 cleanup 663 sec 2023-12-01T23:45:31.344 INFO:tasks.workunit.client.0.smithi096.stdout: 9 cleanup 664 sec 2023-12-01T23:45:32.344 INFO:tasks.workunit.client.0.smithi096.stdout: 8 cleanup 665 sec 2023-12-01T23:45:33.344 INFO:tasks.workunit.client.0.smithi096.stdout: 8 cleanup 666 sec 2023-12-01T23:45:34.344 INFO:tasks.workunit.client.0.smithi096.stdout: 8 cleanup 667 sec 2023-12-01T23:45:35.344 INFO:tasks.workunit.client.0.smithi096.stdout: 8 cleanup 668 sec 2023-12-01T23:45:36.344 INFO:tasks.workunit.client.0.smithi096.stdout: 6 cleanup 669 sec 2023-12-01T23:45:37.344 INFO:tasks.workunit.client.0.smithi096.stdout: 2 cleanup 670 sec 2023-12-01T23:45:37.851 INFO:tasks.workunit.client.0.smithi096.stdout: 0 cleanup 671 sec 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Operation Count AvgLat MaxLat 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: ---------------------------------------- 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: NTCreateX 3927 290.078 1868.997 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Close 3226 2.846 61.720 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Rename 209 810.530 1613.617 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Unlink 466 263.736 1060.880 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Qpathinfo 4014 184.832 1850.762 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Qfileinfo 854 5.744 59.564 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Qfsinfo 574 19.429 98.311 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Sfileinfo 453 40.001 140.181 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: Find 1397 2634.798 5009.007 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: WriteX 2398 12.758 407.802 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: ReadX 7750 0.072 43.094 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: LockX 20 143.113 255.577 2023-12-01T23:45:37.852 INFO:tasks.workunit.client.0.smithi096.stdout: UnlockX 20 131.297 228.312 2023-12-01T23:45:37.853 INFO:tasks.workunit.client.0.smithi096.stdout: Flush 302 259.534 859.434 2023-12-01T23:45:37.853 INFO:tasks.workunit.client.0.smithi096.stdout: 2023-12-01T23:45:37.853 INFO:tasks.workunit.client.0.smithi096.stdout:Throughput 0.234472 MB/sec 10 clients 10 procs max_latency=5009.011 ms 2023-12-01T23:45:37.853 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-01T23:45:37.853 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-01T23:45:41.951 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:45:41.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:45:59.475 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-12-01T23:45:59.475 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-01T23:45:59.738 DEBUG:teuthology.parallel:result is None 2023-12-01T23:45:59.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-01T23:45:59.925 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-01T23:45:59.925 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-01T23:45:59.934 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-01T23:45:59.934 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:45:59.934 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T23:45:59.950 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:45:59.950 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T23:46:00.006 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:46:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.144+0000 7fa703d48640 1 Processor -- start 2023-12-01T23:46:00.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.144+0000 7fa703d48640 1 -- start start 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.145+0000 7fa703d48640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa6fc071c40 0x7fa6fc070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.145+0000 7fa703d48640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.145+0000 7fa703d48640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc071420 con 0x7fa6fc14fd70 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.145+0000 7fa703d48640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc155b20 con 0x7fa6fc071c40 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.145+0000 7fa703d48640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc15a0c0 con 0x7fa6fc159760 2023-12-01T23:46:00.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.146+0000 7fa7022e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.146+0000 7fa7022e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:42288/0 (socket says 172.21.15.96:42288) 2023-12-01T23:46:00.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.146+0000 7fa7022e5640 1 -- 172.21.15.96:0/3112719225 learned_addr learned my addr 172.21.15.96:0/3112719225 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.148+0000 7fa7022e5640 1 -- 172.21.15.96:0/3112719225 >> v2:172.21.15.96:3300/0 conn(0x7fa6fc071c40 msgr2=0x7fa6fc070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.148+0000 7fa7022e5640 1 --2- 172.21.15.96:0/3112719225 >> v2:172.21.15.96:3300/0 conn(0x7fa6fc071c40 0x7fa6fc070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.148+0000 7fa7022e5640 1 -- 172.21.15.96:0/3112719225 >> v1:172.21.15.96:6789/0 conn(0x7fa6fc14fd70 legacy=0x7fa6fc0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:00.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.148+0000 7fa7022e5640 1 -- 172.21.15.96:0/3112719225 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc1592d0 con 0x7fa6fc159760 2023-12-01T23:46:00.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.150+0000 7fa7022e5640 1 --2- 172.21.15.96:0/3112719225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b0640 tx=0x7fa6f802cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f124848c6465ff9a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa700ae2640 1 -- 172.21.15.96:0/3112719225 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f802d840 con 0x7fa6fc159760 2023-12-01T23:46:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa700ae2640 1 -- 172.21.15.96:0/3112719225 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f802d9a0 con 0x7fa6fc159760 2023-12-01T23:46:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa700ae2640 1 -- 172.21.15.96:0/3112719225 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f802dd30 con 0x7fa6fc159760 2023-12-01T23:46:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 -- 172.21.15.96:0/3112719225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 msgr2=0x7fa6fc159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 --2- 172.21.15.96:0/3112719225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0b0640 tx=0x7fa6f802cea0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 -- 172.21.15.96:0/3112719225 shutdown_connections 2023-12-01T23:46:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 --2- 172.21.15.96:0/3112719225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc159760 0x7fa6fc159b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 --2- 172.21.15.96:0/3112719225 >> v2:172.21.15.96:3300/0 conn(0x7fa6fc071c40 0x7fa6fc070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.157+0000 7fa703d48640 1 -- 172.21.15.96:0/3112719225 >> 172.21.15.96:0/3112719225 conn(0x7fa6fc06cd60 msgr2=0x7fa6fc06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.158+0000 7fa703d48640 1 -- 172.21.15.96:0/3112719225 shutdown_connections 2023-12-01T23:46:00.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.158+0000 7fa703d48640 1 -- 172.21.15.96:0/3112719225 wait complete. 2023-12-01T23:46:00.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.159+0000 7fa703d48640 1 Processor -- start 2023-12-01T23:46:00.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.159+0000 7fa703d48640 1 -- start start 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc071c40 0x7fa6fc145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6fc14fd70 0x7fa6fc0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc1ebd70 con 0x7fa6fc14fd70 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0cb3c0 con 0x7fa6fc159760 2023-12-01T23:46:00.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa703d48640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc152210 con 0x7fa6fc071c40 2023-12-01T23:46:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa7022e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.161+0000 7fa701ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc071c40 0x7fa6fc145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.162+0000 7fa7022e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37850/0 (socket says 172.21.15.96:37850) 2023-12-01T23:46:00.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.162+0000 7fa7022e5640 1 -- 172.21.15.96:0/1282349636 learned_addr learned my addr 172.21.15.96:0/1282349636 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:00.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.165+0000 7fa7022e5640 1 -- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc071c40 msgr2=0x7fa6fc145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.165+0000 7fa7022e5640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc071c40 0x7fa6fc145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.165+0000 7fa7022e5640 1 -- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6fc14fd70 msgr2=0x7fa6fc0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.165+0000 7fa7022e5640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6fc14fd70 0x7fa6fc0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.165+0000 7fa7022e5640 1 -- 172.21.15.96:0/1282349636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f800ac40 con 0x7fa6fc159760 2023-12-01T23:46:00.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.168+0000 7fa7022e5640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa6f802d4b0 tx=0x7fa6f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.172+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8008ac0 con 0x7fa6fc159760 2023-12-01T23:46:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.172+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f8008c40 con 0x7fa6fc159760 2023-12-01T23:46:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.172+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f803f450 con 0x7fa6fc159760 2023-12-01T23:46:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.172+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc1eb0f0 con 0x7fa6fc159760 2023-12-01T23:46:00.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.172+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc1eb6b0 con 0x7fa6fc159760 2023-12-01T23:46:00.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.173+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc067500 con 0x7fa6fc159760 2023-12-01T23:46:00.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.439+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6f803f5d0 con 0x7fa6fc159760 2023-12-01T23:46:00.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.439+0000 7fa6f27fc640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 0x7fa6e006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.439+0000 7fa701ae4640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 0x7fa6e006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.440+0000 7fa701ae4640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 0x7fa6e006d350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40017f0 tx=0x7fa6f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.442+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6f8041e70 con 0x7fa6fc159760 2023-12-01T23:46:00.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.455+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6f8077900 con 0x7fa6fc159760 2023-12-01T23:46:00.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.626+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6fc071420 con 0x7fa6fc159760 2023-12-01T23:46:00.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.665+0000 7fa6f27fc640 1 -- 172.21.15.96:0/1282349636 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fa6fc071420 con 0x7fa6fc159760 2023-12-01T23:46:00.666 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:00.666 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:46:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 msgr2=0x7fa6e006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 0x7fa6e006d350 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40017f0 tx=0x7fa6f4009040 comp rx=0 tx=0).stop 2023-12-01T23:46:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 msgr2=0x7fa6fc0c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa6f802d4b0 tx=0x7fa6f8004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 shutdown_connections 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa6e006ae90 0x7fa6e006d350 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6fc159760 0x7fa6fc0c9d30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6fc14fd70 0x7fa6fc0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 --2- 172.21.15.96:0/1282349636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6fc071c40 0x7fa6fc145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 >> 172.21.15.96:0/1282349636 conn(0x7fa6fc06cd60 msgr2=0x7fa6fc0c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 shutdown_connections 2023-12-01T23:46:00.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.666+0000 7fa703d48640 1 -- 172.21.15.96:0/1282349636 wait complete. 2023-12-01T23:46:00.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:46:00.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:46:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.781+0000 7f40236c2640 1 Processor -- start 2023-12-01T23:46:00.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.781+0000 7f40236c2640 1 -- start start 2023-12-01T23:46:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.782+0000 7f40236c2640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f401c153890 0x7f401c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.782+0000 7f40236c2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 0x7f401c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.782+0000 7f40236c2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c15a700 con 0x7f401c153c70 2023-12-01T23:46:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.782+0000 7f40236c2640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c0cf840 con 0x7f401c153890 2023-12-01T23:46:00.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.782+0000 7f40236c2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c0ca870 con 0x7f401c0ceef0 2023-12-01T23:46:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.783+0000 7f4021c5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 0x7f401c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.783+0000 7f402145e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f401c153890 0x7f401c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.783+0000 7f4021c5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 0x7f401c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37856/0 (socket says 172.21.15.96:37856) 2023-12-01T23:46:00.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.783+0000 7f4021c5f640 1 -- 172.21.15.96:0/2345430250 learned_addr learned my addr 172.21.15.96:0/2345430250 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.786+0000 7f402145e640 1 -- 172.21.15.96:0/2345430250 >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 msgr2=0x7f401c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.786+0000 7f402145e640 1 --2- 172.21.15.96:0/2345430250 >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 0x7f401c0cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.786+0000 7f402145e640 1 -- 172.21.15.96:0/2345430250 >> v1:172.21.15.102:6789/0 conn(0x7f401c153c70 legacy=0x7f401c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:00.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.786+0000 7f402145e640 1 -- 172.21.15.96:0/2345430250 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c159af0 con 0x7f401c153890 2023-12-01T23:46:00.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.787+0000 7f402145e640 1 --2- 172.21.15.96:0/2345430250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c153890 0x7f401c15d950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f401c0c9ab0 tx=0x7f401802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd59ccd23000267 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.791+0000 7f4013fff640 1 -- 172.21.15.96:0/2345430250 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401802cc80 con 0x7f401c153890 2023-12-01T23:46:00.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.791+0000 7f4013fff640 1 -- 172.21.15.96:0/2345430250 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401802cde0 con 0x7f401c153890 2023-12-01T23:46:00.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.791+0000 7f4013fff640 1 -- 172.21.15.96:0/2345430250 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018034660 con 0x7f401c153890 2023-12-01T23:46:00.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 -- 172.21.15.96:0/2345430250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c153890 msgr2=0x7f401c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 --2- 172.21.15.96:0/2345430250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c153890 0x7f401c15d950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f401c0c9ab0 tx=0x7f401802bed0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 -- 172.21.15.96:0/2345430250 shutdown_connections 2023-12-01T23:46:00.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 --2- 172.21.15.96:0/2345430250 >> v2:172.21.15.102:3300/0 conn(0x7f401c0ceef0 0x7f401c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 --2- 172.21.15.96:0/2345430250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c153890 0x7f401c15d950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 -- 172.21.15.96:0/2345430250 >> 172.21.15.96:0/2345430250 conn(0x7f401c06ba00 msgr2=0x7f401c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:00.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 -- 172.21.15.96:0/2345430250 shutdown_connections 2023-12-01T23:46:00.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.792+0000 7f40236c2640 1 -- 172.21.15.96:0/2345430250 wait complete. 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.793+0000 7f40236c2640 1 Processor -- start 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.793+0000 7f40236c2640 1 -- start start 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f401c153890 0x7f401c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f401c153c70 0x7f401c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1552d0 con 0x7f401c0ceef0 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c143850 con 0x7f401c153c70 2023-12-01T23:46:00.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f40236c2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0b4100 con 0x7f401c153890 2023-12-01T23:46:00.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.794+0000 7f402145e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.795+0000 7f402145e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43666/0 (socket says 172.21.15.96:43666) 2023-12-01T23:46:00.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.795+0000 7f402145e640 1 -- 172.21.15.96:0/2956423748 learned_addr learned my addr 172.21.15.96:0/2956423748 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:00.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.795+0000 7f4021c5f640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f401c153c70 0x7f401c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.795+0000 7f4020c5d640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f401c153890 0x7f401c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.798+0000 7f402145e640 1 -- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f401c153890 msgr2=0x7f401c0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.798+0000 7f402145e640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f401c153890 0x7f401c0c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.798+0000 7f402145e640 1 -- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f401c153c70 msgr2=0x7f401c1556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:00.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.798+0000 7f402145e640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f401c153c70 0x7f401c1556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:00.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.798+0000 7f402145e640 1 -- 172.21.15.96:0/2956423748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4018009a70 con 0x7f401c0ceef0 2023-12-01T23:46:00.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.801+0000 7f402145e640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4018037040 tx=0x7f4018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.804+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018040650 con 0x7f401c0ceef0 2023-12-01T23:46:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.804+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40180407d0 con 0x7f401c0ceef0 2023-12-01T23:46:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.804+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018040b80 con 0x7f401c0ceef0 2023-12-01T23:46:00.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.804+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c0b43c0 con 0x7f401c0ceef0 2023-12-01T23:46:00.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.805+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c0b4750 con 0x7f401c0ceef0 2023-12-01T23:46:00.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.806+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c155410 con 0x7f401c0ceef0 2023-12-01T23:46:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.829+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4018040ce0 con 0x7f401c0ceef0 2023-12-01T23:46:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.829+0000 7f4011ffb640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 0x7f400006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.829+0000 7f4020c5d640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 0x7f400006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.829+0000 7f4020c5d640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 0x7f400006d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f401c158c50 tx=0x7f400c007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:00.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:00.832+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f401807b460 con 0x7f401c0ceef0 2023-12-01T23:46:01.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.068+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40180777a0 con 0x7f401c0ceef0 2023-12-01T23:46:01.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.241+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f401c155410 con 0x7f401c0ceef0 2023-12-01T23:46:01.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.246+0000 7f4011ffb640 1 -- 172.21.15.96:0/2956423748 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f401c155410 con 0x7f401c0ceef0 2023-12-01T23:46:01.247 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 msgr2=0x7f400006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 0x7f400006d380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f401c158c50 tx=0x7f400c007e30 comp rx=0 tx=0).stop 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 msgr2=0x7f401c0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4018037040 tx=0x7f4018004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 shutdown_connections 2023-12-01T23:46:01.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f400006aec0 0x7f400006d380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f401c153c70 0x7f401c1556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f401c153890 0x7f401c0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 --2- 172.21.15.96:0/2956423748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f401c0ceef0 0x7f401c0c52c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 >> 172.21.15.96:0/2956423748 conn(0x7f401c06ba00 msgr2=0x7f401c15b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 shutdown_connections 2023-12-01T23:46:01.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.249+0000 7f40236c2640 1 -- 172.21.15.96:0/2956423748 wait complete. 2023-12-01T23:46:01.261 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:46:01.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.367+0000 7f37852a6640 1 Processor -- start 2023-12-01T23:46:01.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.367+0000 7f37852a6640 1 -- start start 2023-12-01T23:46:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f37852a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37800c2bd0 0x7f378006f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f37852a6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37800c2fb0 0x7f3780159850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f37852a6640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37801593c0 con 0x7f378006fd30 2023-12-01T23:46:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f37852a6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3780061630 con 0x7f37800c2fb0 2023-12-01T23:46:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f37852a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800c3460 con 0x7f37800c2bd0 2023-12-01T23:46:01.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.368+0000 7f3777fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f37800c2fb0 0x7f3780159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.369+0000 7f377effd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37800c2bd0 0x7f378006f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.369+0000 7f377f7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f378006fd30 0x7f3780060f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33560/0 (socket says 172.21.15.96:33560) 2023-12-01T23:46:01.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.369+0000 7f377f7fe640 1 -- 172.21.15.96:0/2483831933 learned_addr learned my addr 172.21.15.96:0/2483831933 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.372+0000 7f3777fff640 1 -- 172.21.15.96:0/2483831933 >> v2:172.21.15.102:3300/0 conn(0x7f37800c2bd0 msgr2=0x7f378006f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.372+0000 7f3777fff640 1 --2- 172.21.15.96:0/2483831933 >> v2:172.21.15.102:3300/0 conn(0x7f37800c2bd0 0x7f378006f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.372+0000 7f3777fff640 1 -- 172.21.15.96:0/2483831933 >> v1:172.21.15.96:6789/0 conn(0x7f378006fd30 legacy=0x7f3780060f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.372+0000 7f3777fff640 1 -- 172.21.15.96:0/2483831933 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780156070 con 0x7f37800c2fb0 2023-12-01T23:46:01.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.375+0000 7f3777fff640 1 --2- 172.21.15.96:0/2483831933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37800c2fb0 0x7f3780159850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37800c7ec0 tx=0x7f376802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a2fa7a2549823f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:01.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.380+0000 7f377e7fc640 1 -- 172.21.15.96:0/2483831933 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768030610 con 0x7f37800c2fb0 2023-12-01T23:46:01.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.380+0000 7f377e7fc640 1 -- 172.21.15.96:0/2483831933 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768030770 con 0x7f37800c2fb0 2023-12-01T23:46:01.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.380+0000 7f377e7fc640 1 -- 172.21.15.96:0/2483831933 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768030b00 con 0x7f37800c2fb0 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 -- 172.21.15.96:0/2483831933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37800c2fb0 msgr2=0x7f3780159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 --2- 172.21.15.96:0/2483831933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37800c2fb0 0x7f3780159850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f37800c7ec0 tx=0x7f376802b960 comp rx=0 tx=0).stop 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 -- 172.21.15.96:0/2483831933 shutdown_connections 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 --2- 172.21.15.96:0/2483831933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f37800c2fb0 0x7f3780159850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 --2- 172.21.15.96:0/2483831933 >> v2:172.21.15.102:3300/0 conn(0x7f37800c2bd0 0x7f378006f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 -- 172.21.15.96:0/2483831933 >> 172.21.15.96:0/2483831933 conn(0x7f37800c7f60 msgr2=0x7f37800c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 -- 172.21.15.96:0/2483831933 shutdown_connections 2023-12-01T23:46:01.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.381+0000 7f37852a6640 1 -- 172.21.15.96:0/2483831933 wait complete. 2023-12-01T23:46:01.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.382+0000 7f37852a6640 1 Processor -- start 2023-12-01T23:46:01.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.382+0000 7f37852a6640 1 -- start start 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37800c2bd0 0x7f37801f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37800c2fb0 0x7f3780145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37801f1540 con 0x7f378006fd30 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378014da70 con 0x7f37800c2fb0 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f37852a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37801f0ca0 con 0x7f37800c2bd0 2023-12-01T23:46:01.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f377effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f377f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37800c2fb0 0x7f3780145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.383+0000 7f3777fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37800c2bd0 0x7f37801f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.384+0000 7f377effd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43686/0 (socket says 172.21.15.96:43686) 2023-12-01T23:46:01.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.384+0000 7f377effd640 1 -- 172.21.15.96:0/1077105948 learned_addr learned my addr 172.21.15.96:0/1077105948 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.387+0000 7f377effd640 1 -- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37800c2bd0 msgr2=0x7f37801f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.387+0000 7f377effd640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37800c2bd0 0x7f37801f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.387+0000 7f377effd640 1 -- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37800c2fb0 msgr2=0x7f3780145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.387+0000 7f377effd640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37800c2fb0 0x7f3780145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.387+0000 7f377effd640 1 -- 172.21.15.96:0/1077105948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009400 con 0x7f378006fd30 2023-12-01T23:46:01.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.389+0000 7f377effd640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f377000e9b0 tx=0x7f377000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:01.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.392+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770009670 con 0x7f378006fd30 2023-12-01T23:46:01.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.392+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377000c9a0 con 0x7f378006fd30 2023-12-01T23:46:01.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.392+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000cd50 con 0x7f378006fd30 2023-12-01T23:46:01.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.392+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37801f0f80 con 0x7f378006fd30 2023-12-01T23:46:01.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.393+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378014d700 con 0x7f378006fd30 2023-12-01T23:46:01.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.393+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378014d560 con 0x7f378006fd30 2023-12-01T23:46:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.642+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3770013470 con 0x7f378006fd30 2023-12-01T23:46:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.643+0000 7f37777fe640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.643+0000 7f3777fff640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.643+0000 7f3777fff640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 0x7f376006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3768036000 tx=0x7f376803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:01.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.668+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3770058c60 con 0x7f378006fd30 2023-12-01T23:46:01.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.668+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3770054fa0 con 0x7f378006fd30 2023-12-01T23:46:01.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.836+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f378014d560 con 0x7f378006fd30 2023-12-01T23:46:01.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.841+0000 7f37777fe640 1 -- 172.21.15.96:0/1077105948 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3770021020 con 0x7f378006fd30 2023-12-01T23:46:01.842 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 msgr2=0x7f376006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 0x7f376006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3768036000 tx=0x7f376803b040 comp rx=0 tx=0).stop 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 msgr2=0x7f37801ed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f377000e9b0 tx=0x7f377000ee70 comp rx=0 tx=0).stop 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 shutdown_connections 2023-12-01T23:46:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f376006ae70 0x7f376006d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37800c2fb0 0x7f3780145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37800c2bd0 0x7f37801f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 --2- 172.21.15.96:0/1077105948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f378006fd30 0x7f37801ed020 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 >> 172.21.15.96:0/1077105948 conn(0x7f37800c7f60 msgr2=0x7f378006f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 shutdown_connections 2023-12-01T23:46:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.843+0000 7f37852a6640 1 -- 172.21.15.96:0/1077105948 wait complete. 2023-12-01T23:46:01.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:46:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.958+0000 7f1bfa17c640 1 Processor -- start 2023-12-01T23:46:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.958+0000 7f1bfa17c640 1 -- start start 2023-12-01T23:46:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.958+0000 7f1bfa17c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1bf40c4de0 0x7f1bf406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bfa17c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf40c7dd0 con 0x7f1bf40c51c0 2023-12-01T23:46:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bfa17c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf4158640 con 0x7f1bf406f940 2023-12-01T23:46:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bfa17c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf406ec40 con 0x7f1bf40c4de0 2023-12-01T23:46:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bf3fff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f1bf40c51c0 0x7f1bf4161fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33568/0 (socket says 172.21.15.96:33568) 2023-12-01T23:46:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bf3fff640 1 -- 172.21.15.96:0/2313494628 learned_addr learned my addr 172.21.15.96:0/2313494628 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:01.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.959+0000 7f1bf37fe640 1 --2- 172.21.15.96:0/2313494628 >> v2:172.21.15.102:3300/0 conn(0x7f1bf40c4de0 0x7f1bf406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.961+0000 7f1bf27fc640 1 -- 172.21.15.96:0/2313494628 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198517609 0 0) 0x7f1bf40c7dd0 con 0x7f1bf40c51c0 2023-12-01T23:46:01.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.962+0000 7f1bf27fc640 1 -- 172.21.15.96:0/2313494628 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bdc003520 con 0x7f1bf40c51c0 2023-12-01T23:46:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.962+0000 7f1bf37fe640 1 -- 172.21.15.96:0/2313494628 >> v1:172.21.15.102:6789/0 conn(0x7f1bf406f940 legacy=0x7f1bf41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.962+0000 7f1bf37fe640 1 -- 172.21.15.96:0/2313494628 >> v1:172.21.15.96:6789/0 conn(0x7f1bf40c51c0 legacy=0x7f1bf4161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.962+0000 7f1bf37fe640 1 -- 172.21.15.96:0/2313494628 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf406a8b0 con 0x7f1bf40c4de0 2023-12-01T23:46:01.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.967+0000 7f1bf37fe640 1 --2- 172.21.15.96:0/2313494628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf406f400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1be40097a0 tx=0x7f1be402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f416aa1b279cc950 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.971+0000 7f1bf27fc640 1 -- 172.21.15.96:0/2313494628 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4030610 con 0x7f1bf40c4de0 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.971+0000 7f1bf27fc640 1 -- 172.21.15.96:0/2313494628 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4030770 con 0x7f1bf40c4de0 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.971+0000 7f1bf27fc640 1 -- 172.21.15.96:0/2313494628 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4030b00 con 0x7f1bf40c4de0 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 -- 172.21.15.96:0/2313494628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 msgr2=0x7f1bf406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/2313494628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf406f400 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1be40097a0 tx=0x7f1be402b960 comp rx=0 tx=0).stop 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 -- 172.21.15.96:0/2313494628 shutdown_connections 2023-12-01T23:46:01.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/2313494628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf406f400 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 -- 172.21.15.96:0/2313494628 >> 172.21.15.96:0/2313494628 conn(0x7f1bf40c7f60 msgr2=0x7f1bf40c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:01.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 -- 172.21.15.96:0/2313494628 shutdown_connections 2023-12-01T23:46:01.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.972+0000 7f1bfa17c640 1 -- 172.21.15.96:0/2313494628 wait complete. 2023-12-01T23:46:01.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.973+0000 7f1bfa17c640 1 Processor -- start 2023-12-01T23:46:01.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.973+0000 7f1bfa17c640 1 -- start start 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1bf40c51c0 0x7f1bf4072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415ae80 con 0x7f1bf406f940 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415b120 con 0x7f1bf40c4de0 2023-12-01T23:46:01.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bfa17c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415baf0 con 0x7f1bf40c51c0 2023-12-01T23:46:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.974+0000 7f1bf37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.975+0000 7f1bf2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.975+0000 7f1bf3fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1bf40c51c0 0x7f1bf4072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.975+0000 7f1bf37fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43688/0 (socket says 172.21.15.96:43688) 2023-12-01T23:46:01.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.975+0000 7f1bf37fe640 1 -- 172.21.15.96:0/1019539339 learned_addr learned my addr 172.21.15.96:0/1019539339 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:01.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.978+0000 7f1bf37fe640 1 -- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1bf40c51c0 msgr2=0x7f1bf4072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.978+0000 7f1bf37fe640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1bf40c51c0 0x7f1bf4072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.978+0000 7f1bf37fe640 1 -- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 msgr2=0x7f1bf415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:01.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.978+0000 7f1bf37fe640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:01.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.978+0000 7f1bf37fe640 1 -- 172.21.15.96:0/1019539339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be4009400 con 0x7f1bf406f940 2023-12-01T23:46:01.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.981+0000 7f1bf37fe640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1be40098c0 tx=0x7f1be4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.984+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be403e040 con 0x7f1bf406f940 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.984+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4039bb0 con 0x7f1bf406f940 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.984+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf41599b0 con 0x7f1bf406f940 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.984+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40443f0 con 0x7f1bf406f940 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.984+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf4159f70 con 0x7f1bf406f940 2023-12-01T23:46:01.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:01.986+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf406a560 con 0x7f1bf406f940 2023-12-01T23:46:02.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.004+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1be404d3b0 con 0x7f1bf406f940 2023-12-01T23:46:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.005+0000 7f1bdbfff640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.005+0000 7f1bf2ffd640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.005+0000 7f1bf2ffd640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 0x7f1be006d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4144ce0 tx=0x7f1be8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:02.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.244+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1be407acd0 con 0x7f1bf406f940 2023-12-01T23:46:02.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.244+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1be4077010 con 0x7f1bf406f940 2023-12-01T23:46:02.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.422+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bf40674e0 con 0x7f1bf406f940 2023-12-01T23:46:02.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.427+0000 7f1bdbfff640 1 -- 172.21.15.96:0/1019539339 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1be4049020 con 0x7f1bf406f940 2023-12-01T23:46:02.428 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:46:02.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 msgr2=0x7f1be006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 0x7f1be006d350 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4144ce0 tx=0x7f1be8009040 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 msgr2=0x7f1bf41e1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1be40098c0 tx=0x7f1be4004730 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 shutdown_connections 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1be006ae90 0x7f1be006d350 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1bf40c51c0 0x7f1bf4072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bf40c4de0 0x7f1bf415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 --2- 172.21.15.96:0/1019539339 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1bf406f940 0x7f1bf41e1ac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 >> 172.21.15.96:0/1019539339 conn(0x7f1bf40c7f60 msgr2=0x7f1bf4156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 shutdown_connections 2023-12-01T23:46:02.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.429+0000 7f1bfa17c640 1 -- 172.21.15.96:0/1019539339 wait complete. 2023-12-01T23:46:02.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:46:02.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.544+0000 7f8493bf1640 1 Processor -- start 2023-12-01T23:46:02.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.544+0000 7f8493bf1640 1 -- start start 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f8493bf1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f848c151690 0x7f848c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f8493bf1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f848c0c6050 0x7f848c0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f8493bf1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c0c58e0 con 0x7f848c06f460 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f8493bf1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0c7610 con 0x7f848c0c6050 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f8493bf1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0c69a0 con 0x7f848c151690 2023-12-01T23:46:02.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.545+0000 7f849218e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f848c0c6050 0x7f848c0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.546+0000 7f849198d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f848c151690 0x7f848c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.546+0000 7f849218e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f848c0c6050 0x7f848c0c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43698/0 (socket says 172.21.15.96:43698) 2023-12-01T23:46:02.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.546+0000 7f849218e640 1 -- 172.21.15.96:0/789878824 learned_addr learned my addr 172.21.15.96:0/789878824 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.548+0000 7f849218e640 1 -- 172.21.15.96:0/789878824 >> v2:172.21.15.102:3300/0 conn(0x7f848c151690 msgr2=0x7f848c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.548+0000 7f849218e640 1 --2- 172.21.15.96:0/789878824 >> v2:172.21.15.102:3300/0 conn(0x7f848c151690 0x7f848c157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.548+0000 7f849218e640 1 -- 172.21.15.96:0/789878824 >> v1:172.21.15.102:6789/0 conn(0x7f848c06f460 legacy=0x7f848c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.548+0000 7f849218e640 1 -- 172.21.15.96:0/789878824 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c151a70 con 0x7f848c0c6050 2023-12-01T23:46:02.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.550+0000 7f849218e640 1 --2- 172.21.15.96:0/789878824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c0c6050 0x7f848c0c6460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f848c0c8a50 tx=0x7f848402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808f2813eae5df8c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f849098b640 1 -- 172.21.15.96:0/789878824 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848402ca80 con 0x7f848c0c6050 2023-12-01T23:46:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f849098b640 1 -- 172.21.15.96:0/789878824 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848402cbe0 con 0x7f848c0c6050 2023-12-01T23:46:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f849098b640 1 -- 172.21.15.96:0/789878824 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840343f0 con 0x7f848c0c6050 2023-12-01T23:46:02.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 -- 172.21.15.96:0/789878824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c0c6050 msgr2=0x7f848c0c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 --2- 172.21.15.96:0/789878824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c0c6050 0x7f848c0c6460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f848c0c8a50 tx=0x7f848402bee0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 -- 172.21.15.96:0/789878824 shutdown_connections 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 --2- 172.21.15.96:0/789878824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c0c6050 0x7f848c0c6460 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 --2- 172.21.15.96:0/789878824 >> v2:172.21.15.102:3300/0 conn(0x7f848c151690 0x7f848c157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.554+0000 7f8493bf1640 1 -- 172.21.15.96:0/789878824 >> 172.21.15.96:0/789878824 conn(0x7f848c06cd60 msgr2=0x7f848c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.555+0000 7f8493bf1640 1 -- 172.21.15.96:0/789878824 shutdown_connections 2023-12-01T23:46:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.555+0000 7f8493bf1640 1 -- 172.21.15.96:0/789878824 wait complete. 2023-12-01T23:46:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.556+0000 7f8493bf1640 1 Processor -- start 2023-12-01T23:46:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.556+0000 7f8493bf1640 1 -- start start 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 0x7f848c0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f848c0c6050 0x7f848c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c15b5b0 con 0x7f848c151690 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0740c0 con 0x7f848c06f460 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f8493bf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c15ad80 con 0x7f848c0c6050 2023-12-01T23:46:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.557+0000 7f849218e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.558+0000 7f849198d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 0x7f848c0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.558+0000 7f849218e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43700/0 (socket says 172.21.15.96:43700) 2023-12-01T23:46:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.558+0000 7f849218e640 1 -- 172.21.15.96:0/4052985739 learned_addr learned my addr 172.21.15.96:0/4052985739 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:02.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.558+0000 7f849118c640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f848c0c6050 0x7f848c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849218e640 1 -- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f848c0c6050 msgr2=0x7f848c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849218e640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f848c0c6050 0x7f848c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849218e640 1 -- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 msgr2=0x7f848c0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849218e640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 0x7f848c0c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849218e640 1 -- 172.21.15.96:0/4052985739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484009b30 con 0x7f848c151690 2023-12-01T23:46:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.561+0000 7f849198d640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 0x7f848c0c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:02.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.563+0000 7f849218e640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f848402c4f0 tx=0x7f8484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:02.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.567+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484009510 con 0x7f848c151690 2023-12-01T23:46:02.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.567+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848403e450 con 0x7f848c151690 2023-12-01T23:46:02.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.567+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848403e800 con 0x7f848c151690 2023-12-01T23:46:02.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.567+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c15aff0 con 0x7f848c151690 2023-12-01T23:46:02.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.567+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c0c00a0 con 0x7f848c151690 2023-12-01T23:46:02.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.568+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c072b80 con 0x7f848c151690 2023-12-01T23:46:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.811+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f848402cd50 con 0x7f848c151690 2023-12-01T23:46:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.811+0000 7f84827fc640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 0x7f847006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:02.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.811+0000 7f849198d640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 0x7f847006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:02.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.812+0000 7f849198d640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 0x7f847006d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8488009f30 tx=0x7f8488009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:02.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.825+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f848407b860 con 0x7f848c151690 2023-12-01T23:46:02.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.825+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8484077ba0 con 0x7f848c151690 2023-12-01T23:46:02.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.991+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f848c0bff00 con 0x7f848c151690 2023-12-01T23:46:02.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.996+0000 7f84827fc640 1 -- 172.21.15.96:0/4052985739 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8484043020 con 0x7f848c151690 2023-12-01T23:46:02.998 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 msgr2=0x7f847006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 0x7f847006d380 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8488009f30 tx=0x7f8488009190 comp rx=0 tx=0).stop 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 msgr2=0x7f848c0c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f848402c4f0 tx=0x7f8484004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 shutdown_connections 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f847006aec0 0x7f847006d380 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:02.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f848c151690 0x7f848c0c0b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f848c0c6050 0x7f848c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 --2- 172.21.15.96:0/4052985739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f848c06f460 0x7f848c0c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 >> 172.21.15.96:0/4052985739 conn(0x7f848c06cd60 msgr2=0x7f848c0c3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:03.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 shutdown_connections 2023-12-01T23:46:03.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:02.998+0000 7f8493bf1640 1 -- 172.21.15.96:0/4052985739 wait complete. 2023-12-01T23:46:03.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T23:46:03.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.112+0000 7fd9f65be640 1 Processor -- start 2023-12-01T23:46:03.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.112+0000 7fd9f65be640 1 -- start start 2023-12-01T23:46:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.113+0000 7fd9f65be640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd9f0159860 0x7fd9f0156e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.113+0000 7fd9f65be640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0072b60 con 0x7fd9f01501c0 2023-12-01T23:46:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.113+0000 7fd9f65be640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f00c1a90 con 0x7fd9f00bff00 2023-12-01T23:46:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.113+0000 7fd9f65be640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f0159c80 con 0x7fd9f0159860 2023-12-01T23:46:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.114+0000 7fd9f4b5b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd9f0159860 0x7fd9f0156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.114+0000 7fd9ef7fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd9f00bff00 0x7fd9f0071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:44492/0 (socket says 172.21.15.96:44492) 2023-12-01T23:46:03.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.114+0000 7fd9ef7fe640 1 -- 172.21.15.96:0/978649181 learned_addr learned my addr 172.21.15.96:0/978649181 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.117+0000 7fd9eeffd640 1 -- 172.21.15.96:0/978649181 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471057855 0 0) 0x7fd9f00c1a90 con 0x7fd9f00bff00 2023-12-01T23:46:03.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.117+0000 7fd9eeffd640 1 -- 172.21.15.96:0/978649181 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d8003520 con 0x7fd9f00bff00 2023-12-01T23:46:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.117+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/978649181 >> v1:172.21.15.102:6789/0 conn(0x7fd9f00bff00 legacy=0x7fd9f0071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.117+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/978649181 >> v1:172.21.15.96:6789/0 conn(0x7fd9f01501c0 legacy=0x7fd9f0072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.117+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/978649181 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00c1d30 con 0x7fd9f0159860 2023-12-01T23:46:03.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.121+0000 7fd9f4b5b640 1 --2- 172.21.15.96:0/978649181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f0156e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009d90 tx=0x7fd9e802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a56308637c03da4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:03.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.125+0000 7fd9eeffd640 1 -- 172.21.15.96:0/978649181 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e802cd80 con 0x7fd9f0159860 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.125+0000 7fd9eeffd640 1 -- 172.21.15.96:0/978649181 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8034440 con 0x7fd9f0159860 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.125+0000 7fd9eeffd640 1 -- 172.21.15.96:0/978649181 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e80347d0 con 0x7fd9f0159860 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 -- 172.21.15.96:0/978649181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 msgr2=0x7fd9f0156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 --2- 172.21.15.96:0/978649181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f0156e60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009d90 tx=0x7fd9e802bfd0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 -- 172.21.15.96:0/978649181 shutdown_connections 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 --2- 172.21.15.96:0/978649181 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f0156e60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 -- 172.21.15.96:0/978649181 >> 172.21.15.96:0/978649181 conn(0x7fd9f006cd60 msgr2=0x7fd9f006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:03.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 -- 172.21.15.96:0/978649181 shutdown_connections 2023-12-01T23:46:03.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.126+0000 7fd9f65be640 1 -- 172.21.15.96:0/978649181 wait complete. 2023-12-01T23:46:03.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.127+0000 7fd9f65be640 1 Processor -- start 2023-12-01T23:46:03.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.127+0000 7fd9f65be640 1 -- start start 2023-12-01T23:46:03.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9f00bff00 0x7fd9f0158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9f01501c0 0x7fd9f00c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01edcf0 con 0x7fd9f0159860 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01ed750 con 0x7fd9f00bff00 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f65be640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f01eda10 con 0x7fd9f01501c0 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.128+0000 7fd9f4b5b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.129+0000 7fd9f4b5b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43716/0 (socket says 172.21.15.96:43716) 2023-12-01T23:46:03.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.129+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/2559324761 learned_addr learned my addr 172.21.15.96:0/2559324761 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:03.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.129+0000 7fd9effff640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9f00bff00 0x7fd9f0158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.129+0000 7fd9ef7fe640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9f01501c0 0x7fd9f00c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.132+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9f01501c0 msgr2=0x7fd9f00c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.132+0000 7fd9f4b5b640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9f01501c0 0x7fd9f00c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.132+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9f00bff00 msgr2=0x7fd9f0158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.132+0000 7fd9f4b5b640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9f00bff00 0x7fd9f0158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.132+0000 7fd9f4b5b640 1 -- 172.21.15.96:0/2559324761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e8009a70 con 0x7fd9f0159860 2023-12-01T23:46:03.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.135+0000 7fd9f4b5b640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009eb0 tx=0x7fd9e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:03.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.138+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e803e410 con 0x7fd9f0159860 2023-12-01T23:46:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.138+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e803e570 con 0x7fd9f0159860 2023-12-01T23:46:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.138+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e803e920 con 0x7fd9f0159860 2023-12-01T23:46:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.138+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00c8f80 con 0x7fd9f0159860 2023-12-01T23:46:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.138+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f013e010 con 0x7fd9f0159860 2023-12-01T23:46:03.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.140+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f00c77e0 con 0x7fd9f0159860 2023-12-01T23:46:03.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.158+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9e803b050 con 0x7fd9f0159860 2023-12-01T23:46:03.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.158+0000 7fd9ecff9640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 0x7fd9dc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.158+0000 7fd9effff640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 0x7fd9dc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.159+0000 7fd9effff640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 0x7fd9dc06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001780 tx=0x7fd9e0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:03.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.161+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd9e807b090 con 0x7fd9f0159860 2023-12-01T23:46:03.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.395+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9e80773d0 con 0x7fd9f0159860 2023-12-01T23:46:03.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.579+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9f006ec70 con 0x7fd9f0159860 2023-12-01T23:46:03.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.583+0000 7fd9ecff9640 1 -- 172.21.15.96:0/2559324761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9e804e070 con 0x7fd9f0159860 2023-12-01T23:46:03.584 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 msgr2=0x7fd9dc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 0x7fd9dc06d350 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0001780 tx=0x7fd9e0009040 comp rx=0 tx=0).stop 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 msgr2=0x7fd9f00ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9e8009eb0 tx=0x7fd9e8004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 shutdown_connections 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd9dc06ae90 0x7fd9dc06d350 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd9f0159860 0x7fd9f00ca110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9f01501c0 0x7fd9f00c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 --2- 172.21.15.96:0/2559324761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9f00bff00 0x7fd9f0158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 >> 172.21.15.96:0/2559324761 conn(0x7fd9f006cd60 msgr2=0x7fd9f006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 shutdown_connections 2023-12-01T23:46:03.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.586+0000 7fd9f65be640 1 -- 172.21.15.96:0/2559324761 wait complete. 2023-12-01T23:46:03.598 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-12-01T23:46:03.598 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T23:46:03.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.752+0000 7f4ed58c2640 1 Processor -- start 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.752+0000 7f4ed58c2640 1 -- start start 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ed58c2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed01538f0 0x7f4ed00c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ed58c2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4ed0159b70 0x7f4ed015a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ed58c2640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed01596e0 con 0x7f4ed00c7b90 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ed58c2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed015a540 con 0x7f4ed0159b70 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ed58c2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00ca630 con 0x7f4ed01538f0 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.753+0000 7f4ece7fc640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f4ed00c7b90 0x7f4ed006b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33584/0 (socket says 172.21.15.96:33584) 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.754+0000 7f4ece7fc640 1 -- 172.21.15.96:0/1947212207 learned_addr learned my addr 172.21.15.96:0/1947212207 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:03.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.754+0000 7f4ecf7fe640 1 --2- 172.21.15.96:0/1947212207 >> v2:172.21.15.102:3300/0 conn(0x7f4ed0159b70 0x7f4ed015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.754+0000 7f4eceffd640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed01538f0 0x7f4ed00c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.756+0000 7f4ecdffb640 1 -- 172.21.15.96:0/1947212207 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062162427 0 0) 0x7f4ed01596e0 con 0x7f4ed00c7b90 2023-12-01T23:46:03.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.756+0000 7f4ecdffb640 1 -- 172.21.15.96:0/1947212207 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb8003520 con 0x7f4ed00c7b90 2023-12-01T23:46:03.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.757+0000 7f4ecf7fe640 1 -- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed01538f0 msgr2=0x7f4ed00c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:03.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.757+0000 7f4ecf7fe640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed01538f0 0x7f4ed00c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.757+0000 7f4ecf7fe640 1 -- 172.21.15.96:0/1947212207 >> v1:172.21.15.96:6789/0 conn(0x7f4ed00c7b90 legacy=0x7f4ed006b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.757+0000 7f4ecf7fe640 1 -- 172.21.15.96:0/1947212207 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00c2f40 con 0x7f4ed0159b70 2023-12-01T23:46:03.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.759+0000 7f4ecf7fe640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015a000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80097a0 tx=0x7f4ec802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e578b15297a436dd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.763+0000 7f4ecdffb640 1 -- 172.21.15.96:0/1947212207 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec802e070 con 0x7f4ed0159b70 2023-12-01T23:46:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.763+0000 7f4ecdffb640 1 -- 172.21.15.96:0/1947212207 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec80315a0 con 0x7f4ed0159b70 2023-12-01T23:46:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.763+0000 7f4ecdffb640 1 -- 172.21.15.96:0/1947212207 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8031930 con 0x7f4ed0159b70 2023-12-01T23:46:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 -- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 msgr2=0x7f4ed015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015a000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80097a0 tx=0x7f4ec802b840 comp rx=0 tx=0).stop 2023-12-01T23:46:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 -- 172.21.15.96:0/1947212207 shutdown_connections 2023-12-01T23:46:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015a000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/1947212207 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed01538f0 0x7f4ed00c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 -- 172.21.15.96:0/1947212207 >> 172.21.15.96:0/1947212207 conn(0x7f4ed0060f20 msgr2=0x7f4ed0061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 -- 172.21.15.96:0/1947212207 shutdown_connections 2023-12-01T23:46:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.764+0000 7f4ed58c2640 1 -- 172.21.15.96:0/1947212207 wait complete. 2023-12-01T23:46:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.765+0000 7f4ed58c2640 1 Processor -- start 2023-12-01T23:46:03.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 -- start start 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed00c7b90 0x7f4ed01e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01e3380 con 0x7f4ed01538f0 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01e6800 con 0x7f4ed0159b70 2023-12-01T23:46:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.766+0000 7f4ed58c2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01e3d50 con 0x7f4ed00c7b90 2023-12-01T23:46:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.767+0000 7f4ece7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.767+0000 7f4eceffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed00c7b90 0x7f4ed01e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.767+0000 7f4ecf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.767+0000 7f4ece7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43730/0 (socket says 172.21.15.96:43730) 2023-12-01T23:46:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.767+0000 7f4ece7fc640 1 -- 172.21.15.96:0/3165095039 learned_addr learned my addr 172.21.15.96:0/3165095039 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.770+0000 7f4ece7fc640 1 -- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed00c7b90 msgr2=0x7f4ed01e3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.770+0000 7f4ece7fc640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed00c7b90 0x7f4ed01e3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.770+0000 7f4ece7fc640 1 -- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 msgr2=0x7f4ed015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.770+0000 7f4ece7fc640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.770+0000 7f4ece7fc640 1 -- 172.21.15.96:0/3165095039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8009400 con 0x7f4ed01538f0 2023-12-01T23:46:03.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.773+0000 7f4ece7fc640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c410 tx=0x7f4ec400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.776+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4005ce0 con 0x7f4ed01538f0 2023-12-01T23:46:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.776+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4005e40 con 0x7f4ed01538f0 2023-12-01T23:46:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.776+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40072f0 con 0x7f4ed01538f0 2023-12-01T23:46:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.776+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed01e4eb0 con 0x7f4ed01538f0 2023-12-01T23:46:03.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.776+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed01e5450 con 0x7f4ed01538f0 2023-12-01T23:46:03.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:03.777+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0067500 con 0x7f4ed01538f0 2023-12-01T23:46:04.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.025+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ec4007510 con 0x7f4ed01538f0 2023-12-01T23:46:04.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.025+0000 7f4eb7fff640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 0x7f4ebc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.025+0000 7f4eceffd640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 0x7f4ebc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.026+0000 7f4eceffd640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 0x7f4ebc06d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00113e0 tx=0x7f4ec000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.037+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ec4013e70 con 0x7f4ed01538f0 2023-12-01T23:46:04.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.037+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ec40542f0 con 0x7f4ed01538f0 2023-12-01T23:46:04.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.210+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ed0073bb0 con 0x7f4ed01538f0 2023-12-01T23:46:04.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.248+0000 7f4eb7fff640 1 -- 172.21.15.96:0/3165095039 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f4ec4017020 con 0x7f4ed01538f0 2023-12-01T23:46:04.250 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:04.250 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:46:04.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 msgr2=0x7f4ebc06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 0x7f4ebc06d350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00113e0 tx=0x7f4ec000b040 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 msgr2=0x7f4ed014f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c410 tx=0x7f4ec400c8d0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 shutdown_connections 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4ebc06ae90 0x7f4ebc06d350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ed0159b70 0x7f4ed015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ed01538f0 0x7f4ed014f800 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 --2- 172.21.15.96:0/3165095039 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ed00c7b90 0x7f4ed01e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 >> 172.21.15.96:0/3165095039 conn(0x7f4ed0060f20 msgr2=0x7f4ed0151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.250+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 shutdown_connections 2023-12-01T23:46:04.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.251+0000 7f4ed58c2640 1 -- 172.21.15.96:0/3165095039 wait complete. 2023-12-01T23:46:04.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T23:18:14.051664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T23:18:26.226080+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T23:18:27.378852+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-01T23:18:32.629361+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-01T23:46:04.263 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T23:46:04.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.364+0000 7fae63f9e640 1 Processor -- start 2023-12-01T23:46:04.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 -- start start 2023-12-01T23:46:04.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae5c1501c0 0x7fae5c159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 0x7fae5c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c072b60 con 0x7fae5c0bff00 2023-12-01T23:46:04.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c1572d0 con 0x7fae5c156e60 2023-12-01T23:46:04.367 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.365+0000 7fae63f9e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c0c1a90 con 0x7fae5c1501c0 2023-12-01T23:46:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.366+0000 7fae6253b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 0x7fae5c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.366+0000 7fae61d3a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae5c1501c0 0x7fae5c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.367+0000 7fae61539640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fae5c0bff00 0x7fae5c072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:33598/0 (socket says 172.21.15.96:33598) 2023-12-01T23:46:04.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.367+0000 7fae61539640 1 -- 172.21.15.96:0/2396987466 learned_addr learned my addr 172.21.15.96:0/2396987466 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.369+0000 7fae61d3a640 1 -- 172.21.15.96:0/2396987466 >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 msgr2=0x7fae5c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.369+0000 7fae61d3a640 1 --2- 172.21.15.96:0/2396987466 >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 0x7fae5c071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.369+0000 7fae61d3a640 1 -- 172.21.15.96:0/2396987466 >> v1:172.21.15.96:6789/0 conn(0x7fae5c0bff00 legacy=0x7fae5c072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.369+0000 7fae61d3a640 1 -- 172.21.15.96:0/2396987466 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0c1d30 con 0x7fae5c1501c0 2023-12-01T23:46:04.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.369+0000 7fae6253b640 1 --2- 172.21.15.96:0/2396987466 >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 0x7fae5c071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:04.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.371+0000 7fae61d3a640 1 --2- 172.21.15.96:0/2396987466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1501c0 0x7fae5c159860 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0cbad0 tx=0x7fae5002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea4cdb840e8fc2a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.375+0000 7fae60d38640 1 -- 172.21.15.96:0/2396987466 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50030610 con 0x7fae5c1501c0 2023-12-01T23:46:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.375+0000 7fae60d38640 1 -- 172.21.15.96:0/2396987466 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50030770 con 0x7fae5c1501c0 2023-12-01T23:46:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.375+0000 7fae60d38640 1 -- 172.21.15.96:0/2396987466 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50030b00 con 0x7fae5c1501c0 2023-12-01T23:46:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 -- 172.21.15.96:0/2396987466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1501c0 msgr2=0x7fae5c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 --2- 172.21.15.96:0/2396987466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1501c0 0x7fae5c159860 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0cbad0 tx=0x7fae5002b960 comp rx=0 tx=0).stop 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 -- 172.21.15.96:0/2396987466 shutdown_connections 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 --2- 172.21.15.96:0/2396987466 >> v2:172.21.15.96:3300/0 conn(0x7fae5c156e60 0x7fae5c071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 --2- 172.21.15.96:0/2396987466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c1501c0 0x7fae5c159860 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 -- 172.21.15.96:0/2396987466 >> 172.21.15.96:0/2396987466 conn(0x7fae5c06cd60 msgr2=0x7fae5c06d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 -- 172.21.15.96:0/2396987466 shutdown_connections 2023-12-01T23:46:04.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.376+0000 7fae63f9e640 1 -- 172.21.15.96:0/2396987466 wait complete. 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.377+0000 7fae63f9e640 1 Processor -- start 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.377+0000 7fae63f9e640 1 -- start start 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c0bff00 0x7fae5c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae5c156e60 0x7fae5c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c14d8b0 con 0x7fae5c1501c0 2023-12-01T23:46:04.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0c9210 con 0x7fae5c0bff00 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae63f9e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c1edd60 con 0x7fae5c156e60 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.378+0000 7fae61539640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.379+0000 7fae61d3a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c0bff00 0x7fae5c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.379+0000 7fae6253b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae5c156e60 0x7fae5c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.379+0000 7fae61539640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43744/0 (socket says 172.21.15.96:43744) 2023-12-01T23:46:04.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.379+0000 7fae61539640 1 -- 172.21.15.96:0/4269912684 learned_addr learned my addr 172.21.15.96:0/4269912684 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.382+0000 7fae61539640 1 -- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae5c156e60 msgr2=0x7fae5c149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.382+0000 7fae61539640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae5c156e60 0x7fae5c149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.382+0000 7fae61539640 1 -- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c0bff00 msgr2=0x7fae5c14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.382+0000 7fae61539640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c0bff00 0x7fae5c14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.382+0000 7fae61539640 1 -- 172.21.15.96:0/4269912684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009a70 con 0x7fae5c1501c0 2023-12-01T23:46:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.384+0000 7fae61539640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c400 tx=0x7fae5800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.388+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58005ce0 con 0x7fae5c1501c0 2023-12-01T23:46:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.388+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae58005e40 con 0x7fae5c1501c0 2023-12-01T23:46:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.388+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae580072d0 con 0x7fae5c1501c0 2023-12-01T23:46:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.388+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50009400 con 0x7fae5c1501c0 2023-12-01T23:46:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.388+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c0c9480 con 0x7fae5c1501c0 2023-12-01T23:46:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.389+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c14a9b0 con 0x7fae5c1501c0 2023-12-01T23:46:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.631+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae580074f0 con 0x7fae5c1501c0 2023-12-01T23:46:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.632+0000 7fae4e7fc640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 0x7fae4006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.632+0000 7fae61d3a640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 0x7fae4006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.632+0000 7fae61d3a640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 0x7fae4006d350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae50036000 tx=0x7fae50008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.645+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fae58013e70 con 0x7fae5c1501c0 2023-12-01T23:46:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.645+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fae580540d0 con 0x7fae5c1501c0 2023-12-01T23:46:04.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.816+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae5c067500 con 0x7fae5c1501c0 2023-12-01T23:46:04.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.834+0000 7fae4e7fc640 1 -- 172.21.15.96:0/4269912684 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae580170a0 con 0x7fae5c1501c0 2023-12-01T23:46:04.836 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 msgr2=0x7fae4006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 0x7fae4006d350 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fae50036000 tx=0x7fae50008030 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 msgr2=0x7fae5c14cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c400 tx=0x7fae5800c800 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 shutdown_connections 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fae4006ae90 0x7fae4006d350 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fae5c156e60 0x7fae5c149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae5c1501c0 0x7fae5c14cdf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.836+0000 7fae63f9e640 1 --2- 172.21.15.96:0/4269912684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae5c0bff00 0x7fae5c14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.837+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 >> 172.21.15.96:0/4269912684 conn(0x7fae5c06cd60 msgr2=0x7fae5c06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:04.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.837+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 shutdown_connections 2023-12-01T23:46:04.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.837+0000 7fae63f9e640 1 -- 172.21.15.96:0/4269912684 wait complete. 2023-12-01T23:46:04.850 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.954+0000 7fd74d168640 1 Processor -- start 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.954+0000 7fd74d168640 1 -- start start 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd74d168640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7481537d0 0x7fd74806a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd74d168640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd7480c2e40 0x7fd74806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd74d168640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74806e0f0 con 0x7fd74806f160 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd74d168640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd748159710 con 0x7fd7481537d0 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd74d168640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480c72d0 con 0x7fd7480c2e40 2023-12-01T23:46:04.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.955+0000 7fd746d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7481537d0 0x7fd74806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.956+0000 7fd74759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd7480c2e40 0x7fd74806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.956+0000 7fd746d9d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd7481537d0 0x7fd74806a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43754/0 (socket says 172.21.15.96:43754) 2023-12-01T23:46:04.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.956+0000 7fd746d9d640 1 -- 172.21.15.96:0/191465924 learned_addr learned my addr 172.21.15.96:0/191465924 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.958+0000 7fd746d9d640 1 -- 172.21.15.96:0/191465924 >> v2:172.21.15.102:3300/0 conn(0x7fd7480c2e40 msgr2=0x7fd74806aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.958+0000 7fd746d9d640 1 --2- 172.21.15.96:0/191465924 >> v2:172.21.15.102:3300/0 conn(0x7fd7480c2e40 0x7fd74806aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.958+0000 7fd746d9d640 1 -- 172.21.15.96:0/191465924 >> v1:172.21.15.102:6789/0 conn(0x7fd74806f160 legacy=0x7fd748159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.958+0000 7fd746d9d640 1 -- 172.21.15.96:0/191465924 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480c7590 con 0x7fd7481537d0 2023-12-01T23:46:04.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.960+0000 7fd746d9d640 1 --2- 172.21.15.96:0/191465924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd74806a500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd74806ee70 tx=0x7fd73802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec2ab74a21a782 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.963+0000 7fd745d9b640 1 -- 172.21.15.96:0/191465924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73802cbb0 con 0x7fd7481537d0 2023-12-01T23:46:04.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd745d9b640 1 -- 172.21.15.96:0/191465924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73802cd10 con 0x7fd7481537d0 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd745d9b640 1 -- 172.21.15.96:0/191465924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738034610 con 0x7fd7481537d0 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 -- 172.21.15.96:0/191465924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 msgr2=0x7fd74806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 --2- 172.21.15.96:0/191465924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd74806a500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd74806ee70 tx=0x7fd73802c010 comp rx=0 tx=0).stop 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 -- 172.21.15.96:0/191465924 shutdown_connections 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 --2- 172.21.15.96:0/191465924 >> v2:172.21.15.102:3300/0 conn(0x7fd7480c2e40 0x7fd74806aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 --2- 172.21.15.96:0/191465924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd74806a500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 -- 172.21.15.96:0/191465924 >> 172.21.15.96:0/191465924 conn(0x7fd7480cbf60 msgr2=0x7fd7480cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 -- 172.21.15.96:0/191465924 shutdown_connections 2023-12-01T23:46:04.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.964+0000 7fd74d168640 1 -- 172.21.15.96:0/191465924 wait complete. 2023-12-01T23:46:04.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 Processor -- start 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 -- start start 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74806f160 0x7fd7481f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7480c2e40 0x7fd74814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7481eec60 con 0x7fd7481537d0 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7481eef20 con 0x7fd74806f160 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.966+0000 7fd74d168640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7481ef200 con 0x7fd7480c2e40 2023-12-01T23:46:04.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.967+0000 7fd74759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.967+0000 7fd746d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74806f160 0x7fd7481f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.967+0000 7fd74759e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43756/0 (socket says 172.21.15.96:43756) 2023-12-01T23:46:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.967+0000 7fd74759e640 1 -- 172.21.15.96:0/1320520425 learned_addr learned my addr 172.21.15.96:0/1320520425 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:04.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.967+0000 7fd74659c640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7480c2e40 0x7fd74814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.971+0000 7fd74759e640 1 -- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7480c2e40 msgr2=0x7fd74814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.971+0000 7fd74759e640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7480c2e40 0x7fd74814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.971+0000 7fd74759e640 1 -- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74806f160 msgr2=0x7fd7481f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.971+0000 7fd74759e640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74806f160 0x7fd7481f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.971+0000 7fd74759e640 1 -- 172.21.15.96:0/1320520425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009b30 con 0x7fd7481537d0 2023-12-01T23:46:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.974+0000 7fd74759e640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd74000e930 tx=0x7fd74000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:04.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.977+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740009690 con 0x7fd7481537d0 2023-12-01T23:46:04.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.977+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74000c980 con 0x7fd7481537d0 2023-12-01T23:46:04.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.977+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74000cd30 con 0x7fd7481537d0 2023-12-01T23:46:04.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.977+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7481ef4e0 con 0x7fd7481537d0 2023-12-01T23:46:04.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.978+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7481efaa0 con 0x7fd7481537d0 2023-12-01T23:46:04.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:04.979+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd748067500 con 0x7fd7481537d0 2023-12-01T23:46:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.219+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd740013470 con 0x7fd7481537d0 2023-12-01T23:46:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.220+0000 7fd72f7fe640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 0x7fd73406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.220+0000 7fd746d9d640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 0x7fd73406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.220+0000 7fd746d9d640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 0x7fd73406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd738035000 tx=0x7fd738030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:05.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.234+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd740058e20 con 0x7fd7481537d0 2023-12-01T23:46:05.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.234+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd740055160 con 0x7fd7481537d0 2023-12-01T23:46:05.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.408+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd74806e730 con 0x7fd7481537d0 2023-12-01T23:46:05.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.414+0000 7fd72f7fe640 1 -- 172.21.15.96:0/1320520425 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd740058780 con 0x7fd7481537d0 2023-12-01T23:46:05.415 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:46:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 msgr2=0x7fd73406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 0x7fd73406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd738035000 tx=0x7fd738030000 comp rx=0 tx=0).stop 2023-12-01T23:46:05.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 msgr2=0x7fd7481552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd74000e930 tx=0x7fd74000edf0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 shutdown_connections 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd73406ae40 0x7fd73406d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7481537d0 0x7fd7481552a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd7480c2e40 0x7fd74814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 --2- 172.21.15.96:0/1320520425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74806f160 0x7fd7481f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.416+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 >> 172.21.15.96:0/1320520425 conn(0x7fd7480cbf60 msgr2=0x7fd7480c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.417+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 shutdown_connections 2023-12-01T23:46:05.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.417+0000 7fd74d168640 1 -- 172.21.15.96:0/1320520425 wait complete. 2023-12-01T23:46:05.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T23:46:05.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.533+0000 7fbc3bae5640 1 Processor -- start 2023-12-01T23:46:05.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.533+0000 7fbc3bae5640 1 -- start start 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3bae5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fbc340728b0 0x7fbc340c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3bae5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3bae5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3415b6e0 con 0x7fbc34151510 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3bae5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3415a880 con 0x7fbc340728b0 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3bae5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c6480 con 0x7fbc340c5fd0 2023-12-01T23:46:05.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.534+0000 7fbc3a082640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.535+0000 7fbc3a082640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:42390/0 (socket says 172.21.15.96:42390) 2023-12-01T23:46:05.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.535+0000 7fbc3a082640 1 -- 172.21.15.96:0/2154395017 learned_addr learned my addr 172.21.15.96:0/2154395017 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:05.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.536+0000 7fbc39080640 1 --2- 172.21.15.96:0/2154395017 >> v2:172.21.15.96:3300/0 conn(0x7fbc340728b0 0x7fbc340c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.537+0000 7fbc3a082640 1 -- 172.21.15.96:0/2154395017 >> v2:172.21.15.96:3300/0 conn(0x7fbc340728b0 msgr2=0x7fbc340c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.537+0000 7fbc3a082640 1 --2- 172.21.15.96:0/2154395017 >> v2:172.21.15.96:3300/0 conn(0x7fbc340728b0 0x7fbc340c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.537+0000 7fbc3a082640 1 -- 172.21.15.96:0/2154395017 >> v1:172.21.15.102:6789/0 conn(0x7fbc34151510 legacy=0x7fbc340cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.537+0000 7fbc3a082640 1 -- 172.21.15.96:0/2154395017 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3406f7e0 con 0x7fbc340c5fd0 2023-12-01T23:46:05.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.539+0000 7fbc3a082640 1 --2- 172.21.15.96:0/2154395017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009e50 tx=0x7fbc2c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe5798545852585 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.542+0000 7fbc3887f640 1 -- 172.21.15.96:0/2154395017 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c02cb00 con 0x7fbc340c5fd0 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.542+0000 7fbc3887f640 1 -- 172.21.15.96:0/2154395017 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c02cc60 con 0x7fbc340c5fd0 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.542+0000 7fbc3887f640 1 -- 172.21.15.96:0/2154395017 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0343f0 con 0x7fbc340c5fd0 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 -- 172.21.15.96:0/2154395017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 msgr2=0x7fbc34161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/2154395017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009e50 tx=0x7fbc2c02bf60 comp rx=0 tx=0).stop 2023-12-01T23:46:05.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 -- 172.21.15.96:0/2154395017 shutdown_connections 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/2154395017 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34161c10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/2154395017 >> v2:172.21.15.96:3300/0 conn(0x7fbc340728b0 0x7fbc340c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 -- 172.21.15.96:0/2154395017 >> 172.21.15.96:0/2154395017 conn(0x7fbc3406cd60 msgr2=0x7fbc3406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 -- 172.21.15.96:0/2154395017 shutdown_connections 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.543+0000 7fbc3bae5640 1 -- 172.21.15.96:0/2154395017 wait complete. 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.544+0000 7fbc3bae5640 1 Processor -- start 2023-12-01T23:46:05.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.544+0000 7fbc3bae5640 1 -- start start 2023-12-01T23:46:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc340728b0 0x7fbc340afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc341523a0 con 0x7fbc34151510 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34156c90 con 0x7fbc340728b0 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3bae5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc341ef910 con 0x7fbc340c5fd0 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.545+0000 7fbc3a082640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.546+0000 7fbc39080640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.546+0000 7fbc39881640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc340728b0 0x7fbc340afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.546+0000 7fbc3a082640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43778/0 (socket says 172.21.15.96:43778) 2023-12-01T23:46:05.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.546+0000 7fbc3a082640 1 -- 172.21.15.96:0/3578613643 learned_addr learned my addr 172.21.15.96:0/3578613643 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.549+0000 7fbc3a082640 1 -- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 msgr2=0x7fbc34155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.549+0000 7fbc3a082640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.549+0000 7fbc3a082640 1 -- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc340728b0 msgr2=0x7fbc340afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.549+0000 7fbc3a082640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc340728b0 0x7fbc340afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.549+0000 7fbc3a082640 1 -- 172.21.15.96:0/3578613643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009b30 con 0x7fbc34151510 2023-12-01T23:46:05.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.551+0000 7fbc3a082640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c036040 tx=0x7fbc2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.555+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c009510 con 0x7fbc34151510 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.555+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c03e450 con 0x7fbc34151510 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.555+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c03e800 con 0x7fbc34151510 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.555+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc34151c50 con 0x7fbc34151510 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.555+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc34156f30 con 0x7fbc34151510 2023-12-01T23:46:05.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.556+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc341efac0 con 0x7fbc34151510 2023-12-01T23:46:05.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.575+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc2c03e960 con 0x7fbc34151510 2023-12-01T23:46:05.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.575+0000 7fbc2a7fc640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 0x7fbc1806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:05.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.575+0000 7fbc39881640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 0x7fbc1806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:05.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.576+0000 7fbc39881640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 0x7fbc1806d350 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc30000f60 tx=0x7fbc30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:05.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.810+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc2c040e70 con 0x7fbc34151510 2023-12-01T23:46:05.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.810+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc2c077780 con 0x7fbc34151510 2023-12-01T23:46:05.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.989+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc341efac0 con 0x7fbc34151510 2023-12-01T23:46:05.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.993+0000 7fbc2a7fc640 1 -- 172.21.15.96:0/3578613643 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc341efac0 con 0x7fbc34151510 2023-12-01T23:46:05.995 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 msgr2=0x7fbc1806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 0x7fbc1806d350 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc30000f60 tx=0x7fbc30009040 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 msgr2=0x7fbc34155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c036040 tx=0x7fbc2c004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 shutdown_connections 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fbc1806ae90 0x7fbc1806d350 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbc34151510 0x7fbc34155d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc340c5fd0 0x7fbc34155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 --2- 172.21.15.96:0/3578613643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc340728b0 0x7fbc340afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 >> 172.21.15.96:0/3578613643 conn(0x7fbc3406cd60 msgr2=0x7fbc34073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:05.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 shutdown_connections 2023-12-01T23:46:05.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:05.996+0000 7fbc3bae5640 1 -- 172.21.15.96:0/3578613643 wait complete. 2023-12-01T23:46:06.008 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-01T23:46:06.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.109+0000 7f4d7fecf640 1 Processor -- start 2023-12-01T23:46:06.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 -- start start 2023-12-01T23:46:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 0x7f4d78070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 0x7f4d781510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d78070540 con 0x7f4d780cd2b0 2023-12-01T23:46:06.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d78158400 con 0x7f4d780cc650 2023-12-01T23:46:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.110+0000 7f4d7fecf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7815ad60 con 0x7f4d780cced0 2023-12-01T23:46:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.111+0000 7f4d7e46c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 0x7f4d781510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.111+0000 7f4d7dc6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 0x7f4d78070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.111+0000 7f4d7e46c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 0x7f4d781510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43788/0 (socket says 172.21.15.96:43788) 2023-12-01T23:46:06.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.111+0000 7f4d7e46c640 1 -- 172.21.15.96:0/1480783989 learned_addr learned my addr 172.21.15.96:0/1480783989 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:06.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.114+0000 7f4d7dc6b640 1 -- 172.21.15.96:0/1480783989 >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 msgr2=0x7f4d781510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:06.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.114+0000 7f4d7dc6b640 1 --2- 172.21.15.96:0/1480783989 >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 0x7f4d781510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.114+0000 7f4d7dc6b640 1 -- 172.21.15.96:0/1480783989 >> v1:172.21.15.96:6789/0 conn(0x7f4d780cd2b0 legacy=0x7f4d780cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.114+0000 7f4d7dc6b640 1 -- 172.21.15.96:0/1480783989 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7815b040 con 0x7f4d780cced0 2023-12-01T23:46:06.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.116+0000 7f4d7dc6b640 1 --2- 172.21.15.96:0/1480783989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 0x7f4d78070000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009d90 tx=0x7f4d7002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d82ca56759107d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.119+0000 7f4d7cc69640 1 -- 172.21.15.96:0/1480783989 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7002cce0 con 0x7f4d780cced0 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7cc69640 1 -- 172.21.15.96:0/1480783989 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7002ce40 con 0x7f4d780cced0 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7cc69640 1 -- 172.21.15.96:0/1480783989 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70034660 con 0x7f4d780cced0 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1480783989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 msgr2=0x7f4d78070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1480783989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 0x7f4d78070000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009d90 tx=0x7f4d7002bf30 comp rx=0 tx=0).stop 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1480783989 shutdown_connections 2023-12-01T23:46:06.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1480783989 >> v2:172.21.15.96:3300/0 conn(0x7f4d780cc650 0x7f4d781510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1480783989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cced0 0x7f4d78070000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1480783989 >> 172.21.15.96:0/1480783989 conn(0x7f4d78061660 msgr2=0x7f4d78070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1480783989 shutdown_connections 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.120+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1480783989 wait complete. 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.121+0000 7f4d7fecf640 1 Processor -- start 2023-12-01T23:46:06.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 -- start start 2023-12-01T23:46:06.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cc650 0x7f4d78143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780cced0 0x7f4d781564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78143f60 con 0x7f4d780cd2b0 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c5430 con 0x7f4d780cced0 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.122+0000 7f4d7fecf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c5c40 con 0x7f4d780cc650 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.123+0000 7f4d7e46c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.123+0000 7f4d7dc6b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cc650 0x7f4d78143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.123+0000 7f4d7d46a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780cced0 0x7f4d781564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.123+0000 7f4d7e46c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43792/0 (socket says 172.21.15.96:43792) 2023-12-01T23:46:06.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.123+0000 7f4d7e46c640 1 -- 172.21.15.96:0/1713548063 learned_addr learned my addr 172.21.15.96:0/1713548063 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:06.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.126+0000 7f4d7e46c640 1 -- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cc650 msgr2=0x7f4d78143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.126+0000 7f4d7e46c640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cc650 0x7f4d78143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.126+0000 7f4d7e46c640 1 -- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780cced0 msgr2=0x7f4d781564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.126+0000 7f4d7e46c640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780cced0 0x7f4d781564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.126+0000 7f4d7e46c640 1 -- 172.21.15.96:0/1713548063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009a70 con 0x7f4d780cd2b0 2023-12-01T23:46:06.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.128+0000 7f4d7e46c640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400e8a0 tx=0x7f4d7400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.132+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400c940 con 0x7f4d780cd2b0 2023-12-01T23:46:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.132+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400caa0 con 0x7f4d780cd2b0 2023-12-01T23:46:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.132+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400ce50 con 0x7f4d780cd2b0 2023-12-01T23:46:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.132+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d780c6dd0 con 0x7f4d780cd2b0 2023-12-01T23:46:06.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.132+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d78155d50 con 0x7f4d780cd2b0 2023-12-01T23:46:06.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.133+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78067500 con 0x7f4d780cd2b0 2023-12-01T23:46:06.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.152+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4d74013470 con 0x7f4d780cd2b0 2023-12-01T23:46:06.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.153+0000 7f4d6e7fc640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 0x7f4d5c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.153+0000 7f4d7dc6b640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 0x7f4d5c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.153+0000 7f4d7dc6b640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 0x7f4d5c06d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d70036000 tx=0x7f4d70030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.388+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d74058d80 con 0x7f4d780cd2b0 2023-12-01T23:46:06.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.388+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4d740550c0 con 0x7f4d780cd2b0 2023-12-01T23:46:06.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.573+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d780c3080 con 0x7f4d780cd2b0 2023-12-01T23:46:06.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.578+0000 7f4d6e7fc640 1 -- 172.21.15.96:0/1713548063 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d74021020 con 0x7f4d780cd2b0 2023-12-01T23:46:06.579 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-12-01T23:46:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 msgr2=0x7f4d5c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 0x7f4d5c06d350 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d70036000 tx=0x7f4d70030000 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 msgr2=0x7f4d781569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400e8a0 tx=0x7f4d7400ed60 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 shutdown_connections 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4d5c06ae90 0x7f4d5c06d350 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d780cd2b0 0x7f4d781569f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d780cced0 0x7f4d781564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 --2- 172.21.15.96:0/1713548063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d780cc650 0x7f4d78143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 >> 172.21.15.96:0/1713548063 conn(0x7f4d78061660 msgr2=0x7f4d781500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 shutdown_connections 2023-12-01T23:46:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.580+0000 7f4d7fecf640 1 -- 172.21.15.96:0/1713548063 wait complete. 2023-12-01T23:46:06.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T23:46:06.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.693+0000 7f48aa3d0640 1 Processor -- start 2023-12-01T23:46:06.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.693+0000 7f48aa3d0640 1 -- start start 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48aa3d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f48a4151510 0x7f48a40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48aa3d0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48a40c61a0 0x7f48a40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48aa3d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a415b6e0 con 0x7f48a40728b0 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48aa3d0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a415a880 con 0x7f48a40c61a0 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48aa3d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a406f7e0 con 0x7f48a4151510 2023-12-01T23:46:06.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.694+0000 7f48a896d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48a40c61a0 0x7f48a40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.695+0000 7f48a3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f48a4151510 0x7f48a40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.695+0000 7f48a896d640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f48a40c61a0 0x7f48a40cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53832/0 (socket says 172.21.15.96:53832) 2023-12-01T23:46:06.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.695+0000 7f48a896d640 1 -- 172.21.15.96:0/499930450 learned_addr learned my addr 172.21.15.96:0/499930450 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:06.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.697+0000 7f48a896d640 1 -- 172.21.15.96:0/499930450 >> v2:172.21.15.102:3300/0 conn(0x7f48a4151510 msgr2=0x7f48a40cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:06.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.697+0000 7f48a896d640 1 --2- 172.21.15.96:0/499930450 >> v2:172.21.15.102:3300/0 conn(0x7f48a4151510 0x7f48a40cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.697+0000 7f48a896d640 1 -- 172.21.15.96:0/499930450 >> v1:172.21.15.102:6789/0 conn(0x7f48a40728b0 legacy=0x7f48a40c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.697+0000 7f48a896d640 1 -- 172.21.15.96:0/499930450 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a415aad0 con 0x7f48a40c61a0 2023-12-01T23:46:06.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.699+0000 7f48a896d640 1 --2- 172.21.15.96:0/499930450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a40c61a0 0x7f48a40cb370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48a40cbe00 tx=0x7f489c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d756ca1b2885ebd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.702+0000 7f48a2ffd640 1 -- 172.21.15.96:0/499930450 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c02cb20 con 0x7f48a40c61a0 2023-12-01T23:46:06.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.702+0000 7f48a2ffd640 1 -- 172.21.15.96:0/499930450 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c02cc80 con 0x7f48a40c61a0 2023-12-01T23:46:06.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.702+0000 7f48a2ffd640 1 -- 172.21.15.96:0/499930450 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0343f0 con 0x7f48a40c61a0 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 -- 172.21.15.96:0/499930450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a40c61a0 msgr2=0x7f48a40cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/499930450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a40c61a0 0x7f48a40cb370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48a40cbe00 tx=0x7f489c02bf80 comp rx=0 tx=0).stop 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 -- 172.21.15.96:0/499930450 shutdown_connections 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/499930450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a40c61a0 0x7f48a40cb370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/499930450 >> v2:172.21.15.102:3300/0 conn(0x7f48a4151510 0x7f48a40cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 -- 172.21.15.96:0/499930450 >> 172.21.15.96:0/499930450 conn(0x7f48a406cd60 msgr2=0x7f48a406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 -- 172.21.15.96:0/499930450 shutdown_connections 2023-12-01T23:46:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.703+0000 7f48aa3d0640 1 -- 172.21.15.96:0/499930450 wait complete. 2023-12-01T23:46:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.704+0000 7f48aa3d0640 1 Processor -- start 2023-12-01T23:46:06.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 -- start start 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48a40728b0 0x7f48a41ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48a40c61a0 0x7f48a4159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4146650 con 0x7f48a4151510 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4145760 con 0x7f48a40728b0 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.705+0000 7f48aa3d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4146a70 con 0x7f48a40c61a0 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.706+0000 7f48a896d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.706+0000 7f48a3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48a40728b0 0x7f48a41ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.706+0000 7f48a37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48a40c61a0 0x7f48a4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.706+0000 7f48a896d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53840/0 (socket says 172.21.15.96:53840) 2023-12-01T23:46:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.706+0000 7f48a896d640 1 -- 172.21.15.96:0/1985324502 learned_addr learned my addr 172.21.15.96:0/1985324502 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.709+0000 7f48a896d640 1 -- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48a40c61a0 msgr2=0x7f48a4159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.709+0000 7f48a896d640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48a40c61a0 0x7f48a4159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.709+0000 7f48a896d640 1 -- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48a40728b0 msgr2=0x7f48a41ec5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.709+0000 7f48a896d640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48a40728b0 0x7f48a41ec5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:06.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.709+0000 7f48a896d640 1 -- 172.21.15.96:0/1985324502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c009b30 con 0x7f48a4151510 2023-12-01T23:46:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.711+0000 7f48a896d640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f489c009f40 tx=0x7f489c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.715+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c009510 con 0x7f48a4151510 2023-12-01T23:46:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.715+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c02c920 con 0x7f48a4151510 2023-12-01T23:46:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.715+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a41459d0 con 0x7f48a4151510 2023-12-01T23:46:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.715+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c03e690 con 0x7f48a4151510 2023-12-01T23:46:06.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.715+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4145f90 con 0x7f48a4151510 2023-12-01T23:46:06.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.716+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a4146790 con 0x7f48a4151510 2023-12-01T23:46:06.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.735+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f489c03e7f0 con 0x7f48a4151510 2023-12-01T23:46:06.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.735+0000 7f48a0ff9640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 0x7f489006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:06.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.736+0000 7f48a3fff640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 0x7f489006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:06.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.736+0000 7f48a3fff640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 0x7f489006d380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4894009b40 tx=0x7f4894009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:06.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.738+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f489c040e70 con 0x7f48a4151510 2023-12-01T23:46:06.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:06.971+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f489c0773a0 con 0x7f48a4151510 2023-12-01T23:46:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.160+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48a4146790 con 0x7f48a4151510 2023-12-01T23:46:07.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.164+0000 7f48a0ff9640 1 -- 172.21.15.96:0/1985324502 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f48a4146790 con 0x7f48a4151510 2023-12-01T23:46:07.165 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 msgr2=0x7f489006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 0x7f489006d380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4894009b40 tx=0x7f4894009190 comp rx=0 tx=0).stop 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 msgr2=0x7f48a4156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f489c009f40 tx=0x7f489c004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 shutdown_connections 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f489006aec0 0x7f489006d380 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48a4151510 0x7f48a4156410 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48a40c61a0 0x7f48a4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:07.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 --2- 172.21.15.96:0/1985324502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48a40728b0 0x7f48a41ec5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:07.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 >> 172.21.15.96:0/1985324502 conn(0x7f48a406cd60 msgr2=0x7f48a414ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:07.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 shutdown_connections 2023-12-01T23:46:07.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:07.166+0000 7f48aa3d0640 1 -- 172.21.15.96:0/1985324502 wait complete. 2023-12-01T23:46:07.178 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-12-01T23:46:07.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:46:07.178 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-01T23:46:07.206 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:46:07.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[97755]: fuse finished with error 0 and tester_r 0 2023-12-01T23:46:07.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:==00:00:26:48.474 97755== 2023-12-01T23:46:07.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:==00:00:26:48.474 97755== Exit program on first error (--exit-on-first-error=yes) 2023-12-01T23:46:07.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:daemon-helper: command failed with exit status 42 2023-12-01T23:46:12.113 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:46:12.116 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:46:13.308 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-01T23:46:13.308 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:46:13.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:46:13.308 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-01T23:46:13.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:46:13.327 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-12-01T23:46:13.385 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-01T23:46:13.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:46:13.386 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T23:46:13.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T23:46:13.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2023-12-01T23:46:13.551 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-01T23:46:13.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-01T23:46:13.561 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:46:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.660+0000 7f9fce26b640 1 Processor -- start 2023-12-01T23:46:13.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.660+0000 7f9fce26b640 1 -- start start 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.661+0000 7f9fce26b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fc80cb480 0x7f9fc815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.661+0000 7f9fce26b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9fc815a240 0x7f9fc815d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.661+0000 7f9fce26b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc8071170 con 0x7f9fc80cb0a0 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.661+0000 7f9fce26b640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc8071450 con 0x7f9fc815a240 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.661+0000 7f9fce26b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc8071730 con 0x7f9fc80cb480 2023-12-01T23:46:13.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.662+0000 7f9fcc808640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9fc815a240 0x7f9fc815d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.662+0000 7f9fcc808640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f9fc815a240 0x7f9fc815d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53852/0 (socket says 172.21.15.96:53852) 2023-12-01T23:46:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.662+0000 7f9fc77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fc80cb480 0x7f9fc815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.662+0000 7f9fcc808640 1 -- 172.21.15.96:0/3350892731 learned_addr learned my addr 172.21.15.96:0/3350892731 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.664+0000 7f9fcc808640 1 -- 172.21.15.96:0/3350892731 >> v2:172.21.15.102:3300/0 conn(0x7f9fc80cb480 msgr2=0x7f9fc815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.664+0000 7f9fcc808640 1 --2- 172.21.15.96:0/3350892731 >> v2:172.21.15.102:3300/0 conn(0x7f9fc80cb480 0x7f9fc815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.664+0000 7f9fcc808640 1 -- 172.21.15.96:0/3350892731 >> v1:172.21.15.102:6789/0 conn(0x7f9fc80cb0a0 legacy=0x7f9fc806f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:13.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.664+0000 7f9fcc808640 1 -- 172.21.15.96:0/3350892731 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8071a10 con 0x7f9fc815a240 2023-12-01T23:46:13.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.666+0000 7f9fcc808640 1 --2- 172.21.15.96:0/3350892731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc815a240 0x7f9fc815d6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fc806eeb0 tx=0x7f9fc002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394805296976788d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:13.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fc6ffd640 1 -- 172.21.15.96:0/3350892731 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc002cb20 con 0x7f9fc815a240 2023-12-01T23:46:13.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fc6ffd640 1 -- 172.21.15.96:0/3350892731 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc002cc80 con 0x7f9fc815a240 2023-12-01T23:46:13.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fc6ffd640 1 -- 172.21.15.96:0/3350892731 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00343f0 con 0x7f9fc815a240 2023-12-01T23:46:13.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 -- 172.21.15.96:0/3350892731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc815a240 msgr2=0x7f9fc815d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:13.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 --2- 172.21.15.96:0/3350892731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc815a240 0x7f9fc815d6b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9fc806eeb0 tx=0x7f9fc002bf80 comp rx=0 tx=0).stop 2023-12-01T23:46:13.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 -- 172.21.15.96:0/3350892731 shutdown_connections 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 --2- 172.21.15.96:0/3350892731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc815a240 0x7f9fc815d6b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 --2- 172.21.15.96:0/3350892731 >> v2:172.21.15.102:3300/0 conn(0x7f9fc80cb480 0x7f9fc815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 -- 172.21.15.96:0/3350892731 >> 172.21.15.96:0/3350892731 conn(0x7f9fc806cd60 msgr2=0x7f9fc806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 -- 172.21.15.96:0/3350892731 shutdown_connections 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.670+0000 7f9fce26b640 1 -- 172.21.15.96:0/3350892731 wait complete. 2023-12-01T23:46:13.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.672+0000 7f9fce26b640 1 Processor -- start 2023-12-01T23:46:13.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.672+0000 7f9fce26b640 1 -- start start 2023-12-01T23:46:13.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc80cb0a0 0x7f9fc81575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc815a240 0x7f9fc8149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81e3e10 con 0x7f9fc80cb480 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81e3830 con 0x7f9fc80cb0a0 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fce26b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc81e3530 con 0x7f9fc815a240 2023-12-01T23:46:13.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fc77fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53858/0 (socket says 172.21.15.96:53858) 2023-12-01T23:46:13.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fc77fe640 1 -- 172.21.15.96:0/2822158540 learned_addr learned my addr 172.21.15.96:0/2822158540 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:13.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.673+0000 7f9fc7fff640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc80cb0a0 0x7f9fc81575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.674+0000 7f9fcc808640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc815a240 0x7f9fc8149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.677+0000 7f9fc77fe640 1 -- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc815a240 msgr2=0x7f9fc8149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.677+0000 7f9fc77fe640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc815a240 0x7f9fc8149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.677+0000 7f9fc77fe640 1 -- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc80cb0a0 msgr2=0x7f9fc81575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.677+0000 7f9fc77fe640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc80cb0a0 0x7f9fc81575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.677+0000 7f9fc77fe640 1 -- 172.21.15.96:0/2822158540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0009b30 con 0x7f9fc80cb480 2023-12-01T23:46:13.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.679+0000 7f9fc77fe640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00e9b0 tx=0x7f9fbc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.682+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc009670 con 0x7f9fc80cb480 2023-12-01T23:46:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.682+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc00c9a0 con 0x7f9fc80cb480 2023-12-01T23:46:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.682+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc00cd30 con 0x7f9fc80cb480 2023-12-01T23:46:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.682+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc8157e00 con 0x7f9fc80cb480 2023-12-01T23:46:13.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.682+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc81583c0 con 0x7f9fc80cb480 2023-12-01T23:46:13.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.683+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc8070e10 con 0x7f9fc80cb480 2023-12-01T23:46:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.701+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9fbc013470 con 0x7f9fc80cb480 2023-12-01T23:46:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.702+0000 7f9fc4ff9640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 0x7f9fb406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:13.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.702+0000 7f9fc7fff640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 0x7f9fb406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:13.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.702+0000 7f9fc7fff640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 0x7f9fb406d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fc814f850 tx=0x7f9fb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:13.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.705+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9fbc058c40 con 0x7f9fc80cb480 2023-12-01T23:46:13.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:13.949+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9fbc054f80 con 0x7f9fc80cb480 2023-12-01T23:46:14.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.115+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fc815cc50 con 0x7f9fb406ae90 2023-12-01T23:46:14.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.125+0000 7f9fc4ff9640 1 -- 172.21.15.96:0/2822158540 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371047 (secure 0 0 0) 0x7f9fb80014c0 con 0x7f9fb406ae90 2023-12-01T23:46:14.131 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:14.133 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:46:14.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.128+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 msgr2=0x7f9fb406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.128+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 0x7f9fb406d350 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9fc814f850 tx=0x7f9fb8009040 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.128+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 msgr2=0x7f9fc81598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.128+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00e9b0 tx=0x7f9fbc00ee70 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 shutdown_connections 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9fb406ae90 0x7f9fb406d350 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc815a240 0x7f9fc8149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc80cb480 0x7f9fc81598a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 --2- 172.21.15.96:0/2822158540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc80cb0a0 0x7f9fc81575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 >> 172.21.15.96:0/2822158540 conn(0x7f9fc806cd60 msgr2=0x7f9fc814ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 shutdown_connections 2023-12-01T23:46:14.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.129+0000 7f9fce26b640 1 -- 172.21.15.96:0/2822158540 wait complete. 2023-12-01T23:46:14.142 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":863,"stamp":"2023-12-01T23:46:12.176549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15659,"ondisk_log_size":15659,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352544,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":27,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002898"},"pg_stats":[{"pgid":"2.1f","version":"29'584","reported_seq":616,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.549640+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:46:01.549640+0000","last_peered":"2023-12-01T23:46:01.549640+0000","last_clean":"2023-12-01T23:46:01.549640+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:01.549640+0000","last_undegraded":"2023-12-01T23:46:01.549640+0000","last_fullsized":"2023-12-01T23:46:01.549640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.488155+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:46:07.488155+0000","last_peered":"2023-12-01T23:46:07.488155+0000","last_clean":"2023-12-01T23:46:07.488155+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:07.488155+0000","last_undegraded":"2023-12-01T23:46:07.488155+0000","last_fullsized":"2023-12-01T23:46:07.488155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137759+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.137759+0000","last_peered":"2023-12-01T23:45:40.137759+0000","last_clean":"2023-12-01T23:45:40.137759+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.137759+0000","last_undegraded":"2023-12-01T23:45:40.137759+0000","last_fullsized":"2023-12-01T23:45:40.137759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'721","reported_seq":753,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.383573+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:45:48.383573+0000","last_peered":"2023-12-01T23:45:48.383573+0000","last_clean":"2023-12-01T23:45:48.383573+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:45:48.383573+0000","last_undegraded":"2023-12-01T23:45:48.383573+0000","last_fullsized":"2023-12-01T23:45:48.383573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506249+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:46:07.506249+0000","last_peered":"2023-12-01T23:46:07.506249+0000","last_clean":"2023-12-01T23:46:07.506249+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:07.506249+0000","last_undegraded":"2023-12-01T23:46:07.506249+0000","last_fullsized":"2023-12-01T23:46:07.506249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:35.302116+0000","last_change":"2023-12-01T23:19:06.103620+0000","last_active":"2023-12-01T23:45:35.302116+0000","last_peered":"2023-12-01T23:45:35.302116+0000","last_clean":"2023-12-01T23:45:35.302116+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:45:35.302116+0000","last_undegraded":"2023-12-01T23:45:35.302116+0000","last_fullsized":"2023-12-01T23:45:35.302116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:18:06.190136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1374","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565136+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:45:58.565136+0000","last_peered":"2023-12-01T23:45:58.565136+0000","last_clean":"2023-12-01T23:45:58.565136+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:45:58.565136+0000","last_undegraded":"2023-12-01T23:45:58.565136+0000","last_fullsized":"2023-12-01T23:45:58.565136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504046+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:46:07.504046+0000","last_peered":"2023-12-01T23:46:07.504046+0000","last_clean":"2023-12-01T23:46:07.504046+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:07.504046+0000","last_undegraded":"2023-12-01T23:46:07.504046+0000","last_fullsized":"2023-12-01T23:46:07.504046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143603+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:45:40.143603+0000","last_peered":"2023-12-01T23:45:40.143603+0000","last_clean":"2023-12-01T23:45:40.143603+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:45:40.143603+0000","last_undegraded":"2023-12-01T23:45:40.143603+0000","last_fullsized":"2023-12-01T23:45:40.143603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:59.111214+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:45:59.111214+0000","last_peered":"2023-12-01T23:45:59.111214+0000","last_clean":"2023-12-01T23:45:59.111214+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:45:59.111214+0000","last_undegraded":"2023-12-01T23:45:59.111214+0000","last_fullsized":"2023-12-01T23:45:59.111214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504109+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:46:07.504109+0000","last_peered":"2023-12-01T23:46:07.504109+0000","last_clean":"2023-12-01T23:46:07.504109+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:07.504109+0000","last_undegraded":"2023-12-01T23:46:07.504109+0000","last_fullsized":"2023-12-01T23:46:07.504109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:33.156414+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:45:33.156414+0000","last_peered":"2023-12-01T23:45:33.156414+0000","last_clean":"2023-12-01T23:45:33.156414+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:45:33.156414+0000","last_undegraded":"2023-12-01T23:45:33.156414+0000","last_fullsized":"2023-12-01T23:45:33.156414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588270+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:46:07.588270+0000","last_peered":"2023-12-01T23:46:07.588270+0000","last_clean":"2023-12-01T23:46:07.588270+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:07.588270+0000","last_undegraded":"2023-12-01T23:46:07.588270+0000","last_fullsized":"2023-12-01T23:46:07.588270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'634","reported_seq":665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.532741+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:45:58.532741+0000","last_peered":"2023-12-01T23:45:58.532741+0000","last_clean":"2023-12-01T23:45:58.532741+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:45:58.532741+0000","last_undegraded":"2023-12-01T23:45:58.532741+0000","last_fullsized":"2023-12-01T23:45:58.532741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.284663+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:45:39.284663+0000","last_peered":"2023-12-01T23:45:39.284663+0000","last_clean":"2023-12-01T23:45:39.284663+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:45:39.284663+0000","last_undegraded":"2023-12-01T23:45:39.284663+0000","last_fullsized":"2023-12-01T23:45:39.284663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491511+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:46:07.491511+0000","last_peered":"2023-12-01T23:46:07.491511+0000","last_clean":"2023-12-01T23:46:07.491511+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:07.491511+0000","last_undegraded":"2023-12-01T23:46:07.491511+0000","last_fullsized":"2023-12-01T23:46:07.491511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288102+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:45:44.288102+0000","last_peered":"2023-12-01T23:45:44.288102+0000","last_clean":"2023-12-01T23:45:44.288102+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:45:44.288102+0000","last_undegraded":"2023-12-01T23:45:44.288102+0000","last_fullsized":"2023-12-01T23:45:44.288102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143684+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143684+0000","last_peered":"2023-12-01T23:45:40.143684+0000","last_clean":"2023-12-01T23:45:40.143684+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143684+0000","last_undegraded":"2023-12-01T23:45:40.143684+0000","last_fullsized":"2023-12-01T23:45:40.143684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507118+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:46:07.507118+0000","last_peered":"2023-12-01T23:46:07.507118+0000","last_clean":"2023-12-01T23:46:07.507118+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:07.507118+0000","last_undegraded":"2023-12-01T23:46:07.507118+0000","last_fullsized":"2023-12-01T23:46:07.507118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288099+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:45:44.288099+0000","last_peered":"2023-12-01T23:45:44.288099+0000","last_clean":"2023-12-01T23:45:44.288099+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:45:44.288099+0000","last_undegraded":"2023-12-01T23:45:44.288099+0000","last_fullsized":"2023-12-01T23:45:44.288099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.239466+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:39.239466+0000","last_peered":"2023-12-01T23:45:39.239466+0000","last_clean":"2023-12-01T23:45:39.239466+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:39.239466+0000","last_undegraded":"2023-12-01T23:45:39.239466+0000","last_fullsized":"2023-12-01T23:45:39.239466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.994567+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:45:37.994567+0000","last_peered":"2023-12-01T23:45:37.994567+0000","last_clean":"2023-12-01T23:45:37.994567+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:45:37.994567+0000","last_undegraded":"2023-12-01T23:45:37.994567+0000","last_fullsized":"2023-12-01T23:45:37.994567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.470358+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:45:56.470358+0000","last_peered":"2023-12-01T23:45:56.470358+0000","last_clean":"2023-12-01T23:45:56.470358+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:45:56.470358+0000","last_undegraded":"2023-12-01T23:45:56.470358+0000","last_fullsized":"2023-12-01T23:45:56.470358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.849137+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:45:37.849137+0000","last_peered":"2023-12-01T23:45:37.849137+0000","last_clean":"2023-12-01T23:45:37.849137+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:45:37.849137+0000","last_undegraded":"2023-12-01T23:45:37.849137+0000","last_fullsized":"2023-12-01T23:45:37.849137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503456+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:46:07.503456+0000","last_peered":"2023-12-01T23:46:07.503456+0000","last_clean":"2023-12-01T23:46:07.503456+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:07.503456+0000","last_undegraded":"2023-12-01T23:46:07.503456+0000","last_fullsized":"2023-12-01T23:46:07.503456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135804+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:45:39.135804+0000","last_peered":"2023-12-01T23:45:39.135804+0000","last_clean":"2023-12-01T23:45:39.135804+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:45:39.135804+0000","last_undegraded":"2023-12-01T23:45:39.135804+0000","last_fullsized":"2023-12-01T23:45:39.135804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511306+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:46:07.511306+0000","last_peered":"2023-12-01T23:46:07.511306+0000","last_clean":"2023-12-01T23:46:07.511306+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:07.511306+0000","last_undegraded":"2023-12-01T23:46:07.511306+0000","last_fullsized":"2023-12-01T23:46:07.511306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'309","reported_seq":340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.815973+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:46:01.815973+0000","last_peered":"2023-12-01T23:46:01.815973+0000","last_clean":"2023-12-01T23:46:01.815973+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:01.815973+0000","last_undegraded":"2023-12-01T23:46:01.815973+0000","last_fullsized":"2023-12-01T23:46:01.815973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.975866+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:45:37.975866+0000","last_peered":"2023-12-01T23:45:37.975866+0000","last_clean":"2023-12-01T23:45:37.975866+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:45:37.975866+0000","last_undegraded":"2023-12-01T23:45:37.975866+0000","last_fullsized":"2023-12-01T23:45:37.975866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424012+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:46:07.424012+0000","last_peered":"2023-12-01T23:46:07.424012+0000","last_clean":"2023-12-01T23:46:07.424012+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:07.424012+0000","last_undegraded":"2023-12-01T23:46:07.424012+0000","last_fullsized":"2023-12-01T23:46:07.424012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:50.389391+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:45:50.389391+0000","last_peered":"2023-12-01T23:45:50.389391+0000","last_clean":"2023-12-01T23:45:50.389391+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:45:50.389391+0000","last_undegraded":"2023-12-01T23:45:50.389391+0000","last_fullsized":"2023-12-01T23:45:50.389391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":160,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.077188+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:45:39.077188+0000","last_peered":"2023-12-01T23:45:39.077188+0000","last_clean":"2023-12-01T23:45:39.077188+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:45:39.077188+0000","last_undegraded":"2023-12-01T23:45:39.077188+0000","last_fullsized":"2023-12-01T23:45:39.077188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507506+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:46:07.507506+0000","last_peered":"2023-12-01T23:46:07.507506+0000","last_clean":"2023-12-01T23:46:07.507506+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:07.507506+0000","last_undegraded":"2023-12-01T23:46:07.507506+0000","last_fullsized":"2023-12-01T23:46:07.507506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.427894+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:45:52.427894+0000","last_peered":"2023-12-01T23:45:52.427894+0000","last_clean":"2023-12-01T23:45:52.427894+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:45:52.427894+0000","last_undegraded":"2023-12-01T23:45:52.427894+0000","last_fullsized":"2023-12-01T23:45:52.427894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":219,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.136442+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:39.136442+0000","last_peered":"2023-12-01T23:45:39.136442+0000","last_clean":"2023-12-01T23:45:39.136442+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:39.136442+0000","last_undegraded":"2023-12-01T23:45:39.136442+0000","last_fullsized":"2023-12-01T23:45:39.136442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447483+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:46:07.447483+0000","last_peered":"2023-12-01T23:46:07.447483+0000","last_clean":"2023-12-01T23:46:07.447483+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:07.447483+0000","last_undegraded":"2023-12-01T23:46:07.447483+0000","last_fullsized":"2023-12-01T23:46:07.447483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565477+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:45:58.565477+0000","last_peered":"2023-12-01T23:45:58.565477+0000","last_clean":"2023-12-01T23:45:58.565477+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:45:58.565477+0000","last_undegraded":"2023-12-01T23:45:58.565477+0000","last_fullsized":"2023-12-01T23:45:58.565477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.268353+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:39.268353+0000","last_peered":"2023-12-01T23:45:39.268353+0000","last_clean":"2023-12-01T23:45:39.268353+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:39.268353+0000","last_undegraded":"2023-12-01T23:45:39.268353+0000","last_fullsized":"2023-12-01T23:45:39.268353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423058+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:07.423058+0000","last_peered":"2023-12-01T23:46:07.423058+0000","last_clean":"2023-12-01T23:46:07.423058+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:07.423058+0000","last_undegraded":"2023-12-01T23:46:07.423058+0000","last_fullsized":"2023-12-01T23:46:07.423058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2094,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.534843+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:46:01.534843+0000","last_peered":"2023-12-01T23:46:01.534843+0000","last_clean":"2023-12-01T23:46:01.534843+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:01.534843+0000","last_undegraded":"2023-12-01T23:46:01.534843+0000","last_fullsized":"2023-12-01T23:46:01.534843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134701+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:45:39.134701+0000","last_peered":"2023-12-01T23:45:39.134701+0000","last_clean":"2023-12-01T23:45:39.134701+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:45:39.134701+0000","last_undegraded":"2023-12-01T23:45:39.134701+0000","last_fullsized":"2023-12-01T23:45:39.134701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506489+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:46:07.506489+0000","last_peered":"2023-12-01T23:46:07.506489+0000","last_clean":"2023-12-01T23:46:07.506489+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:07.506489+0000","last_undegraded":"2023-12-01T23:46:07.506489+0000","last_fullsized":"2023-12-01T23:46:07.506489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'521","reported_seq":553,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446851+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:45:52.446851+0000","last_peered":"2023-12-01T23:45:52.446851+0000","last_clean":"2023-12-01T23:45:52.446851+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:45:52.446851+0000","last_undegraded":"2023-12-01T23:45:52.446851+0000","last_fullsized":"2023-12-01T23:45:52.446851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.274188+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:45:39.274188+0000","last_peered":"2023-12-01T23:45:39.274188+0000","last_clean":"2023-12-01T23:45:39.274188+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:45:39.274188+0000","last_undegraded":"2023-12-01T23:45:39.274188+0000","last_fullsized":"2023-12-01T23:45:39.274188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.499828+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:46:07.499828+0000","last_peered":"2023-12-01T23:46:07.499828+0000","last_clean":"2023-12-01T23:46:07.499828+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:07.499828+0000","last_undegraded":"2023-12-01T23:46:07.499828+0000","last_fullsized":"2023-12-01T23:46:07.499828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.085700+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:45:34.085700+0000","last_peered":"2023-12-01T23:45:34.085700+0000","last_clean":"2023-12-01T23:45:34.085700+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:45:34.085700+0000","last_undegraded":"2023-12-01T23:45:34.085700+0000","last_fullsized":"2023-12-01T23:45:34.085700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:42:24.091255+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:42:24.091255+0000","last_peered":"2023-12-01T23:42:24.091255+0000","last_clean":"2023-12-01T23:42:24.091255+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:42:24.091255+0000","last_undegraded":"2023-12-01T23:42:24.091255+0000","last_fullsized":"2023-12-01T23:42:24.091255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":215,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152410+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:45:40.152410+0000","last_peered":"2023-12-01T23:45:40.152410+0000","last_clean":"2023-12-01T23:45:40.152410+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:45:40.152410+0000","last_undegraded":"2023-12-01T23:45:40.152410+0000","last_fullsized":"2023-12-01T23:45:40.152410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578898+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:46:07.578898+0000","last_peered":"2023-12-01T23:46:07.578898+0000","last_clean":"2023-12-01T23:46:07.578898+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:46:07.578898+0000","last_undegraded":"2023-12-01T23:46:07.578898+0000","last_fullsized":"2023-12-01T23:46:07.578898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317219+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:45:46.317219+0000","last_peered":"2023-12-01T23:45:46.317219+0000","last_clean":"2023-12-01T23:45:46.317219+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:45:46.317219+0000","last_undegraded":"2023-12-01T23:45:46.317219+0000","last_fullsized":"2023-12-01T23:45:46.317219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.581319+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:45:34.581319+0000","last_peered":"2023-12-01T23:45:34.581319+0000","last_clean":"2023-12-01T23:45:34.581319+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:45:34.581319+0000","last_undegraded":"2023-12-01T23:45:34.581319+0000","last_fullsized":"2023-12-01T23:45:34.581319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429551+0000","last_change":"2023-12-01T23:19:06.056259+0000","last_active":"2023-12-01T23:46:07.429551+0000","last_peered":"2023-12-01T23:46:07.429551+0000","last_clean":"2023-12-01T23:46:07.429551+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:07.429551+0000","last_undegraded":"2023-12-01T23:46:07.429551+0000","last_fullsized":"2023-12-01T23:46:07.429551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:02.070575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.527321+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:46:00.527321+0000","last_peered":"2023-12-01T23:46:00.527321+0000","last_clean":"2023-12-01T23:46:00.527321+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:00.527321+0000","last_undegraded":"2023-12-01T23:46:00.527321+0000","last_fullsized":"2023-12-01T23:46:00.527321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":222,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.265895+0000","last_change":"2023-12-01T23:19:06.163021+0000","last_active":"2023-12-01T23:45:39.265895+0000","last_peered":"2023-12-01T23:45:39.265895+0000","last_clean":"2023-12-01T23:45:39.265895+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:45:39.265895+0000","last_undegraded":"2023-12-01T23:45:39.265895+0000","last_fullsized":"2023-12-01T23:45:39.265895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:00:33.222976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578723+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.578723+0000","last_peered":"2023-12-01T23:46:07.578723+0000","last_clean":"2023-12-01T23:46:07.578723+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.578723+0000","last_undegraded":"2023-12-01T23:46:07.578723+0000","last_fullsized":"2023-12-01T23:46:07.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:43.162322+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:45:43.162322+0000","last_peered":"2023-12-01T23:45:43.162322+0000","last_clean":"2023-12-01T23:45:43.162322+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:45:43.162322+0000","last_undegraded":"2023-12-01T23:45:43.162322+0000","last_fullsized":"2023-12-01T23:45:43.162322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.280157+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:45:39.280157+0000","last_peered":"2023-12-01T23:45:39.280157+0000","last_clean":"2023-12-01T23:45:39.280157+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:45:39.280157+0000","last_undegraded":"2023-12-01T23:45:39.280157+0000","last_fullsized":"2023-12-01T23:45:39.280157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575841+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.575841+0000","last_peered":"2023-12-01T23:46:07.575841+0000","last_clean":"2023-12-01T23:46:07.575841+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:46:07.575841+0000","last_undegraded":"2023-12-01T23:46:07.575841+0000","last_fullsized":"2023-12-01T23:46:07.575841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.564741+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:45:58.564741+0000","last_peered":"2023-12-01T23:45:58.564741+0000","last_clean":"2023-12-01T23:45:58.564741+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:45:58.564741+0000","last_undegraded":"2023-12-01T23:45:58.564741+0000","last_fullsized":"2023-12-01T23:45:58.564741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135509+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:45:39.135509+0000","last_peered":"2023-12-01T23:45:39.135509+0000","last_clean":"2023-12-01T23:45:39.135509+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:45:39.135509+0000","last_undegraded":"2023-12-01T23:45:39.135509+0000","last_fullsized":"2023-12-01T23:45:39.135509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575888+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:46:07.575888+0000","last_peered":"2023-12-01T23:46:07.575888+0000","last_clean":"2023-12-01T23:46:07.575888+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:07.575888+0000","last_undegraded":"2023-12-01T23:46:07.575888+0000","last_fullsized":"2023-12-01T23:46:07.575888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317486+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:45:46.317486+0000","last_peered":"2023-12-01T23:45:46.317486+0000","last_clean":"2023-12-01T23:45:46.317486+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:45:46.317486+0000","last_undegraded":"2023-12-01T23:45:46.317486+0000","last_fullsized":"2023-12-01T23:45:46.317486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135127+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:45:39.135127+0000","last_peered":"2023-12-01T23:45:39.135127+0000","last_clean":"2023-12-01T23:45:39.135127+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:45:39.135127+0000","last_undegraded":"2023-12-01T23:45:39.135127+0000","last_fullsized":"2023-12-01T23:45:39.135127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.586320+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:46:07.586320+0000","last_peered":"2023-12-01T23:46:07.586320+0000","last_clean":"2023-12-01T23:46:07.586320+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:07.586320+0000","last_undegraded":"2023-12-01T23:46:07.586320+0000","last_fullsized":"2023-12-01T23:46:07.586320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.384828+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:45:48.384828+0000","last_peered":"2023-12-01T23:45:48.384828+0000","last_clean":"2023-12-01T23:45:48.384828+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:45:48.384828+0000","last_undegraded":"2023-12-01T23:45:48.384828+0000","last_fullsized":"2023-12-01T23:45:48.384828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.278999+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:39.278999+0000","last_peered":"2023-12-01T23:45:39.278999+0000","last_clean":"2023-12-01T23:45:39.278999+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:39.278999+0000","last_undegraded":"2023-12-01T23:45:39.278999+0000","last_fullsized":"2023-12-01T23:45:39.278999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.432398+0000","last_change":"2023-12-01T23:19:06.056474+0000","last_active":"2023-12-01T23:46:07.432398+0000","last_peered":"2023-12-01T23:46:07.432398+0000","last_clean":"2023-12-01T23:46:07.432398+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:07.432398+0000","last_undegraded":"2023-12-01T23:46:07.432398+0000","last_fullsized":"2023-12-01T23:46:07.432398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:00.298932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565262+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:45:58.565262+0000","last_peered":"2023-12-01T23:45:58.565262+0000","last_clean":"2023-12-01T23:45:58.565262+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:45:58.565262+0000","last_undegraded":"2023-12-01T23:45:58.565262+0000","last_fullsized":"2023-12-01T23:45:58.565262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137373+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:45:40.137373+0000","last_peered":"2023-12-01T23:45:40.137373+0000","last_clean":"2023-12-01T23:45:40.137373+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:45:40.137373+0000","last_undegraded":"2023-12-01T23:45:40.137373+0000","last_fullsized":"2023-12-01T23:45:40.137373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503494+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:46:07.503494+0000","last_peered":"2023-12-01T23:46:07.503494+0000","last_clean":"2023-12-01T23:46:07.503494+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:07.503494+0000","last_undegraded":"2023-12-01T23:46:07.503494+0000","last_fullsized":"2023-12-01T23:46:07.503494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'256","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.260901+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:46:07.260901+0000","last_peered":"2023-12-01T23:46:07.260901+0000","last_clean":"2023-12-01T23:46:07.260901+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:07.260901+0000","last_undegraded":"2023-12-01T23:46:07.260901+0000","last_fullsized":"2023-12-01T23:46:07.260901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.211620+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.211620+0000","last_peered":"2023-12-01T23:45:39.211620+0000","last_clean":"2023-12-01T23:45:39.211620+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.211620+0000","last_undegraded":"2023-12-01T23:45:39.211620+0000","last_fullsized":"2023-12-01T23:45:39.211620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578590+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:46:07.578590+0000","last_peered":"2023-12-01T23:46:07.578590+0000","last_clean":"2023-12-01T23:46:07.578590+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:07.578590+0000","last_undegraded":"2023-12-01T23:46:07.578590+0000","last_fullsized":"2023-12-01T23:46:07.578590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.992466+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:45:56.992466+0000","last_peered":"2023-12-01T23:45:56.992466+0000","last_clean":"2023-12-01T23:45:56.992466+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:45:56.992466+0000","last_undegraded":"2023-12-01T23:45:56.992466+0000","last_fullsized":"2023-12-01T23:45:56.992466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152294+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:45:40.152294+0000","last_peered":"2023-12-01T23:45:40.152294+0000","last_clean":"2023-12-01T23:45:40.152294+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:45:40.152294+0000","last_undegraded":"2023-12-01T23:45:40.152294+0000","last_fullsized":"2023-12-01T23:45:40.152294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448442+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:46:07.448442+0000","last_peered":"2023-12-01T23:46:07.448442+0000","last_clean":"2023-12-01T23:46:07.448442+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:07.448442+0000","last_undegraded":"2023-12-01T23:46:07.448442+0000","last_fullsized":"2023-12-01T23:46:07.448442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'696","reported_seq":726,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.553477+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:46:01.553477+0000","last_peered":"2023-12-01T23:46:01.553477+0000","last_clean":"2023-12-01T23:46:01.553477+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:01.553477+0000","last_undegraded":"2023-12-01T23:46:01.553477+0000","last_fullsized":"2023-12-01T23:46:01.553477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.207440+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:45:39.207440+0000","last_peered":"2023-12-01T23:45:39.207440+0000","last_clean":"2023-12-01T23:45:39.207440+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:45:39.207440+0000","last_undegraded":"2023-12-01T23:45:39.207440+0000","last_fullsized":"2023-12-01T23:45:39.207440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503556+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:46:07.503556+0000","last_peered":"2023-12-01T23:46:07.503556+0000","last_clean":"2023-12-01T23:46:07.503556+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:07.503556+0000","last_undegraded":"2023-12-01T23:46:07.503556+0000","last_fullsized":"2023-12-01T23:46:07.503556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.354784+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:45:49.354784+0000","last_peered":"2023-12-01T23:45:49.354784+0000","last_clean":"2023-12-01T23:45:49.354784+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:45:49.354784+0000","last_undegraded":"2023-12-01T23:45:49.354784+0000","last_fullsized":"2023-12-01T23:45:49.354784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.976384+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:45:37.976384+0000","last_peered":"2023-12-01T23:45:37.976384+0000","last_clean":"2023-12-01T23:45:37.976384+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:45:37.976384+0000","last_undegraded":"2023-12-01T23:45:37.976384+0000","last_fullsized":"2023-12-01T23:45:37.976384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500976+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:46:07.500976+0000","last_peered":"2023-12-01T23:46:07.500976+0000","last_clean":"2023-12-01T23:46:07.500976+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:07.500976+0000","last_undegraded":"2023-12-01T23:46:07.500976+0000","last_fullsized":"2023-12-01T23:46:07.500976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.340217+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:45:49.340217+0000","last_peered":"2023-12-01T23:45:49.340217+0000","last_clean":"2023-12-01T23:45:49.340217+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:45:49.340217+0000","last_undegraded":"2023-12-01T23:45:49.340217+0000","last_fullsized":"2023-12-01T23:45:49.340217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.276183+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:45:39.276183+0000","last_peered":"2023-12-01T23:45:39.276183+0000","last_clean":"2023-12-01T23:45:39.276183+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:45:39.276183+0000","last_undegraded":"2023-12-01T23:45:39.276183+0000","last_fullsized":"2023-12-01T23:45:39.276183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.430560+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:45:34.430560+0000","last_peered":"2023-12-01T23:45:34.430560+0000","last_clean":"2023-12-01T23:45:34.430560+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:45:34.430560+0000","last_undegraded":"2023-12-01T23:45:34.430560+0000","last_fullsized":"2023-12-01T23:45:34.430560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429200+0000","last_change":"2023-12-01T23:19:06.057281+0000","last_active":"2023-12-01T23:46:07.429200+0000","last_peered":"2023-12-01T23:46:07.429200+0000","last_clean":"2023-12-01T23:46:07.429200+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:07.429200+0000","last_undegraded":"2023-12-01T23:46:07.429200+0000","last_fullsized":"2023-12-01T23:46:07.429200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:15:36.967562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.532515+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:46:00.532515+0000","last_peered":"2023-12-01T23:46:00.532515+0000","last_clean":"2023-12-01T23:46:00.532515+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:00.532515+0000","last_undegraded":"2023-12-01T23:46:00.532515+0000","last_fullsized":"2023-12-01T23:46:00.532515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.071949+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:45:40.071949+0000","last_peered":"2023-12-01T23:45:40.071949+0000","last_clean":"2023-12-01T23:45:40.071949+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:45:40.071949+0000","last_undegraded":"2023-12-01T23:45:40.071949+0000","last_fullsized":"2023-12-01T23:45:40.071949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510478+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:46:07.510478+0000","last_peered":"2023-12-01T23:46:07.510478+0000","last_clean":"2023-12-01T23:46:07.510478+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:07.510478+0000","last_undegraded":"2023-12-01T23:46:07.510478+0000","last_fullsized":"2023-12-01T23:46:07.510478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446752+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:45:52.446752+0000","last_peered":"2023-12-01T23:45:52.446752+0000","last_clean":"2023-12-01T23:45:52.446752+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:45:52.446752+0000","last_undegraded":"2023-12-01T23:45:52.446752+0000","last_fullsized":"2023-12-01T23:45:52.446752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'687","reported_seq":717,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.887479+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:45:57.887479+0000","last_peered":"2023-12-01T23:45:57.887479+0000","last_clean":"2023-12-01T23:45:57.887479+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:45:57.887479+0000","last_undegraded":"2023-12-01T23:45:57.887479+0000","last_fullsized":"2023-12-01T23:45:57.887479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503298+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:46:07.503298+0000","last_peered":"2023-12-01T23:46:07.503298+0000","last_clean":"2023-12-01T23:46:07.503298+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:07.503298+0000","last_undegraded":"2023-12-01T23:46:07.503298+0000","last_fullsized":"2023-12-01T23:46:07.503298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134507+0000","last_change":"2023-12-01T23:19:06.163026+0000","last_active":"2023-12-01T23:45:39.134507+0000","last_peered":"2023-12-01T23:45:39.134507+0000","last_clean":"2023-12-01T23:45:39.134507+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:45:39.134507+0000","last_undegraded":"2023-12-01T23:45:39.134507+0000","last_fullsized":"2023-12-01T23:45:39.134507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'676","reported_seq":706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.469370+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:45:56.469370+0000","last_peered":"2023-12-01T23:45:56.469370+0000","last_clean":"2023-12-01T23:45:56.469370+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:45:56.469370+0000","last_undegraded":"2023-12-01T23:45:56.469370+0000","last_fullsized":"2023-12-01T23:45:56.469370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448156+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:46:07.448156+0000","last_peered":"2023-12-01T23:46:07.448156+0000","last_clean":"2023-12-01T23:46:07.448156+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:07.448156+0000","last_undegraded":"2023-12-01T23:46:07.448156+0000","last_fullsized":"2023-12-01T23:46:07.448156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134413+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:45:39.134413+0000","last_peered":"2023-12-01T23:45:39.134413+0000","last_clean":"2023-12-01T23:45:39.134413+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:45:39.134413+0000","last_undegraded":"2023-12-01T23:45:39.134413+0000","last_fullsized":"2023-12-01T23:45:39.134413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588952+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:46:07.588952+0000","last_peered":"2023-12-01T23:46:07.588952+0000","last_clean":"2023-12-01T23:46:07.588952+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:07.588952+0000","last_undegraded":"2023-12-01T23:46:07.588952+0000","last_fullsized":"2023-12-01T23:46:07.588952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429738+0000","last_change":"2023-12-01T23:19:06.058763+0000","last_active":"2023-12-01T23:46:07.429738+0000","last_peered":"2023-12-01T23:46:07.429738+0000","last_clean":"2023-12-01T23:46:07.429738+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:07.429738+0000","last_undegraded":"2023-12-01T23:46:07.429738+0000","last_fullsized":"2023-12-01T23:46:07.429738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:01.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507283+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:46:07.507283+0000","last_peered":"2023-12-01T23:46:07.507283+0000","last_clean":"2023-12-01T23:46:07.507283+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:46:07.507283+0000","last_undegraded":"2023-12-01T23:46:07.507283+0000","last_fullsized":"2023-12-01T23:46:07.507283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500625+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:46:07.500625+0000","last_peered":"2023-12-01T23:46:07.500625+0000","last_clean":"2023-12-01T23:46:07.500625+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:07.500625+0000","last_undegraded":"2023-12-01T23:46:07.500625+0000","last_fullsized":"2023-12-01T23:46:07.500625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.514310+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:46:07.514310+0000","last_peered":"2023-12-01T23:46:07.514310+0000","last_clean":"2023-12-01T23:46:07.514310+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:07.514310+0000","last_undegraded":"2023-12-01T23:46:07.514310+0000","last_fullsized":"2023-12-01T23:46:07.514310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424251+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:46:07.424251+0000","last_peered":"2023-12-01T23:46:07.424251+0000","last_clean":"2023-12-01T23:46:07.424251+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:07.424251+0000","last_undegraded":"2023-12-01T23:46:07.424251+0000","last_fullsized":"2023-12-01T23:46:07.424251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591499+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:46:07.591499+0000","last_peered":"2023-12-01T23:46:07.591499+0000","last_clean":"2023-12-01T23:46:07.591499+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:07.591499+0000","last_undegraded":"2023-12-01T23:46:07.591499+0000","last_fullsized":"2023-12-01T23:46:07.591499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491852+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:46:07.491852+0000","last_peered":"2023-12-01T23:46:07.491852+0000","last_clean":"2023-12-01T23:46:07.491852+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:07.491852+0000","last_undegraded":"2023-12-01T23:46:07.491852+0000","last_fullsized":"2023-12-01T23:46:07.491852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507294+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:46:07.507294+0000","last_peered":"2023-12-01T23:46:07.507294+0000","last_clean":"2023-12-01T23:46:07.507294+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:07.507294+0000","last_undegraded":"2023-12-01T23:46:07.507294+0000","last_fullsized":"2023-12-01T23:46:07.507294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510325+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:46:07.510325+0000","last_peered":"2023-12-01T23:46:07.510325+0000","last_clean":"2023-12-01T23:46:07.510325+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:07.510325+0000","last_undegraded":"2023-12-01T23:46:07.510325+0000","last_fullsized":"2023-12-01T23:46:07.510325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506232+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:46:07.506232+0000","last_peered":"2023-12-01T23:46:07.506232+0000","last_clean":"2023-12-01T23:46:07.506232+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:46:07.506232+0000","last_undegraded":"2023-12-01T23:46:07.506232+0000","last_fullsized":"2023-12-01T23:46:07.506232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503212+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:46:07.503212+0000","last_peered":"2023-12-01T23:46:07.503212+0000","last_clean":"2023-12-01T23:46:07.503212+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:07.503212+0000","last_undegraded":"2023-12-01T23:46:07.503212+0000","last_fullsized":"2023-12-01T23:46:07.503212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588627+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:46:07.588627+0000","last_peered":"2023-12-01T23:46:07.588627+0000","last_clean":"2023-12-01T23:46:07.588627+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:07.588627+0000","last_undegraded":"2023-12-01T23:46:07.588627+0000","last_fullsized":"2023-12-01T23:46:07.588627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578518+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578518+0000","last_peered":"2023-12-01T23:46:07.578518+0000","last_clean":"2023-12-01T23:46:07.578518+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578518+0000","last_undegraded":"2023-12-01T23:46:07.578518+0000","last_fullsized":"2023-12-01T23:46:07.578518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.431852+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:46:07.431852+0000","last_peered":"2023-12-01T23:46:07.431852+0000","last_clean":"2023-12-01T23:46:07.431852+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:07.431852+0000","last_undegraded":"2023-12-01T23:46:07.431852+0000","last_fullsized":"2023-12-01T23:46:07.431852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.497772+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:46:07.497772+0000","last_peered":"2023-12-01T23:46:07.497772+0000","last_clean":"2023-12-01T23:46:07.497772+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:07.497772+0000","last_undegraded":"2023-12-01T23:46:07.497772+0000","last_fullsized":"2023-12-01T23:46:07.497772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504038+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:46:07.504038+0000","last_peered":"2023-12-01T23:46:07.504038+0000","last_clean":"2023-12-01T23:46:07.504038+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:07.504038+0000","last_undegraded":"2023-12-01T23:46:07.504038+0000","last_fullsized":"2023-12-01T23:46:07.504038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423212+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:46:07.423212+0000","last_peered":"2023-12-01T23:46:07.423212+0000","last_clean":"2023-12-01T23:46:07.423212+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:07.423212+0000","last_undegraded":"2023-12-01T23:46:07.423212+0000","last_fullsized":"2023-12-01T23:46:07.423212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503576+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:46:07.503576+0000","last_peered":"2023-12-01T23:46:07.503576+0000","last_clean":"2023-12-01T23:46:07.503576+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:07.503576+0000","last_undegraded":"2023-12-01T23:46:07.503576+0000","last_fullsized":"2023-12-01T23:46:07.503576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511618+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:46:07.511618+0000","last_peered":"2023-12-01T23:46:07.511618+0000","last_clean":"2023-12-01T23:46:07.511618+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:07.511618+0000","last_undegraded":"2023-12-01T23:46:07.511618+0000","last_fullsized":"2023-12-01T23:46:07.511618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447672+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:46:07.447672+0000","last_peered":"2023-12-01T23:46:07.447672+0000","last_clean":"2023-12-01T23:46:07.447672+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:07.447672+0000","last_undegraded":"2023-12-01T23:46:07.447672+0000","last_fullsized":"2023-12-01T23:46:07.447672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.587639+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:46:07.587639+0000","last_peered":"2023-12-01T23:46:07.587639+0000","last_clean":"2023-12-01T23:46:07.587639+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:07.587639+0000","last_undegraded":"2023-12-01T23:46:07.587639+0000","last_fullsized":"2023-12-01T23:46:07.587639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591637+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:46:07.591637+0000","last_peered":"2023-12-01T23:46:07.591637+0000","last_clean":"2023-12-01T23:46:07.591637+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:07.591637+0000","last_undegraded":"2023-12-01T23:46:07.591637+0000","last_fullsized":"2023-12-01T23:46:07.591637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578993+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.578993+0000","last_peered":"2023-12-01T23:46:07.578993+0000","last_clean":"2023-12-01T23:46:07.578993+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.578993+0000","last_undegraded":"2023-12-01T23:46:07.578993+0000","last_fullsized":"2023-12-01T23:46:07.578993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511817+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:46:07.511817+0000","last_peered":"2023-12-01T23:46:07.511817+0000","last_clean":"2023-12-01T23:46:07.511817+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:07.511817+0000","last_undegraded":"2023-12-01T23:46:07.511817+0000","last_fullsized":"2023-12-01T23:46:07.511817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.572644+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:46:07.572644+0000","last_peered":"2023-12-01T23:46:07.572644+0000","last_clean":"2023-12-01T23:46:07.572644+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:07.572644+0000","last_undegraded":"2023-12-01T23:46:07.572644+0000","last_fullsized":"2023-12-01T23:46:07.572644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504289+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:46:07.504289+0000","last_peered":"2023-12-01T23:46:07.504289+0000","last_clean":"2023-12-01T23:46:07.504289+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:46:07.504289+0000","last_undegraded":"2023-12-01T23:46:07.504289+0000","last_fullsized":"2023-12-01T23:46:07.504289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.571255+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:46:07.571255+0000","last_peered":"2023-12-01T23:46:07.571255+0000","last_clean":"2023-12-01T23:46:07.571255+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:07.571255+0000","last_undegraded":"2023-12-01T23:46:07.571255+0000","last_fullsized":"2023-12-01T23:46:07.571255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507521+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.507521+0000","last_peered":"2023-12-01T23:46:07.507521+0000","last_clean":"2023-12-01T23:46:07.507521+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:07.507521+0000","last_undegraded":"2023-12-01T23:46:07.507521+0000","last_fullsized":"2023-12-01T23:46:07.507521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503340+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:46:07.503340+0000","last_peered":"2023-12-01T23:46:07.503340+0000","last_clean":"2023-12-01T23:46:07.503340+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:07.503340+0000","last_undegraded":"2023-12-01T23:46:07.503340+0000","last_fullsized":"2023-12-01T23:46:07.503340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.421891+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:46:07.421891+0000","last_peered":"2023-12-01T23:46:07.421891+0000","last_clean":"2023-12-01T23:46:07.421891+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:07.421891+0000","last_undegraded":"2023-12-01T23:46:07.421891+0000","last_fullsized":"2023-12-01T23:46:07.421891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578463+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:46:07.578463+0000","last_peered":"2023-12-01T23:46:07.578463+0000","last_clean":"2023-12-01T23:46:07.578463+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:07.578463+0000","last_undegraded":"2023-12-01T23:46:07.578463+0000","last_fullsized":"2023-12-01T23:46:07.578463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8417,"ondisk_log_size":8417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509779,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.439}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.315}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.41699999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.379}]}]},{"osd":5,"up_from":15,"seq":64424509780,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.28100000000000003,"5min":0.22900000000000001,"15min":0.20999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.68700000000000006},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.20200000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.441,"15min":0.436},"min":{"1min":0.312,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.434},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51000000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.31900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.27200000000000002}]},{"osd":6,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.308,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.375},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.63800000000000001},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.439,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.71699999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.436,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65700000000000003},"last":0.39400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509779,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.29899999999999999},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.41099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.40300000000000002,"5min":0.48699999999999999,"15min":0.48899999999999999},"last":0.307}]},{"osd":1,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.29999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.23000000000000001,"15min":0.216},"max":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.56699999999999995},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.42899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.315,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.45500000000000002,"5min":0.57199999999999995,"15min":0.58299999999999996},"last":0.378}]},{"osd":4,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.68600000000000005},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.628},"last":0.36399999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.66400000000000003},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.625,"5min":0.71999999999999997,"15min":0.72599999999999998},"last":0.432},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.55700000000000005,"5min":0.61599999999999999,"15min":0.70399999999999996},"last":0.45100000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59199999999999997,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48099999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509780,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.314}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.69599999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.54700000000000004,"5min":0.63,"15min":0.66500000000000004},"last":0.627},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.29299999999999998,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.626,"15min":0.68100000000000005},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.71199999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40100000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.505,"5min":0.59399999999999997,"15min":0.70299999999999996},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.68000000000000005},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57599999999999996,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.71299999999999997}]},{"osd":4,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.23999999999999999},"max":{"1min":0.5,"5min":0.54700000000000004,"15min":0.68899999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.372,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.74199999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.55900000000000005,"5min":0.61899999999999999,"15min":0.69799999999999995},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.314,"5min":0.254,"15min":0.249},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.71799999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542483,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121371,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67400000000000004},"last":0.371},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.40799999999999997},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53800000000000003,"5min":0.63700000000000001,"15min":0.68700000000000006},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65400000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.40100000000000002},"min":{"1min":0.28999999999999998,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.61599999999999999},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56799999999999995,"5min":0.626,"15min":0.626},"last":0.438}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.40400000000000003,"5min":0.54200000000000004,"15min":0.61399999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47599999999999998,"5min":0.56899999999999995,"15min":0.59899999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.64900000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.37,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23400000000000001},"max":{"1min":0.46200000000000002,"5min":0.626,"15min":0.73899999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.64400000000000002,"15min":0.71799999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39000000000000001,"15min":0.40000000000000002},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.45100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.47399999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.309}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.433},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.373},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.503},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.51600000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.48099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575188,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.42199999999999999,"5min":0.623,"15min":0.623},"last":0.217},{"interface":"front","average":{"1min":0.312,"5min":0.316,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.47799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.314,"15min":0.30199999999999999},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.193},"max":{"1min":0.46000000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.254}]},{"osd":3,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.57399999999999995,"15min":0.623},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.36099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.59699999999999998},"last":0.375},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.56899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39600000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.441,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.442},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58199999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.432}]},{"osd":6,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67100000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.69799999999999995,"15min":0.71099999999999997},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.745},"last":0.441},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":0.64200000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:46:14.148 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:46:14.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.280+0000 7f4a7a1a5640 1 Processor -- start 2023-12-01T23:46:14.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.280+0000 7f4a7a1a5640 1 -- start start 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a74070d00 0x7f4a7415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a740710e0 0x7f4a74153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4a740c7700 0x7f4a741538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740ca6c0 con 0x7f4a740710e0 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7415da60 con 0x7f4a740c7700 2023-12-01T23:46:14.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.281+0000 7f4a7a1a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74159880 con 0x7f4a74070d00 2023-12-01T23:46:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.282+0000 7f4a6affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a740710e0 0x7f4a74153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.282+0000 7f4a6affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f4a740710e0 0x7f4a74153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53870/0 (socket says 172.21.15.96:53870) 2023-12-01T23:46:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.282+0000 7f4a6affd640 1 -- 172.21.15.96:0/4016894802 learned_addr learned my addr 172.21.15.96:0/4016894802 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.282+0000 7f4a737fe640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a74070d00 0x7f4a7415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.282+0000 7f4a73fff640 1 --2- 172.21.15.96:0/4016894802 >> v2:172.21.15.102:3300/0 conn(0x7f4a740c7700 0x7f4a741538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.284+0000 7f4a6affd640 1 -- 172.21.15.96:0/4016894802 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a74070d00 msgr2=0x7f4a7415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.284+0000 7f4a6affd640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a74070d00 0x7f4a7415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.284+0000 7f4a6affd640 1 -- 172.21.15.96:0/4016894802 >> v2:172.21.15.102:3300/0 conn(0x7f4a740c7700 msgr2=0x7f4a741538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.284+0000 7f4a6affd640 1 --2- 172.21.15.96:0/4016894802 >> v2:172.21.15.102:3300/0 conn(0x7f4a740c7700 0x7f4a741538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.284+0000 7f4a6affd640 1 -- 172.21.15.96:0/4016894802 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a74159b60 con 0x7f4a740710e0 2023-12-01T23:46:14.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.286+0000 7f4a6affd640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a74153380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a74070710 tx=0x7f4a5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e23735dfa4925cc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a72ffd640 1 -- 172.21.15.96:0/4016894802 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c030860 con 0x7f4a740710e0 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a72ffd640 1 -- 172.21.15.96:0/4016894802 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5c0309c0 con 0x7f4a740710e0 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a72ffd640 1 -- 172.21.15.96:0/4016894802 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c030d50 con 0x7f4a740710e0 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/4016894802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 msgr2=0x7f4a74153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a74153380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a74070710 tx=0x7f4a5c02b9a0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/4016894802 shutdown_connections 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/4016894802 >> v2:172.21.15.102:3300/0 conn(0x7f4a740c7700 0x7f4a741538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a74153380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/4016894802 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a74070d00 0x7f4a7415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/4016894802 >> 172.21.15.96:0/4016894802 conn(0x7f4a7406ab30 msgr2=0x7f4a7406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/4016894802 shutdown_connections 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.290+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/4016894802 wait complete. 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.292+0000 7f4a7a1a5640 1 Processor -- start 2023-12-01T23:46:14.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.292+0000 7f4a7a1a5640 1 -- start start 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a740c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a740c7700 0x7f4a74073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c4880 con 0x7f4a740710e0 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74154ed0 con 0x7f4a74070d00 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a7a1a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74155770 con 0x7f4a740c7700 2023-12-01T23:46:14.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.293+0000 7f4a73fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a740c7700 0x7f4a74073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.294+0000 7f4a737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:41288/0 (socket says 172.21.15.96:41288) 2023-12-01T23:46:14.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.294+0000 7f4a737fe640 1 -- 172.21.15.96:0/142470319 learned_addr learned my addr 172.21.15.96:0/142470319 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:14.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.294+0000 7f4a6affd640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a740c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.298+0000 7f4a737fe640 1 -- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a740c7700 msgr2=0x7f4a74073ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.298+0000 7f4a737fe640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a740c7700 0x7f4a74073ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.298+0000 7f4a737fe640 1 -- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 msgr2=0x7f4a740c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.298+0000 7f4a737fe640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a740c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.298+0000 7f4a737fe640 1 -- 172.21.15.96:0/142470319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0094d0 con 0x7f4a74070d00 2023-12-01T23:46:14.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.301+0000 7f4a737fe640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400e9e0 tx=0x7f4a6400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64009670 con 0x7f4a74070d00 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6400c9d0 con 0x7f4a74070d00 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6400cd80 con 0x7f4a74070d00 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74157ed0 con 0x7f4a74070d00 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74155120 con 0x7f4a74070d00 2023-12-01T23:46:14.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.306+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74067500 con 0x7f4a74070d00 2023-12-01T23:46:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.326+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a64013470 con 0x7f4a74070d00 2023-12-01T23:46:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.326+0000 7f4a70ff9640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 0x7f4a5406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.326+0000 7f4a6affd640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 0x7f4a5406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.326+0000 7f4a6affd640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 0x7f4a5406d380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c036000 tx=0x7f4a5c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:14.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.554+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a64058d30 con 0x7f4a74070d00 2023-12-01T23:46:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.563+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a64055070 con 0x7f4a74070d00 2023-12-01T23:46:14.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.739+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a7415a400 con 0x7f4a5406aec0 2023-12-01T23:46:14.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.748+0000 7f4a70ff9640 1 -- 172.21.15.96:0/142470319 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371057 (secure 0 0 0) 0x7f4a5c030bb0 con 0x7f4a5406aec0 2023-12-01T23:46:14.754 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:14.756 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 msgr2=0x7f4a5406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 0x7f4a5406d380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c036000 tx=0x7f4a5c008030 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 msgr2=0x7f4a740c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400e9e0 tx=0x7f4a6400eea0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 shutdown_connections 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f4a5406aec0 0x7f4a5406d380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a740c7700 0x7f4a74073ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a740710e0 0x7f4a740c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 --2- 172.21.15.96:0/142470319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a74070d00 0x7f4a740c4340 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 >> 172.21.15.96:0/142470319 conn(0x7f4a7406ab30 msgr2=0x7f4a740c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 shutdown_connections 2023-12-01T23:46:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.752+0000 7f4a7a1a5640 1 -- 172.21.15.96:0/142470319 wait complete. 2023-12-01T23:46:14.765 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":864,"stamp":"2023-12-01T23:46:14.177151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15659,"ondisk_log_size":15659,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":19,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002920"},"pg_stats":[{"pgid":"2.1f","version":"29'584","reported_seq":616,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.549640+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:46:01.549640+0000","last_peered":"2023-12-01T23:46:01.549640+0000","last_clean":"2023-12-01T23:46:01.549640+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:01.549640+0000","last_undegraded":"2023-12-01T23:46:01.549640+0000","last_fullsized":"2023-12-01T23:46:01.549640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.488155+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:46:07.488155+0000","last_peered":"2023-12-01T23:46:07.488155+0000","last_clean":"2023-12-01T23:46:07.488155+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:07.488155+0000","last_undegraded":"2023-12-01T23:46:07.488155+0000","last_fullsized":"2023-12-01T23:46:07.488155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137759+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.137759+0000","last_peered":"2023-12-01T23:45:40.137759+0000","last_clean":"2023-12-01T23:45:40.137759+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.137759+0000","last_undegraded":"2023-12-01T23:45:40.137759+0000","last_fullsized":"2023-12-01T23:45:40.137759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'721","reported_seq":753,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.383573+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:45:48.383573+0000","last_peered":"2023-12-01T23:45:48.383573+0000","last_clean":"2023-12-01T23:45:48.383573+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:45:48.383573+0000","last_undegraded":"2023-12-01T23:45:48.383573+0000","last_fullsized":"2023-12-01T23:45:48.383573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506249+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:46:07.506249+0000","last_peered":"2023-12-01T23:46:07.506249+0000","last_clean":"2023-12-01T23:46:07.506249+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:07.506249+0000","last_undegraded":"2023-12-01T23:46:07.506249+0000","last_fullsized":"2023-12-01T23:46:07.506249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:35.302116+0000","last_change":"2023-12-01T23:19:06.103620+0000","last_active":"2023-12-01T23:45:35.302116+0000","last_peered":"2023-12-01T23:45:35.302116+0000","last_clean":"2023-12-01T23:45:35.302116+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:45:35.302116+0000","last_undegraded":"2023-12-01T23:45:35.302116+0000","last_fullsized":"2023-12-01T23:45:35.302116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:18:06.190136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1374","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565136+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:45:58.565136+0000","last_peered":"2023-12-01T23:45:58.565136+0000","last_clean":"2023-12-01T23:45:58.565136+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:45:58.565136+0000","last_undegraded":"2023-12-01T23:45:58.565136+0000","last_fullsized":"2023-12-01T23:45:58.565136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504046+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:46:07.504046+0000","last_peered":"2023-12-01T23:46:07.504046+0000","last_clean":"2023-12-01T23:46:07.504046+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:07.504046+0000","last_undegraded":"2023-12-01T23:46:07.504046+0000","last_fullsized":"2023-12-01T23:46:07.504046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143603+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:45:40.143603+0000","last_peered":"2023-12-01T23:45:40.143603+0000","last_clean":"2023-12-01T23:45:40.143603+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:45:40.143603+0000","last_undegraded":"2023-12-01T23:45:40.143603+0000","last_fullsized":"2023-12-01T23:45:40.143603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:59.111214+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:45:59.111214+0000","last_peered":"2023-12-01T23:45:59.111214+0000","last_clean":"2023-12-01T23:45:59.111214+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:45:59.111214+0000","last_undegraded":"2023-12-01T23:45:59.111214+0000","last_fullsized":"2023-12-01T23:45:59.111214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504109+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:46:07.504109+0000","last_peered":"2023-12-01T23:46:07.504109+0000","last_clean":"2023-12-01T23:46:07.504109+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:07.504109+0000","last_undegraded":"2023-12-01T23:46:07.504109+0000","last_fullsized":"2023-12-01T23:46:07.504109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:33.156414+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:45:33.156414+0000","last_peered":"2023-12-01T23:45:33.156414+0000","last_clean":"2023-12-01T23:45:33.156414+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:45:33.156414+0000","last_undegraded":"2023-12-01T23:45:33.156414+0000","last_fullsized":"2023-12-01T23:45:33.156414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588270+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:46:07.588270+0000","last_peered":"2023-12-01T23:46:07.588270+0000","last_clean":"2023-12-01T23:46:07.588270+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:07.588270+0000","last_undegraded":"2023-12-01T23:46:07.588270+0000","last_fullsized":"2023-12-01T23:46:07.588270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'634","reported_seq":665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.532741+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:45:58.532741+0000","last_peered":"2023-12-01T23:45:58.532741+0000","last_clean":"2023-12-01T23:45:58.532741+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:45:58.532741+0000","last_undegraded":"2023-12-01T23:45:58.532741+0000","last_fullsized":"2023-12-01T23:45:58.532741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.284663+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:45:39.284663+0000","last_peered":"2023-12-01T23:45:39.284663+0000","last_clean":"2023-12-01T23:45:39.284663+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:45:39.284663+0000","last_undegraded":"2023-12-01T23:45:39.284663+0000","last_fullsized":"2023-12-01T23:45:39.284663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491511+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:46:07.491511+0000","last_peered":"2023-12-01T23:46:07.491511+0000","last_clean":"2023-12-01T23:46:07.491511+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:07.491511+0000","last_undegraded":"2023-12-01T23:46:07.491511+0000","last_fullsized":"2023-12-01T23:46:07.491511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288102+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:45:44.288102+0000","last_peered":"2023-12-01T23:45:44.288102+0000","last_clean":"2023-12-01T23:45:44.288102+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:45:44.288102+0000","last_undegraded":"2023-12-01T23:45:44.288102+0000","last_fullsized":"2023-12-01T23:45:44.288102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143684+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143684+0000","last_peered":"2023-12-01T23:45:40.143684+0000","last_clean":"2023-12-01T23:45:40.143684+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143684+0000","last_undegraded":"2023-12-01T23:45:40.143684+0000","last_fullsized":"2023-12-01T23:45:40.143684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507118+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:46:07.507118+0000","last_peered":"2023-12-01T23:46:07.507118+0000","last_clean":"2023-12-01T23:46:07.507118+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:07.507118+0000","last_undegraded":"2023-12-01T23:46:07.507118+0000","last_fullsized":"2023-12-01T23:46:07.507118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288099+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:45:44.288099+0000","last_peered":"2023-12-01T23:45:44.288099+0000","last_clean":"2023-12-01T23:45:44.288099+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:45:44.288099+0000","last_undegraded":"2023-12-01T23:45:44.288099+0000","last_fullsized":"2023-12-01T23:45:44.288099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.239466+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:39.239466+0000","last_peered":"2023-12-01T23:45:39.239466+0000","last_clean":"2023-12-01T23:45:39.239466+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:39.239466+0000","last_undegraded":"2023-12-01T23:45:39.239466+0000","last_fullsized":"2023-12-01T23:45:39.239466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.994567+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:45:37.994567+0000","last_peered":"2023-12-01T23:45:37.994567+0000","last_clean":"2023-12-01T23:45:37.994567+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:45:37.994567+0000","last_undegraded":"2023-12-01T23:45:37.994567+0000","last_fullsized":"2023-12-01T23:45:37.994567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.470358+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:45:56.470358+0000","last_peered":"2023-12-01T23:45:56.470358+0000","last_clean":"2023-12-01T23:45:56.470358+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:45:56.470358+0000","last_undegraded":"2023-12-01T23:45:56.470358+0000","last_fullsized":"2023-12-01T23:45:56.470358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.849137+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:45:37.849137+0000","last_peered":"2023-12-01T23:45:37.849137+0000","last_clean":"2023-12-01T23:45:37.849137+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:45:37.849137+0000","last_undegraded":"2023-12-01T23:45:37.849137+0000","last_fullsized":"2023-12-01T23:45:37.849137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503456+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:46:07.503456+0000","last_peered":"2023-12-01T23:46:07.503456+0000","last_clean":"2023-12-01T23:46:07.503456+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:07.503456+0000","last_undegraded":"2023-12-01T23:46:07.503456+0000","last_fullsized":"2023-12-01T23:46:07.503456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135804+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:45:39.135804+0000","last_peered":"2023-12-01T23:45:39.135804+0000","last_clean":"2023-12-01T23:45:39.135804+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:45:39.135804+0000","last_undegraded":"2023-12-01T23:45:39.135804+0000","last_fullsized":"2023-12-01T23:45:39.135804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511306+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:46:07.511306+0000","last_peered":"2023-12-01T23:46:07.511306+0000","last_clean":"2023-12-01T23:46:07.511306+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:07.511306+0000","last_undegraded":"2023-12-01T23:46:07.511306+0000","last_fullsized":"2023-12-01T23:46:07.511306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'309","reported_seq":340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.815973+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:46:01.815973+0000","last_peered":"2023-12-01T23:46:01.815973+0000","last_clean":"2023-12-01T23:46:01.815973+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:01.815973+0000","last_undegraded":"2023-12-01T23:46:01.815973+0000","last_fullsized":"2023-12-01T23:46:01.815973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.975866+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:45:37.975866+0000","last_peered":"2023-12-01T23:45:37.975866+0000","last_clean":"2023-12-01T23:45:37.975866+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:45:37.975866+0000","last_undegraded":"2023-12-01T23:45:37.975866+0000","last_fullsized":"2023-12-01T23:45:37.975866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424012+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:46:07.424012+0000","last_peered":"2023-12-01T23:46:07.424012+0000","last_clean":"2023-12-01T23:46:07.424012+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:07.424012+0000","last_undegraded":"2023-12-01T23:46:07.424012+0000","last_fullsized":"2023-12-01T23:46:07.424012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:50.389391+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:45:50.389391+0000","last_peered":"2023-12-01T23:45:50.389391+0000","last_clean":"2023-12-01T23:45:50.389391+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:45:50.389391+0000","last_undegraded":"2023-12-01T23:45:50.389391+0000","last_fullsized":"2023-12-01T23:45:50.389391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":160,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.077188+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:45:39.077188+0000","last_peered":"2023-12-01T23:45:39.077188+0000","last_clean":"2023-12-01T23:45:39.077188+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:45:39.077188+0000","last_undegraded":"2023-12-01T23:45:39.077188+0000","last_fullsized":"2023-12-01T23:45:39.077188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507506+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:46:07.507506+0000","last_peered":"2023-12-01T23:46:07.507506+0000","last_clean":"2023-12-01T23:46:07.507506+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:07.507506+0000","last_undegraded":"2023-12-01T23:46:07.507506+0000","last_fullsized":"2023-12-01T23:46:07.507506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.427894+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:45:52.427894+0000","last_peered":"2023-12-01T23:45:52.427894+0000","last_clean":"2023-12-01T23:45:52.427894+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:45:52.427894+0000","last_undegraded":"2023-12-01T23:45:52.427894+0000","last_fullsized":"2023-12-01T23:45:52.427894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":219,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.136442+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:39.136442+0000","last_peered":"2023-12-01T23:45:39.136442+0000","last_clean":"2023-12-01T23:45:39.136442+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:39.136442+0000","last_undegraded":"2023-12-01T23:45:39.136442+0000","last_fullsized":"2023-12-01T23:45:39.136442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447483+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:46:07.447483+0000","last_peered":"2023-12-01T23:46:07.447483+0000","last_clean":"2023-12-01T23:46:07.447483+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:07.447483+0000","last_undegraded":"2023-12-01T23:46:07.447483+0000","last_fullsized":"2023-12-01T23:46:07.447483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565477+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:45:58.565477+0000","last_peered":"2023-12-01T23:45:58.565477+0000","last_clean":"2023-12-01T23:45:58.565477+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:45:58.565477+0000","last_undegraded":"2023-12-01T23:45:58.565477+0000","last_fullsized":"2023-12-01T23:45:58.565477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.268353+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:39.268353+0000","last_peered":"2023-12-01T23:45:39.268353+0000","last_clean":"2023-12-01T23:45:39.268353+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:39.268353+0000","last_undegraded":"2023-12-01T23:45:39.268353+0000","last_fullsized":"2023-12-01T23:45:39.268353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423058+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:07.423058+0000","last_peered":"2023-12-01T23:46:07.423058+0000","last_clean":"2023-12-01T23:46:07.423058+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:07.423058+0000","last_undegraded":"2023-12-01T23:46:07.423058+0000","last_fullsized":"2023-12-01T23:46:07.423058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2094,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.534843+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:46:01.534843+0000","last_peered":"2023-12-01T23:46:01.534843+0000","last_clean":"2023-12-01T23:46:01.534843+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:01.534843+0000","last_undegraded":"2023-12-01T23:46:01.534843+0000","last_fullsized":"2023-12-01T23:46:01.534843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134701+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:45:39.134701+0000","last_peered":"2023-12-01T23:45:39.134701+0000","last_clean":"2023-12-01T23:45:39.134701+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:45:39.134701+0000","last_undegraded":"2023-12-01T23:45:39.134701+0000","last_fullsized":"2023-12-01T23:45:39.134701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506489+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:46:07.506489+0000","last_peered":"2023-12-01T23:46:07.506489+0000","last_clean":"2023-12-01T23:46:07.506489+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:07.506489+0000","last_undegraded":"2023-12-01T23:46:07.506489+0000","last_fullsized":"2023-12-01T23:46:07.506489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'521","reported_seq":553,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446851+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:45:52.446851+0000","last_peered":"2023-12-01T23:45:52.446851+0000","last_clean":"2023-12-01T23:45:52.446851+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:45:52.446851+0000","last_undegraded":"2023-12-01T23:45:52.446851+0000","last_fullsized":"2023-12-01T23:45:52.446851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.274188+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:45:39.274188+0000","last_peered":"2023-12-01T23:45:39.274188+0000","last_clean":"2023-12-01T23:45:39.274188+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:45:39.274188+0000","last_undegraded":"2023-12-01T23:45:39.274188+0000","last_fullsized":"2023-12-01T23:45:39.274188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.499828+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:46:07.499828+0000","last_peered":"2023-12-01T23:46:07.499828+0000","last_clean":"2023-12-01T23:46:07.499828+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:07.499828+0000","last_undegraded":"2023-12-01T23:46:07.499828+0000","last_fullsized":"2023-12-01T23:46:07.499828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.085700+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:45:34.085700+0000","last_peered":"2023-12-01T23:45:34.085700+0000","last_clean":"2023-12-01T23:45:34.085700+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:45:34.085700+0000","last_undegraded":"2023-12-01T23:45:34.085700+0000","last_fullsized":"2023-12-01T23:45:34.085700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:42:24.091255+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:42:24.091255+0000","last_peered":"2023-12-01T23:42:24.091255+0000","last_clean":"2023-12-01T23:42:24.091255+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:42:24.091255+0000","last_undegraded":"2023-12-01T23:42:24.091255+0000","last_fullsized":"2023-12-01T23:42:24.091255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":215,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152410+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:45:40.152410+0000","last_peered":"2023-12-01T23:45:40.152410+0000","last_clean":"2023-12-01T23:45:40.152410+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:45:40.152410+0000","last_undegraded":"2023-12-01T23:45:40.152410+0000","last_fullsized":"2023-12-01T23:45:40.152410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578898+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:46:07.578898+0000","last_peered":"2023-12-01T23:46:07.578898+0000","last_clean":"2023-12-01T23:46:07.578898+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:46:07.578898+0000","last_undegraded":"2023-12-01T23:46:07.578898+0000","last_fullsized":"2023-12-01T23:46:07.578898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317219+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:45:46.317219+0000","last_peered":"2023-12-01T23:45:46.317219+0000","last_clean":"2023-12-01T23:45:46.317219+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:45:46.317219+0000","last_undegraded":"2023-12-01T23:45:46.317219+0000","last_fullsized":"2023-12-01T23:45:46.317219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.581319+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:45:34.581319+0000","last_peered":"2023-12-01T23:45:34.581319+0000","last_clean":"2023-12-01T23:45:34.581319+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:45:34.581319+0000","last_undegraded":"2023-12-01T23:45:34.581319+0000","last_fullsized":"2023-12-01T23:45:34.581319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429551+0000","last_change":"2023-12-01T23:19:06.056259+0000","last_active":"2023-12-01T23:46:07.429551+0000","last_peered":"2023-12-01T23:46:07.429551+0000","last_clean":"2023-12-01T23:46:07.429551+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:07.429551+0000","last_undegraded":"2023-12-01T23:46:07.429551+0000","last_fullsized":"2023-12-01T23:46:07.429551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:02.070575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.527321+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:46:00.527321+0000","last_peered":"2023-12-01T23:46:00.527321+0000","last_clean":"2023-12-01T23:46:00.527321+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:00.527321+0000","last_undegraded":"2023-12-01T23:46:00.527321+0000","last_fullsized":"2023-12-01T23:46:00.527321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":222,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.265895+0000","last_change":"2023-12-01T23:19:06.163021+0000","last_active":"2023-12-01T23:45:39.265895+0000","last_peered":"2023-12-01T23:45:39.265895+0000","last_clean":"2023-12-01T23:45:39.265895+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:45:39.265895+0000","last_undegraded":"2023-12-01T23:45:39.265895+0000","last_fullsized":"2023-12-01T23:45:39.265895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:00:33.222976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578723+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.578723+0000","last_peered":"2023-12-01T23:46:07.578723+0000","last_clean":"2023-12-01T23:46:07.578723+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.578723+0000","last_undegraded":"2023-12-01T23:46:07.578723+0000","last_fullsized":"2023-12-01T23:46:07.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:43.162322+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:45:43.162322+0000","last_peered":"2023-12-01T23:45:43.162322+0000","last_clean":"2023-12-01T23:45:43.162322+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:45:43.162322+0000","last_undegraded":"2023-12-01T23:45:43.162322+0000","last_fullsized":"2023-12-01T23:45:43.162322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.280157+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:45:39.280157+0000","last_peered":"2023-12-01T23:45:39.280157+0000","last_clean":"2023-12-01T23:45:39.280157+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:45:39.280157+0000","last_undegraded":"2023-12-01T23:45:39.280157+0000","last_fullsized":"2023-12-01T23:45:39.280157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575841+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.575841+0000","last_peered":"2023-12-01T23:46:07.575841+0000","last_clean":"2023-12-01T23:46:07.575841+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:46:07.575841+0000","last_undegraded":"2023-12-01T23:46:07.575841+0000","last_fullsized":"2023-12-01T23:46:07.575841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.564741+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:45:58.564741+0000","last_peered":"2023-12-01T23:45:58.564741+0000","last_clean":"2023-12-01T23:45:58.564741+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:45:58.564741+0000","last_undegraded":"2023-12-01T23:45:58.564741+0000","last_fullsized":"2023-12-01T23:45:58.564741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135509+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:45:39.135509+0000","last_peered":"2023-12-01T23:45:39.135509+0000","last_clean":"2023-12-01T23:45:39.135509+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:45:39.135509+0000","last_undegraded":"2023-12-01T23:45:39.135509+0000","last_fullsized":"2023-12-01T23:45:39.135509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575888+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:46:07.575888+0000","last_peered":"2023-12-01T23:46:07.575888+0000","last_clean":"2023-12-01T23:46:07.575888+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:07.575888+0000","last_undegraded":"2023-12-01T23:46:07.575888+0000","last_fullsized":"2023-12-01T23:46:07.575888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317486+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:45:46.317486+0000","last_peered":"2023-12-01T23:45:46.317486+0000","last_clean":"2023-12-01T23:45:46.317486+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:45:46.317486+0000","last_undegraded":"2023-12-01T23:45:46.317486+0000","last_fullsized":"2023-12-01T23:45:46.317486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135127+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:45:39.135127+0000","last_peered":"2023-12-01T23:45:39.135127+0000","last_clean":"2023-12-01T23:45:39.135127+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:45:39.135127+0000","last_undegraded":"2023-12-01T23:45:39.135127+0000","last_fullsized":"2023-12-01T23:45:39.135127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.586320+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:46:07.586320+0000","last_peered":"2023-12-01T23:46:07.586320+0000","last_clean":"2023-12-01T23:46:07.586320+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:07.586320+0000","last_undegraded":"2023-12-01T23:46:07.586320+0000","last_fullsized":"2023-12-01T23:46:07.586320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.384828+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:45:48.384828+0000","last_peered":"2023-12-01T23:45:48.384828+0000","last_clean":"2023-12-01T23:45:48.384828+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:45:48.384828+0000","last_undegraded":"2023-12-01T23:45:48.384828+0000","last_fullsized":"2023-12-01T23:45:48.384828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.278999+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:39.278999+0000","last_peered":"2023-12-01T23:45:39.278999+0000","last_clean":"2023-12-01T23:45:39.278999+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:39.278999+0000","last_undegraded":"2023-12-01T23:45:39.278999+0000","last_fullsized":"2023-12-01T23:45:39.278999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.432398+0000","last_change":"2023-12-01T23:19:06.056474+0000","last_active":"2023-12-01T23:46:07.432398+0000","last_peered":"2023-12-01T23:46:07.432398+0000","last_clean":"2023-12-01T23:46:07.432398+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:07.432398+0000","last_undegraded":"2023-12-01T23:46:07.432398+0000","last_fullsized":"2023-12-01T23:46:07.432398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:00.298932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565262+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:45:58.565262+0000","last_peered":"2023-12-01T23:45:58.565262+0000","last_clean":"2023-12-01T23:45:58.565262+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:45:58.565262+0000","last_undegraded":"2023-12-01T23:45:58.565262+0000","last_fullsized":"2023-12-01T23:45:58.565262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137373+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:45:40.137373+0000","last_peered":"2023-12-01T23:45:40.137373+0000","last_clean":"2023-12-01T23:45:40.137373+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:45:40.137373+0000","last_undegraded":"2023-12-01T23:45:40.137373+0000","last_fullsized":"2023-12-01T23:45:40.137373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503494+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:46:07.503494+0000","last_peered":"2023-12-01T23:46:07.503494+0000","last_clean":"2023-12-01T23:46:07.503494+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:07.503494+0000","last_undegraded":"2023-12-01T23:46:07.503494+0000","last_fullsized":"2023-12-01T23:46:07.503494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'256","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.260901+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:46:07.260901+0000","last_peered":"2023-12-01T23:46:07.260901+0000","last_clean":"2023-12-01T23:46:07.260901+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:07.260901+0000","last_undegraded":"2023-12-01T23:46:07.260901+0000","last_fullsized":"2023-12-01T23:46:07.260901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.211620+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.211620+0000","last_peered":"2023-12-01T23:45:39.211620+0000","last_clean":"2023-12-01T23:45:39.211620+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.211620+0000","last_undegraded":"2023-12-01T23:45:39.211620+0000","last_fullsized":"2023-12-01T23:45:39.211620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578590+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:46:07.578590+0000","last_peered":"2023-12-01T23:46:07.578590+0000","last_clean":"2023-12-01T23:46:07.578590+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:07.578590+0000","last_undegraded":"2023-12-01T23:46:07.578590+0000","last_fullsized":"2023-12-01T23:46:07.578590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.992466+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:45:56.992466+0000","last_peered":"2023-12-01T23:45:56.992466+0000","last_clean":"2023-12-01T23:45:56.992466+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:45:56.992466+0000","last_undegraded":"2023-12-01T23:45:56.992466+0000","last_fullsized":"2023-12-01T23:45:56.992466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152294+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:45:40.152294+0000","last_peered":"2023-12-01T23:45:40.152294+0000","last_clean":"2023-12-01T23:45:40.152294+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:45:40.152294+0000","last_undegraded":"2023-12-01T23:45:40.152294+0000","last_fullsized":"2023-12-01T23:45:40.152294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448442+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:46:07.448442+0000","last_peered":"2023-12-01T23:46:07.448442+0000","last_clean":"2023-12-01T23:46:07.448442+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:07.448442+0000","last_undegraded":"2023-12-01T23:46:07.448442+0000","last_fullsized":"2023-12-01T23:46:07.448442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'696","reported_seq":726,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.553477+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:46:01.553477+0000","last_peered":"2023-12-01T23:46:01.553477+0000","last_clean":"2023-12-01T23:46:01.553477+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:01.553477+0000","last_undegraded":"2023-12-01T23:46:01.553477+0000","last_fullsized":"2023-12-01T23:46:01.553477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.207440+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:45:39.207440+0000","last_peered":"2023-12-01T23:45:39.207440+0000","last_clean":"2023-12-01T23:45:39.207440+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:45:39.207440+0000","last_undegraded":"2023-12-01T23:45:39.207440+0000","last_fullsized":"2023-12-01T23:45:39.207440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503556+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:46:07.503556+0000","last_peered":"2023-12-01T23:46:07.503556+0000","last_clean":"2023-12-01T23:46:07.503556+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:07.503556+0000","last_undegraded":"2023-12-01T23:46:07.503556+0000","last_fullsized":"2023-12-01T23:46:07.503556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.354784+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:45:49.354784+0000","last_peered":"2023-12-01T23:45:49.354784+0000","last_clean":"2023-12-01T23:45:49.354784+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:45:49.354784+0000","last_undegraded":"2023-12-01T23:45:49.354784+0000","last_fullsized":"2023-12-01T23:45:49.354784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.976384+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:45:37.976384+0000","last_peered":"2023-12-01T23:45:37.976384+0000","last_clean":"2023-12-01T23:45:37.976384+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:45:37.976384+0000","last_undegraded":"2023-12-01T23:45:37.976384+0000","last_fullsized":"2023-12-01T23:45:37.976384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500976+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:46:07.500976+0000","last_peered":"2023-12-01T23:46:07.500976+0000","last_clean":"2023-12-01T23:46:07.500976+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:07.500976+0000","last_undegraded":"2023-12-01T23:46:07.500976+0000","last_fullsized":"2023-12-01T23:46:07.500976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.340217+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:45:49.340217+0000","last_peered":"2023-12-01T23:45:49.340217+0000","last_clean":"2023-12-01T23:45:49.340217+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:45:49.340217+0000","last_undegraded":"2023-12-01T23:45:49.340217+0000","last_fullsized":"2023-12-01T23:45:49.340217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.276183+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:45:39.276183+0000","last_peered":"2023-12-01T23:45:39.276183+0000","last_clean":"2023-12-01T23:45:39.276183+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:45:39.276183+0000","last_undegraded":"2023-12-01T23:45:39.276183+0000","last_fullsized":"2023-12-01T23:45:39.276183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.430560+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:45:34.430560+0000","last_peered":"2023-12-01T23:45:34.430560+0000","last_clean":"2023-12-01T23:45:34.430560+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:45:34.430560+0000","last_undegraded":"2023-12-01T23:45:34.430560+0000","last_fullsized":"2023-12-01T23:45:34.430560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429200+0000","last_change":"2023-12-01T23:19:06.057281+0000","last_active":"2023-12-01T23:46:07.429200+0000","last_peered":"2023-12-01T23:46:07.429200+0000","last_clean":"2023-12-01T23:46:07.429200+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:07.429200+0000","last_undegraded":"2023-12-01T23:46:07.429200+0000","last_fullsized":"2023-12-01T23:46:07.429200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:15:36.967562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.532515+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:46:00.532515+0000","last_peered":"2023-12-01T23:46:00.532515+0000","last_clean":"2023-12-01T23:46:00.532515+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:00.532515+0000","last_undegraded":"2023-12-01T23:46:00.532515+0000","last_fullsized":"2023-12-01T23:46:00.532515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.071949+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:45:40.071949+0000","last_peered":"2023-12-01T23:45:40.071949+0000","last_clean":"2023-12-01T23:45:40.071949+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:45:40.071949+0000","last_undegraded":"2023-12-01T23:45:40.071949+0000","last_fullsized":"2023-12-01T23:45:40.071949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510478+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:46:07.510478+0000","last_peered":"2023-12-01T23:46:07.510478+0000","last_clean":"2023-12-01T23:46:07.510478+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:07.510478+0000","last_undegraded":"2023-12-01T23:46:07.510478+0000","last_fullsized":"2023-12-01T23:46:07.510478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446752+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:45:52.446752+0000","last_peered":"2023-12-01T23:45:52.446752+0000","last_clean":"2023-12-01T23:45:52.446752+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:45:52.446752+0000","last_undegraded":"2023-12-01T23:45:52.446752+0000","last_fullsized":"2023-12-01T23:45:52.446752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'687","reported_seq":717,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.887479+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:45:57.887479+0000","last_peered":"2023-12-01T23:45:57.887479+0000","last_clean":"2023-12-01T23:45:57.887479+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:45:57.887479+0000","last_undegraded":"2023-12-01T23:45:57.887479+0000","last_fullsized":"2023-12-01T23:45:57.887479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503298+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:46:07.503298+0000","last_peered":"2023-12-01T23:46:07.503298+0000","last_clean":"2023-12-01T23:46:07.503298+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:07.503298+0000","last_undegraded":"2023-12-01T23:46:07.503298+0000","last_fullsized":"2023-12-01T23:46:07.503298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134507+0000","last_change":"2023-12-01T23:19:06.163026+0000","last_active":"2023-12-01T23:45:39.134507+0000","last_peered":"2023-12-01T23:45:39.134507+0000","last_clean":"2023-12-01T23:45:39.134507+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:45:39.134507+0000","last_undegraded":"2023-12-01T23:45:39.134507+0000","last_fullsized":"2023-12-01T23:45:39.134507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'676","reported_seq":706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.469370+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:45:56.469370+0000","last_peered":"2023-12-01T23:45:56.469370+0000","last_clean":"2023-12-01T23:45:56.469370+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:45:56.469370+0000","last_undegraded":"2023-12-01T23:45:56.469370+0000","last_fullsized":"2023-12-01T23:45:56.469370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448156+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:46:07.448156+0000","last_peered":"2023-12-01T23:46:07.448156+0000","last_clean":"2023-12-01T23:46:07.448156+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:07.448156+0000","last_undegraded":"2023-12-01T23:46:07.448156+0000","last_fullsized":"2023-12-01T23:46:07.448156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134413+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:45:39.134413+0000","last_peered":"2023-12-01T23:45:39.134413+0000","last_clean":"2023-12-01T23:45:39.134413+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:45:39.134413+0000","last_undegraded":"2023-12-01T23:45:39.134413+0000","last_fullsized":"2023-12-01T23:45:39.134413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588952+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:46:07.588952+0000","last_peered":"2023-12-01T23:46:07.588952+0000","last_clean":"2023-12-01T23:46:07.588952+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:07.588952+0000","last_undegraded":"2023-12-01T23:46:07.588952+0000","last_fullsized":"2023-12-01T23:46:07.588952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429738+0000","last_change":"2023-12-01T23:19:06.058763+0000","last_active":"2023-12-01T23:46:07.429738+0000","last_peered":"2023-12-01T23:46:07.429738+0000","last_clean":"2023-12-01T23:46:07.429738+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:07.429738+0000","last_undegraded":"2023-12-01T23:46:07.429738+0000","last_fullsized":"2023-12-01T23:46:07.429738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:01.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507283+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:46:07.507283+0000","last_peered":"2023-12-01T23:46:07.507283+0000","last_clean":"2023-12-01T23:46:07.507283+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:46:07.507283+0000","last_undegraded":"2023-12-01T23:46:07.507283+0000","last_fullsized":"2023-12-01T23:46:07.507283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500625+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:46:07.500625+0000","last_peered":"2023-12-01T23:46:07.500625+0000","last_clean":"2023-12-01T23:46:07.500625+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:07.500625+0000","last_undegraded":"2023-12-01T23:46:07.500625+0000","last_fullsized":"2023-12-01T23:46:07.500625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.514310+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:46:07.514310+0000","last_peered":"2023-12-01T23:46:07.514310+0000","last_clean":"2023-12-01T23:46:07.514310+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:07.514310+0000","last_undegraded":"2023-12-01T23:46:07.514310+0000","last_fullsized":"2023-12-01T23:46:07.514310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424251+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:46:07.424251+0000","last_peered":"2023-12-01T23:46:07.424251+0000","last_clean":"2023-12-01T23:46:07.424251+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:07.424251+0000","last_undegraded":"2023-12-01T23:46:07.424251+0000","last_fullsized":"2023-12-01T23:46:07.424251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591499+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:46:07.591499+0000","last_peered":"2023-12-01T23:46:07.591499+0000","last_clean":"2023-12-01T23:46:07.591499+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:07.591499+0000","last_undegraded":"2023-12-01T23:46:07.591499+0000","last_fullsized":"2023-12-01T23:46:07.591499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491852+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:46:07.491852+0000","last_peered":"2023-12-01T23:46:07.491852+0000","last_clean":"2023-12-01T23:46:07.491852+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:07.491852+0000","last_undegraded":"2023-12-01T23:46:07.491852+0000","last_fullsized":"2023-12-01T23:46:07.491852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507294+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:46:07.507294+0000","last_peered":"2023-12-01T23:46:07.507294+0000","last_clean":"2023-12-01T23:46:07.507294+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:07.507294+0000","last_undegraded":"2023-12-01T23:46:07.507294+0000","last_fullsized":"2023-12-01T23:46:07.507294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510325+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:46:07.510325+0000","last_peered":"2023-12-01T23:46:07.510325+0000","last_clean":"2023-12-01T23:46:07.510325+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:07.510325+0000","last_undegraded":"2023-12-01T23:46:07.510325+0000","last_fullsized":"2023-12-01T23:46:07.510325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506232+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:46:07.506232+0000","last_peered":"2023-12-01T23:46:07.506232+0000","last_clean":"2023-12-01T23:46:07.506232+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:46:07.506232+0000","last_undegraded":"2023-12-01T23:46:07.506232+0000","last_fullsized":"2023-12-01T23:46:07.506232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503212+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:46:07.503212+0000","last_peered":"2023-12-01T23:46:07.503212+0000","last_clean":"2023-12-01T23:46:07.503212+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:07.503212+0000","last_undegraded":"2023-12-01T23:46:07.503212+0000","last_fullsized":"2023-12-01T23:46:07.503212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588627+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:46:07.588627+0000","last_peered":"2023-12-01T23:46:07.588627+0000","last_clean":"2023-12-01T23:46:07.588627+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:07.588627+0000","last_undegraded":"2023-12-01T23:46:07.588627+0000","last_fullsized":"2023-12-01T23:46:07.588627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578518+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578518+0000","last_peered":"2023-12-01T23:46:07.578518+0000","last_clean":"2023-12-01T23:46:07.578518+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578518+0000","last_undegraded":"2023-12-01T23:46:07.578518+0000","last_fullsized":"2023-12-01T23:46:07.578518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.431852+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:46:07.431852+0000","last_peered":"2023-12-01T23:46:07.431852+0000","last_clean":"2023-12-01T23:46:07.431852+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:07.431852+0000","last_undegraded":"2023-12-01T23:46:07.431852+0000","last_fullsized":"2023-12-01T23:46:07.431852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.497772+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:46:07.497772+0000","last_peered":"2023-12-01T23:46:07.497772+0000","last_clean":"2023-12-01T23:46:07.497772+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:07.497772+0000","last_undegraded":"2023-12-01T23:46:07.497772+0000","last_fullsized":"2023-12-01T23:46:07.497772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504038+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:46:07.504038+0000","last_peered":"2023-12-01T23:46:07.504038+0000","last_clean":"2023-12-01T23:46:07.504038+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:07.504038+0000","last_undegraded":"2023-12-01T23:46:07.504038+0000","last_fullsized":"2023-12-01T23:46:07.504038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423212+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:46:07.423212+0000","last_peered":"2023-12-01T23:46:07.423212+0000","last_clean":"2023-12-01T23:46:07.423212+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:07.423212+0000","last_undegraded":"2023-12-01T23:46:07.423212+0000","last_fullsized":"2023-12-01T23:46:07.423212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503576+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:46:07.503576+0000","last_peered":"2023-12-01T23:46:07.503576+0000","last_clean":"2023-12-01T23:46:07.503576+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:07.503576+0000","last_undegraded":"2023-12-01T23:46:07.503576+0000","last_fullsized":"2023-12-01T23:46:07.503576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511618+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:46:07.511618+0000","last_peered":"2023-12-01T23:46:07.511618+0000","last_clean":"2023-12-01T23:46:07.511618+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:07.511618+0000","last_undegraded":"2023-12-01T23:46:07.511618+0000","last_fullsized":"2023-12-01T23:46:07.511618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447672+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:46:07.447672+0000","last_peered":"2023-12-01T23:46:07.447672+0000","last_clean":"2023-12-01T23:46:07.447672+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:07.447672+0000","last_undegraded":"2023-12-01T23:46:07.447672+0000","last_fullsized":"2023-12-01T23:46:07.447672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.587639+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:46:07.587639+0000","last_peered":"2023-12-01T23:46:07.587639+0000","last_clean":"2023-12-01T23:46:07.587639+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:07.587639+0000","last_undegraded":"2023-12-01T23:46:07.587639+0000","last_fullsized":"2023-12-01T23:46:07.587639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591637+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:46:07.591637+0000","last_peered":"2023-12-01T23:46:07.591637+0000","last_clean":"2023-12-01T23:46:07.591637+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:07.591637+0000","last_undegraded":"2023-12-01T23:46:07.591637+0000","last_fullsized":"2023-12-01T23:46:07.591637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578993+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.578993+0000","last_peered":"2023-12-01T23:46:07.578993+0000","last_clean":"2023-12-01T23:46:07.578993+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.578993+0000","last_undegraded":"2023-12-01T23:46:07.578993+0000","last_fullsized":"2023-12-01T23:46:07.578993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511817+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:46:07.511817+0000","last_peered":"2023-12-01T23:46:07.511817+0000","last_clean":"2023-12-01T23:46:07.511817+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:07.511817+0000","last_undegraded":"2023-12-01T23:46:07.511817+0000","last_fullsized":"2023-12-01T23:46:07.511817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.572644+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:46:07.572644+0000","last_peered":"2023-12-01T23:46:07.572644+0000","last_clean":"2023-12-01T23:46:07.572644+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:07.572644+0000","last_undegraded":"2023-12-01T23:46:07.572644+0000","last_fullsized":"2023-12-01T23:46:07.572644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504289+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:46:07.504289+0000","last_peered":"2023-12-01T23:46:07.504289+0000","last_clean":"2023-12-01T23:46:07.504289+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:46:07.504289+0000","last_undegraded":"2023-12-01T23:46:07.504289+0000","last_fullsized":"2023-12-01T23:46:07.504289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.571255+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:46:07.571255+0000","last_peered":"2023-12-01T23:46:07.571255+0000","last_clean":"2023-12-01T23:46:07.571255+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:07.571255+0000","last_undegraded":"2023-12-01T23:46:07.571255+0000","last_fullsized":"2023-12-01T23:46:07.571255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507521+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.507521+0000","last_peered":"2023-12-01T23:46:07.507521+0000","last_clean":"2023-12-01T23:46:07.507521+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:07.507521+0000","last_undegraded":"2023-12-01T23:46:07.507521+0000","last_fullsized":"2023-12-01T23:46:07.507521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503340+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:46:07.503340+0000","last_peered":"2023-12-01T23:46:07.503340+0000","last_clean":"2023-12-01T23:46:07.503340+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:07.503340+0000","last_undegraded":"2023-12-01T23:46:07.503340+0000","last_fullsized":"2023-12-01T23:46:07.503340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.421891+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:46:07.421891+0000","last_peered":"2023-12-01T23:46:07.421891+0000","last_clean":"2023-12-01T23:46:07.421891+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:07.421891+0000","last_undegraded":"2023-12-01T23:46:07.421891+0000","last_fullsized":"2023-12-01T23:46:07.421891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578463+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:46:07.578463+0000","last_peered":"2023-12-01T23:46:07.578463+0000","last_clean":"2023-12-01T23:46:07.578463+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:07.578463+0000","last_undegraded":"2023-12-01T23:46:07.578463+0000","last_fullsized":"2023-12-01T23:46:07.578463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8417,"ondisk_log_size":8417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509780,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.505}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.375},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.433}]}]},{"osd":5,"up_from":15,"seq":64424509781,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.28100000000000003,"5min":0.22900000000000001,"15min":0.20999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.68700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.441,"15min":0.436},"min":{"1min":0.312,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.434},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51000000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.376},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.31900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.308,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.63800000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.439,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.71699999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.436,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65700000000000003},"last":0.58199999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509780,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.29899999999999999},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.41099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.40300000000000002,"5min":0.48699999999999999,"15min":0.48899999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.29999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.314},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.23000000000000001,"15min":0.216},"max":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.56699999999999995},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.42899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.315,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.45500000000000002,"5min":0.57199999999999995,"15min":0.58299999999999996},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.68600000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.628},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.66400000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.625,"5min":0.71999999999999997,"15min":0.72599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.55700000000000005,"5min":0.61599999999999999,"15min":0.70399999999999996},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59199999999999997,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.54400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509781,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.314}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.69599999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.54700000000000004,"5min":0.63,"15min":0.66500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.29299999999999998,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.626,"15min":0.68100000000000005},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.71199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40100000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.505,"5min":0.59399999999999997,"15min":0.70299999999999996},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.441},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.68000000000000005},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57599999999999996,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.23999999999999999},"max":{"1min":0.5,"5min":0.54700000000000004,"15min":0.68899999999999995},"last":0.35599999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.372,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.74199999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.55900000000000005,"5min":0.61899999999999999,"15min":0.69799999999999995},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.314,"5min":0.254,"15min":0.249},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.71799999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.45400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67400000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.40799999999999997},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53800000000000003,"5min":0.63700000000000001,"15min":0.68700000000000006},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.40100000000000002},"min":{"1min":0.28999999999999998,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.61599999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56799999999999995,"5min":0.626,"15min":0.626},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.40400000000000003,"5min":0.54200000000000004,"15min":0.61399999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47599999999999998,"5min":0.56899999999999995,"15min":0.59899999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.64900000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.37,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23400000000000001},"max":{"1min":0.46200000000000002,"5min":0.626,"15min":0.73899999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.64400000000000002,"15min":0.71799999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39000000000000001,"15min":0.40000000000000002},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.45100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542485,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575188,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.42199999999999999,"5min":0.623,"15min":0.623},"last":0.217},{"interface":"front","average":{"1min":0.312,"5min":0.316,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.47799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.314,"15min":0.30199999999999999},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.193},"max":{"1min":0.46000000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.254}]},{"osd":3,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.57399999999999995,"15min":0.623},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.36099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.59699999999999998},"last":0.375},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.56899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39600000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.441,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.442},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58199999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.432}]},{"osd":6,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67100000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.69799999999999995,"15min":0.71099999999999997},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.745},"last":0.441},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":0.64200000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:46:14.771 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-01T23:46:14.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:46:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 Processor -- start 2023-12-01T23:46:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 -- start start 2023-12-01T23:46:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f858c153c70 0x7f858c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 0x7f858c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c15a700 con 0x7f858c153890 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0cf840 con 0x7f858c153c70 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.904+0000 7f8592a48640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0ca870 con 0x7f858c0ceef0 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.905+0000 7f858b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f858c153c70 0x7f858c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.905+0000 7f8590fe5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 0x7f858c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.905+0000 7f8590fe5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 0x7f858c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:41292/0 (socket says 172.21.15.96:41292) 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.905+0000 7f858b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f858c153c70 0x7f858c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53888/0 (socket says 172.21.15.96:53888) 2023-12-01T23:46:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.905+0000 7f8590fe5640 1 -- 172.21.15.96:0/232588435 learned_addr learned my addr 172.21.15.96:0/232588435 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.908+0000 7f858b7fe640 1 -- 172.21.15.96:0/232588435 >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 msgr2=0x7f858c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.908+0000 7f858b7fe640 1 --2- 172.21.15.96:0/232588435 >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 0x7f858c0cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.908+0000 7f858b7fe640 1 -- 172.21.15.96:0/232588435 >> v1:172.21.15.102:6789/0 conn(0x7f858c153890 legacy=0x7f858c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.908+0000 7f858b7fe640 1 -- 172.21.15.96:0/232588435 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c159af0 con 0x7f858c153c70 2023-12-01T23:46:14.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.910+0000 7f858b7fe640 1 --2- 172.21.15.96:0/232588435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c15d950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f858c0c9ab0 tx=0x7f857c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696063d6c90f7c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:14.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.913+0000 7f858affd640 1 -- 172.21.15.96:0/232588435 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c030610 con 0x7f858c153c70 2023-12-01T23:46:14.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.913+0000 7f858affd640 1 -- 172.21.15.96:0/232588435 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c030770 con 0x7f858c153c70 2023-12-01T23:46:14.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.913+0000 7f858affd640 1 -- 172.21.15.96:0/232588435 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c030b00 con 0x7f858c153c70 2023-12-01T23:46:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 -- 172.21.15.96:0/232588435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 msgr2=0x7f858c15d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 --2- 172.21.15.96:0/232588435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c15d950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f858c0c9ab0 tx=0x7f857c02b960 comp rx=0 tx=0).stop 2023-12-01T23:46:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 -- 172.21.15.96:0/232588435 shutdown_connections 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 --2- 172.21.15.96:0/232588435 >> v2:172.21.15.102:3300/0 conn(0x7f858c0ceef0 0x7f858c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 --2- 172.21.15.96:0/232588435 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c15d950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 -- 172.21.15.96:0/232588435 >> 172.21.15.96:0/232588435 conn(0x7f858c06ba00 msgr2=0x7f858c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 -- 172.21.15.96:0/232588435 shutdown_connections 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.914+0000 7f8592a48640 1 -- 172.21.15.96:0/232588435 wait complete. 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.915+0000 7f8592a48640 1 Processor -- start 2023-12-01T23:46:14.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.915+0000 7f8592a48640 1 -- start start 2023-12-01T23:46:14.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0ceef0 0x7f858c1f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f858c153890 0x7f858c1f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c14dde0 con 0x7f858c153c70 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1513e0 con 0x7f858c0ceef0 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.916+0000 7f8592a48640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1516c0 con 0x7f858c153890 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.917+0000 7f8590fe5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.917+0000 7f858bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0ceef0 0x7f858c1f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.917+0000 7f858b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f858c153890 0x7f858c1f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.917+0000 7f8590fe5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53902/0 (socket says 172.21.15.96:53902) 2023-12-01T23:46:14.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.917+0000 7f8590fe5640 1 -- 172.21.15.96:0/1168541118 learned_addr learned my addr 172.21.15.96:0/1168541118 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.920+0000 7f8590fe5640 1 -- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f858c153890 msgr2=0x7f858c1f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.920+0000 7f8590fe5640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f858c153890 0x7f858c1f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.920+0000 7f8590fe5640 1 -- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0ceef0 msgr2=0x7f858c1f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:14.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.920+0000 7f8590fe5640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0ceef0 0x7f858c1f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:14.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.920+0000 7f8590fe5640 1 -- 172.21.15.96:0/1168541118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c009400 con 0x7f858c153c70 2023-12-01T23:46:14.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.922+0000 7f8590fe5640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f858400efc0 tx=0x7f858400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.926+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584009b60 con 0x7f858c153c70 2023-12-01T23:46:14.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.926+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858400f040 con 0x7f858c153c70 2023-12-01T23:46:14.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.926+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8584003990 con 0x7f858c153c70 2023-12-01T23:46:14.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.926+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c1ef580 con 0x7f858c153c70 2023-12-01T23:46:14.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.926+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c1efb40 con 0x7f858c153c70 2023-12-01T23:46:14.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.927+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c1efd30 con 0x7f858c153c70 2023-12-01T23:46:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.945+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8584003af0 con 0x7f858c153c70 2023-12-01T23:46:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.946+0000 7f8588ff9640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 0x7f856c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.946+0000 7f858bfff640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 0x7f856c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:14.946+0000 7f858bfff640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 0x7f856c06d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8574001780 tx=0x7f8574009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:15.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.182+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f85840596d0 con 0x7f858c153c70 2023-12-01T23:46:15.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.182+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8584055a10 con 0x7f858c153c70 2023-12-01T23:46:15.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.349+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f858c0743d0 con 0x7f856c06aec0 2023-12-01T23:46:15.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.367+0000 7f8588ff9640 1 -- 172.21.15.96:0/1168541118 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371057 (secure 0 0 0) 0x7f858c0743d0 con 0x7f856c06aec0 2023-12-01T23:46:15.373 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:15.376 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:46:15.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 msgr2=0x7f856c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 0x7f856c06d380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8574001780 tx=0x7f8574009040 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 msgr2=0x7f858c143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f858400efc0 tx=0x7f858400c490 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 shutdown_connections 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f856c06aec0 0x7f856c06d380 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f858c153c70 0x7f858c143c00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f858c153890 0x7f858c1f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 --2- 172.21.15.96:0/1168541118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f858c0ceef0 0x7f858c1f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 >> 172.21.15.96:0/1168541118 conn(0x7f858c06ba00 msgr2=0x7f858c158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 shutdown_connections 2023-12-01T23:46:15.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.371+0000 7f8592a48640 1 -- 172.21.15.96:0/1168541118 wait complete. 2023-12-01T23:46:15.384 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":864,"stamp":"2023-12-01T23:46:14.177151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15659,"ondisk_log_size":15659,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":33136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":19,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002920"},"pg_stats":[{"pgid":"2.1f","version":"29'584","reported_seq":616,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.549640+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:46:01.549640+0000","last_peered":"2023-12-01T23:46:01.549640+0000","last_clean":"2023-12-01T23:46:01.549640+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:01.549640+0000","last_undegraded":"2023-12-01T23:46:01.549640+0000","last_fullsized":"2023-12-01T23:46:01.549640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:19:39.334321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.488155+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:46:07.488155+0000","last_peered":"2023-12-01T23:46:07.488155+0000","last_clean":"2023-12-01T23:46:07.488155+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:07.488155+0000","last_undegraded":"2023-12-01T23:46:07.488155+0000","last_fullsized":"2023-12-01T23:46:07.488155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137759+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.137759+0000","last_peered":"2023-12-01T23:45:40.137759+0000","last_clean":"2023-12-01T23:45:40.137759+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.137759+0000","last_undegraded":"2023-12-01T23:45:40.137759+0000","last_fullsized":"2023-12-01T23:45:40.137759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'721","reported_seq":753,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.383573+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:45:48.383573+0000","last_peered":"2023-12-01T23:45:48.383573+0000","last_clean":"2023-12-01T23:45:48.383573+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:45:48.383573+0000","last_undegraded":"2023-12-01T23:45:48.383573+0000","last_fullsized":"2023-12-01T23:45:48.383573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506249+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:46:07.506249+0000","last_peered":"2023-12-01T23:46:07.506249+0000","last_clean":"2023-12-01T23:46:07.506249+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:07.506249+0000","last_undegraded":"2023-12-01T23:46:07.506249+0000","last_fullsized":"2023-12-01T23:46:07.506249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:35.302116+0000","last_change":"2023-12-01T23:19:06.103620+0000","last_active":"2023-12-01T23:45:35.302116+0000","last_peered":"2023-12-01T23:45:35.302116+0000","last_clean":"2023-12-01T23:45:35.302116+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:45:35.302116+0000","last_undegraded":"2023-12-01T23:45:35.302116+0000","last_fullsized":"2023-12-01T23:45:35.302116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:18:06.190136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1374","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565136+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:45:58.565136+0000","last_peered":"2023-12-01T23:45:58.565136+0000","last_clean":"2023-12-01T23:45:58.565136+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:45:58.565136+0000","last_undegraded":"2023-12-01T23:45:58.565136+0000","last_fullsized":"2023-12-01T23:45:58.565136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504046+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:46:07.504046+0000","last_peered":"2023-12-01T23:46:07.504046+0000","last_clean":"2023-12-01T23:46:07.504046+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:07.504046+0000","last_undegraded":"2023-12-01T23:46:07.504046+0000","last_fullsized":"2023-12-01T23:46:07.504046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143603+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:45:40.143603+0000","last_peered":"2023-12-01T23:45:40.143603+0000","last_clean":"2023-12-01T23:45:40.143603+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:45:40.143603+0000","last_undegraded":"2023-12-01T23:45:40.143603+0000","last_fullsized":"2023-12-01T23:45:40.143603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:59.111214+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:45:59.111214+0000","last_peered":"2023-12-01T23:45:59.111214+0000","last_clean":"2023-12-01T23:45:59.111214+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:45:59.111214+0000","last_undegraded":"2023-12-01T23:45:59.111214+0000","last_fullsized":"2023-12-01T23:45:59.111214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504109+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:46:07.504109+0000","last_peered":"2023-12-01T23:46:07.504109+0000","last_clean":"2023-12-01T23:46:07.504109+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:07.504109+0000","last_undegraded":"2023-12-01T23:46:07.504109+0000","last_fullsized":"2023-12-01T23:46:07.504109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:33.156414+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:45:33.156414+0000","last_peered":"2023-12-01T23:45:33.156414+0000","last_clean":"2023-12-01T23:45:33.156414+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:45:33.156414+0000","last_undegraded":"2023-12-01T23:45:33.156414+0000","last_fullsized":"2023-12-01T23:45:33.156414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588270+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:46:07.588270+0000","last_peered":"2023-12-01T23:46:07.588270+0000","last_clean":"2023-12-01T23:46:07.588270+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:07.588270+0000","last_undegraded":"2023-12-01T23:46:07.588270+0000","last_fullsized":"2023-12-01T23:46:07.588270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'634","reported_seq":665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.532741+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:45:58.532741+0000","last_peered":"2023-12-01T23:45:58.532741+0000","last_clean":"2023-12-01T23:45:58.532741+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:45:58.532741+0000","last_undegraded":"2023-12-01T23:45:58.532741+0000","last_fullsized":"2023-12-01T23:45:58.532741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.284663+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:45:39.284663+0000","last_peered":"2023-12-01T23:45:39.284663+0000","last_clean":"2023-12-01T23:45:39.284663+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:45:39.284663+0000","last_undegraded":"2023-12-01T23:45:39.284663+0000","last_fullsized":"2023-12-01T23:45:39.284663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491511+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:46:07.491511+0000","last_peered":"2023-12-01T23:46:07.491511+0000","last_clean":"2023-12-01T23:46:07.491511+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:07.491511+0000","last_undegraded":"2023-12-01T23:46:07.491511+0000","last_fullsized":"2023-12-01T23:46:07.491511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288102+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:45:44.288102+0000","last_peered":"2023-12-01T23:45:44.288102+0000","last_clean":"2023-12-01T23:45:44.288102+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:45:44.288102+0000","last_undegraded":"2023-12-01T23:45:44.288102+0000","last_fullsized":"2023-12-01T23:45:44.288102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143684+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143684+0000","last_peered":"2023-12-01T23:45:40.143684+0000","last_clean":"2023-12-01T23:45:40.143684+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143684+0000","last_undegraded":"2023-12-01T23:45:40.143684+0000","last_fullsized":"2023-12-01T23:45:40.143684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507118+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:46:07.507118+0000","last_peered":"2023-12-01T23:46:07.507118+0000","last_clean":"2023-12-01T23:46:07.507118+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:07.507118+0000","last_undegraded":"2023-12-01T23:46:07.507118+0000","last_fullsized":"2023-12-01T23:46:07.507118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:44.288099+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:45:44.288099+0000","last_peered":"2023-12-01T23:45:44.288099+0000","last_clean":"2023-12-01T23:45:44.288099+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:45:44.288099+0000","last_undegraded":"2023-12-01T23:45:44.288099+0000","last_fullsized":"2023-12-01T23:45:44.288099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:55.654227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":155,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.239466+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:39.239466+0000","last_peered":"2023-12-01T23:45:39.239466+0000","last_clean":"2023-12-01T23:45:39.239466+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:39.239466+0000","last_undegraded":"2023-12-01T23:45:39.239466+0000","last_fullsized":"2023-12-01T23:45:39.239466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:30:59.429232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.994567+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:45:37.994567+0000","last_peered":"2023-12-01T23:45:37.994567+0000","last_clean":"2023-12-01T23:45:37.994567+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:45:37.994567+0000","last_undegraded":"2023-12-01T23:45:37.994567+0000","last_fullsized":"2023-12-01T23:45:37.994567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.470358+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:45:56.470358+0000","last_peered":"2023-12-01T23:45:56.470358+0000","last_clean":"2023-12-01T23:45:56.470358+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:45:56.470358+0000","last_undegraded":"2023-12-01T23:45:56.470358+0000","last_fullsized":"2023-12-01T23:45:56.470358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.849137+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:45:37.849137+0000","last_peered":"2023-12-01T23:45:37.849137+0000","last_clean":"2023-12-01T23:45:37.849137+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:45:37.849137+0000","last_undegraded":"2023-12-01T23:45:37.849137+0000","last_fullsized":"2023-12-01T23:45:37.849137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503456+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:46:07.503456+0000","last_peered":"2023-12-01T23:46:07.503456+0000","last_clean":"2023-12-01T23:46:07.503456+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:07.503456+0000","last_undegraded":"2023-12-01T23:46:07.503456+0000","last_fullsized":"2023-12-01T23:46:07.503456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135804+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:45:39.135804+0000","last_peered":"2023-12-01T23:45:39.135804+0000","last_clean":"2023-12-01T23:45:39.135804+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:45:39.135804+0000","last_undegraded":"2023-12-01T23:45:39.135804+0000","last_fullsized":"2023-12-01T23:45:39.135804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511306+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:46:07.511306+0000","last_peered":"2023-12-01T23:46:07.511306+0000","last_clean":"2023-12-01T23:46:07.511306+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:07.511306+0000","last_undegraded":"2023-12-01T23:46:07.511306+0000","last_fullsized":"2023-12-01T23:46:07.511306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'309","reported_seq":340,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.815973+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:46:01.815973+0000","last_peered":"2023-12-01T23:46:01.815973+0000","last_clean":"2023-12-01T23:46:01.815973+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:01.815973+0000","last_undegraded":"2023-12-01T23:46:01.815973+0000","last_fullsized":"2023-12-01T23:46:01.815973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.975866+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:45:37.975866+0000","last_peered":"2023-12-01T23:45:37.975866+0000","last_clean":"2023-12-01T23:45:37.975866+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:45:37.975866+0000","last_undegraded":"2023-12-01T23:45:37.975866+0000","last_fullsized":"2023-12-01T23:45:37.975866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424012+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:46:07.424012+0000","last_peered":"2023-12-01T23:46:07.424012+0000","last_clean":"2023-12-01T23:46:07.424012+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:07.424012+0000","last_undegraded":"2023-12-01T23:46:07.424012+0000","last_fullsized":"2023-12-01T23:46:07.424012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:50.389391+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:45:50.389391+0000","last_peered":"2023-12-01T23:45:50.389391+0000","last_clean":"2023-12-01T23:45:50.389391+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:45:50.389391+0000","last_undegraded":"2023-12-01T23:45:50.389391+0000","last_fullsized":"2023-12-01T23:45:50.389391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":160,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.077188+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:45:39.077188+0000","last_peered":"2023-12-01T23:45:39.077188+0000","last_clean":"2023-12-01T23:45:39.077188+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:45:39.077188+0000","last_undegraded":"2023-12-01T23:45:39.077188+0000","last_fullsized":"2023-12-01T23:45:39.077188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:26.860226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507506+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:46:07.507506+0000","last_peered":"2023-12-01T23:46:07.507506+0000","last_clean":"2023-12-01T23:46:07.507506+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:07.507506+0000","last_undegraded":"2023-12-01T23:46:07.507506+0000","last_fullsized":"2023-12-01T23:46:07.507506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.427894+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:45:52.427894+0000","last_peered":"2023-12-01T23:45:52.427894+0000","last_clean":"2023-12-01T23:45:52.427894+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:45:52.427894+0000","last_undegraded":"2023-12-01T23:45:52.427894+0000","last_fullsized":"2023-12-01T23:45:52.427894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.210321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":219,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.136442+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:39.136442+0000","last_peered":"2023-12-01T23:45:39.136442+0000","last_clean":"2023-12-01T23:45:39.136442+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:39.136442+0000","last_undegraded":"2023-12-01T23:45:39.136442+0000","last_fullsized":"2023-12-01T23:45:39.136442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447483+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:46:07.447483+0000","last_peered":"2023-12-01T23:46:07.447483+0000","last_clean":"2023-12-01T23:46:07.447483+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:07.447483+0000","last_undegraded":"2023-12-01T23:46:07.447483+0000","last_fullsized":"2023-12-01T23:46:07.447483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565477+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:45:58.565477+0000","last_peered":"2023-12-01T23:45:58.565477+0000","last_clean":"2023-12-01T23:45:58.565477+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:45:58.565477+0000","last_undegraded":"2023-12-01T23:45:58.565477+0000","last_fullsized":"2023-12-01T23:45:58.565477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.268353+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:39.268353+0000","last_peered":"2023-12-01T23:45:39.268353+0000","last_clean":"2023-12-01T23:45:39.268353+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:39.268353+0000","last_undegraded":"2023-12-01T23:45:39.268353+0000","last_fullsized":"2023-12-01T23:45:39.268353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:19:51.241129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423058+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:07.423058+0000","last_peered":"2023-12-01T23:46:07.423058+0000","last_clean":"2023-12-01T23:46:07.423058+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:07.423058+0000","last_undegraded":"2023-12-01T23:46:07.423058+0000","last_fullsized":"2023-12-01T23:46:07.423058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2094,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.534843+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:46:01.534843+0000","last_peered":"2023-12-01T23:46:01.534843+0000","last_clean":"2023-12-01T23:46:01.534843+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:01.534843+0000","last_undegraded":"2023-12-01T23:46:01.534843+0000","last_fullsized":"2023-12-01T23:46:01.534843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134701+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:45:39.134701+0000","last_peered":"2023-12-01T23:45:39.134701+0000","last_clean":"2023-12-01T23:45:39.134701+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:45:39.134701+0000","last_undegraded":"2023-12-01T23:45:39.134701+0000","last_fullsized":"2023-12-01T23:45:39.134701+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506489+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:46:07.506489+0000","last_peered":"2023-12-01T23:46:07.506489+0000","last_clean":"2023-12-01T23:46:07.506489+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:07.506489+0000","last_undegraded":"2023-12-01T23:46:07.506489+0000","last_fullsized":"2023-12-01T23:46:07.506489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:48.114452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'521","reported_seq":553,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446851+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:45:52.446851+0000","last_peered":"2023-12-01T23:45:52.446851+0000","last_clean":"2023-12-01T23:45:52.446851+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:45:52.446851+0000","last_undegraded":"2023-12-01T23:45:52.446851+0000","last_fullsized":"2023-12-01T23:45:52.446851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.274188+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:45:39.274188+0000","last_peered":"2023-12-01T23:45:39.274188+0000","last_clean":"2023-12-01T23:45:39.274188+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:45:39.274188+0000","last_undegraded":"2023-12-01T23:45:39.274188+0000","last_fullsized":"2023-12-01T23:45:39.274188+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:14:09.002317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.499828+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:46:07.499828+0000","last_peered":"2023-12-01T23:46:07.499828+0000","last_clean":"2023-12-01T23:46:07.499828+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:07.499828+0000","last_undegraded":"2023-12-01T23:46:07.499828+0000","last_fullsized":"2023-12-01T23:46:07.499828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.085700+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:45:34.085700+0000","last_peered":"2023-12-01T23:45:34.085700+0000","last_clean":"2023-12-01T23:45:34.085700+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:45:34.085700+0000","last_undegraded":"2023-12-01T23:45:34.085700+0000","last_fullsized":"2023-12-01T23:45:34.085700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:42:24.091255+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:42:24.091255+0000","last_peered":"2023-12-01T23:42:24.091255+0000","last_clean":"2023-12-01T23:42:24.091255+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:42:24.091255+0000","last_undegraded":"2023-12-01T23:42:24.091255+0000","last_fullsized":"2023-12-01T23:42:24.091255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":215,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152410+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:45:40.152410+0000","last_peered":"2023-12-01T23:45:40.152410+0000","last_clean":"2023-12-01T23:45:40.152410+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:45:40.152410+0000","last_undegraded":"2023-12-01T23:45:40.152410+0000","last_fullsized":"2023-12-01T23:45:40.152410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578898+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:46:07.578898+0000","last_peered":"2023-12-01T23:46:07.578898+0000","last_clean":"2023-12-01T23:46:07.578898+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:46:07.578898+0000","last_undegraded":"2023-12-01T23:46:07.578898+0000","last_fullsized":"2023-12-01T23:46:07.578898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317219+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:45:46.317219+0000","last_peered":"2023-12-01T23:45:46.317219+0000","last_clean":"2023-12-01T23:45:46.317219+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:45:46.317219+0000","last_undegraded":"2023-12-01T23:45:46.317219+0000","last_fullsized":"2023-12-01T23:45:46.317219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.581319+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:45:34.581319+0000","last_peered":"2023-12-01T23:45:34.581319+0000","last_clean":"2023-12-01T23:45:34.581319+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:45:34.581319+0000","last_undegraded":"2023-12-01T23:45:34.581319+0000","last_fullsized":"2023-12-01T23:45:34.581319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429551+0000","last_change":"2023-12-01T23:19:06.056259+0000","last_active":"2023-12-01T23:46:07.429551+0000","last_peered":"2023-12-01T23:46:07.429551+0000","last_clean":"2023-12-01T23:46:07.429551+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:07.429551+0000","last_undegraded":"2023-12-01T23:46:07.429551+0000","last_fullsized":"2023-12-01T23:46:07.429551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:02.070575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.527321+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:46:00.527321+0000","last_peered":"2023-12-01T23:46:00.527321+0000","last_clean":"2023-12-01T23:46:00.527321+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:00.527321+0000","last_undegraded":"2023-12-01T23:46:00.527321+0000","last_fullsized":"2023-12-01T23:46:00.527321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":222,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.265895+0000","last_change":"2023-12-01T23:19:06.163021+0000","last_active":"2023-12-01T23:45:39.265895+0000","last_peered":"2023-12-01T23:45:39.265895+0000","last_clean":"2023-12-01T23:45:39.265895+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:45:39.265895+0000","last_undegraded":"2023-12-01T23:45:39.265895+0000","last_fullsized":"2023-12-01T23:45:39.265895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:00:33.222976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578723+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.578723+0000","last_peered":"2023-12-01T23:46:07.578723+0000","last_clean":"2023-12-01T23:46:07.578723+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.578723+0000","last_undegraded":"2023-12-01T23:46:07.578723+0000","last_fullsized":"2023-12-01T23:46:07.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:43.162322+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:45:43.162322+0000","last_peered":"2023-12-01T23:45:43.162322+0000","last_clean":"2023-12-01T23:45:43.162322+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:45:43.162322+0000","last_undegraded":"2023-12-01T23:45:43.162322+0000","last_fullsized":"2023-12-01T23:45:43.162322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.280157+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:45:39.280157+0000","last_peered":"2023-12-01T23:45:39.280157+0000","last_clean":"2023-12-01T23:45:39.280157+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:45:39.280157+0000","last_undegraded":"2023-12-01T23:45:39.280157+0000","last_fullsized":"2023-12-01T23:45:39.280157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575841+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.575841+0000","last_peered":"2023-12-01T23:46:07.575841+0000","last_clean":"2023-12-01T23:46:07.575841+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:46:07.575841+0000","last_undegraded":"2023-12-01T23:46:07.575841+0000","last_fullsized":"2023-12-01T23:46:07.575841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.564741+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:45:58.564741+0000","last_peered":"2023-12-01T23:45:58.564741+0000","last_clean":"2023-12-01T23:45:58.564741+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:45:58.564741+0000","last_undegraded":"2023-12-01T23:45:58.564741+0000","last_fullsized":"2023-12-01T23:45:58.564741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135509+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:45:39.135509+0000","last_peered":"2023-12-01T23:45:39.135509+0000","last_clean":"2023-12-01T23:45:39.135509+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:45:39.135509+0000","last_undegraded":"2023-12-01T23:45:39.135509+0000","last_fullsized":"2023-12-01T23:45:39.135509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575888+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:46:07.575888+0000","last_peered":"2023-12-01T23:46:07.575888+0000","last_clean":"2023-12-01T23:46:07.575888+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:07.575888+0000","last_undegraded":"2023-12-01T23:46:07.575888+0000","last_fullsized":"2023-12-01T23:46:07.575888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317486+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:45:46.317486+0000","last_peered":"2023-12-01T23:45:46.317486+0000","last_clean":"2023-12-01T23:45:46.317486+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:45:46.317486+0000","last_undegraded":"2023-12-01T23:45:46.317486+0000","last_fullsized":"2023-12-01T23:45:46.317486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135127+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:45:39.135127+0000","last_peered":"2023-12-01T23:45:39.135127+0000","last_clean":"2023-12-01T23:45:39.135127+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:45:39.135127+0000","last_undegraded":"2023-12-01T23:45:39.135127+0000","last_fullsized":"2023-12-01T23:45:39.135127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:34.393729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.586320+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:46:07.586320+0000","last_peered":"2023-12-01T23:46:07.586320+0000","last_clean":"2023-12-01T23:46:07.586320+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:07.586320+0000","last_undegraded":"2023-12-01T23:46:07.586320+0000","last_fullsized":"2023-12-01T23:46:07.586320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.384828+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:45:48.384828+0000","last_peered":"2023-12-01T23:45:48.384828+0000","last_clean":"2023-12-01T23:45:48.384828+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:45:48.384828+0000","last_undegraded":"2023-12-01T23:45:48.384828+0000","last_fullsized":"2023-12-01T23:45:48.384828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.278999+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:39.278999+0000","last_peered":"2023-12-01T23:45:39.278999+0000","last_clean":"2023-12-01T23:45:39.278999+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:39.278999+0000","last_undegraded":"2023-12-01T23:45:39.278999+0000","last_fullsized":"2023-12-01T23:45:39.278999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.432398+0000","last_change":"2023-12-01T23:19:06.056474+0000","last_active":"2023-12-01T23:46:07.432398+0000","last_peered":"2023-12-01T23:46:07.432398+0000","last_clean":"2023-12-01T23:46:07.432398+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:07.432398+0000","last_undegraded":"2023-12-01T23:46:07.432398+0000","last_fullsized":"2023-12-01T23:46:07.432398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:00.298932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565262+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:45:58.565262+0000","last_peered":"2023-12-01T23:45:58.565262+0000","last_clean":"2023-12-01T23:45:58.565262+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:45:58.565262+0000","last_undegraded":"2023-12-01T23:45:58.565262+0000","last_fullsized":"2023-12-01T23:45:58.565262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137373+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:45:40.137373+0000","last_peered":"2023-12-01T23:45:40.137373+0000","last_clean":"2023-12-01T23:45:40.137373+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:45:40.137373+0000","last_undegraded":"2023-12-01T23:45:40.137373+0000","last_fullsized":"2023-12-01T23:45:40.137373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503494+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:46:07.503494+0000","last_peered":"2023-12-01T23:46:07.503494+0000","last_clean":"2023-12-01T23:46:07.503494+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:07.503494+0000","last_undegraded":"2023-12-01T23:46:07.503494+0000","last_fullsized":"2023-12-01T23:46:07.503494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'256","reported_seq":286,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.260901+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:46:07.260901+0000","last_peered":"2023-12-01T23:46:07.260901+0000","last_clean":"2023-12-01T23:46:07.260901+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:07.260901+0000","last_undegraded":"2023-12-01T23:46:07.260901+0000","last_fullsized":"2023-12-01T23:46:07.260901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:13.196306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.211620+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.211620+0000","last_peered":"2023-12-01T23:45:39.211620+0000","last_clean":"2023-12-01T23:45:39.211620+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.211620+0000","last_undegraded":"2023-12-01T23:45:39.211620+0000","last_fullsized":"2023-12-01T23:45:39.211620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578590+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:46:07.578590+0000","last_peered":"2023-12-01T23:46:07.578590+0000","last_clean":"2023-12-01T23:46:07.578590+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:07.578590+0000","last_undegraded":"2023-12-01T23:46:07.578590+0000","last_fullsized":"2023-12-01T23:46:07.578590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.992466+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:45:56.992466+0000","last_peered":"2023-12-01T23:45:56.992466+0000","last_clean":"2023-12-01T23:45:56.992466+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:45:56.992466+0000","last_undegraded":"2023-12-01T23:45:56.992466+0000","last_fullsized":"2023-12-01T23:45:56.992466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152294+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:45:40.152294+0000","last_peered":"2023-12-01T23:45:40.152294+0000","last_clean":"2023-12-01T23:45:40.152294+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:45:40.152294+0000","last_undegraded":"2023-12-01T23:45:40.152294+0000","last_fullsized":"2023-12-01T23:45:40.152294+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448442+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:46:07.448442+0000","last_peered":"2023-12-01T23:46:07.448442+0000","last_clean":"2023-12-01T23:46:07.448442+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:07.448442+0000","last_undegraded":"2023-12-01T23:46:07.448442+0000","last_fullsized":"2023-12-01T23:46:07.448442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'696","reported_seq":726,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.553477+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:46:01.553477+0000","last_peered":"2023-12-01T23:46:01.553477+0000","last_clean":"2023-12-01T23:46:01.553477+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:01.553477+0000","last_undegraded":"2023-12-01T23:46:01.553477+0000","last_fullsized":"2023-12-01T23:46:01.553477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.207440+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:45:39.207440+0000","last_peered":"2023-12-01T23:45:39.207440+0000","last_clean":"2023-12-01T23:45:39.207440+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:45:39.207440+0000","last_undegraded":"2023-12-01T23:45:39.207440+0000","last_fullsized":"2023-12-01T23:45:39.207440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503556+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:46:07.503556+0000","last_peered":"2023-12-01T23:46:07.503556+0000","last_clean":"2023-12-01T23:46:07.503556+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:07.503556+0000","last_undegraded":"2023-12-01T23:46:07.503556+0000","last_fullsized":"2023-12-01T23:46:07.503556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.354784+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:45:49.354784+0000","last_peered":"2023-12-01T23:45:49.354784+0000","last_clean":"2023-12-01T23:45:49.354784+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:45:49.354784+0000","last_undegraded":"2023-12-01T23:45:49.354784+0000","last_fullsized":"2023-12-01T23:45:49.354784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.976384+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:45:37.976384+0000","last_peered":"2023-12-01T23:45:37.976384+0000","last_clean":"2023-12-01T23:45:37.976384+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:45:37.976384+0000","last_undegraded":"2023-12-01T23:45:37.976384+0000","last_fullsized":"2023-12-01T23:45:37.976384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500976+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:46:07.500976+0000","last_peered":"2023-12-01T23:46:07.500976+0000","last_clean":"2023-12-01T23:46:07.500976+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:07.500976+0000","last_undegraded":"2023-12-01T23:46:07.500976+0000","last_fullsized":"2023-12-01T23:46:07.500976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.340217+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:45:49.340217+0000","last_peered":"2023-12-01T23:45:49.340217+0000","last_clean":"2023-12-01T23:45:49.340217+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:45:49.340217+0000","last_undegraded":"2023-12-01T23:45:49.340217+0000","last_fullsized":"2023-12-01T23:45:49.340217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.276183+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:45:39.276183+0000","last_peered":"2023-12-01T23:45:39.276183+0000","last_clean":"2023-12-01T23:45:39.276183+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:45:39.276183+0000","last_undegraded":"2023-12-01T23:45:39.276183+0000","last_fullsized":"2023-12-01T23:45:39.276183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.430560+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:45:34.430560+0000","last_peered":"2023-12-01T23:45:34.430560+0000","last_clean":"2023-12-01T23:45:34.430560+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:45:34.430560+0000","last_undegraded":"2023-12-01T23:45:34.430560+0000","last_fullsized":"2023-12-01T23:45:34.430560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:15.351583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429200+0000","last_change":"2023-12-01T23:19:06.057281+0000","last_active":"2023-12-01T23:46:07.429200+0000","last_peered":"2023-12-01T23:46:07.429200+0000","last_clean":"2023-12-01T23:46:07.429200+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:07.429200+0000","last_undegraded":"2023-12-01T23:46:07.429200+0000","last_fullsized":"2023-12-01T23:46:07.429200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:15:36.967562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.532515+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:46:00.532515+0000","last_peered":"2023-12-01T23:46:00.532515+0000","last_clean":"2023-12-01T23:46:00.532515+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:00.532515+0000","last_undegraded":"2023-12-01T23:46:00.532515+0000","last_fullsized":"2023-12-01T23:46:00.532515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.071949+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:45:40.071949+0000","last_peered":"2023-12-01T23:45:40.071949+0000","last_clean":"2023-12-01T23:45:40.071949+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:45:40.071949+0000","last_undegraded":"2023-12-01T23:45:40.071949+0000","last_fullsized":"2023-12-01T23:45:40.071949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510478+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:46:07.510478+0000","last_peered":"2023-12-01T23:46:07.510478+0000","last_clean":"2023-12-01T23:46:07.510478+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:07.510478+0000","last_undegraded":"2023-12-01T23:46:07.510478+0000","last_fullsized":"2023-12-01T23:46:07.510478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446752+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:45:52.446752+0000","last_peered":"2023-12-01T23:45:52.446752+0000","last_clean":"2023-12-01T23:45:52.446752+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:45:52.446752+0000","last_undegraded":"2023-12-01T23:45:52.446752+0000","last_fullsized":"2023-12-01T23:45:52.446752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'687","reported_seq":717,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.887479+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:45:57.887479+0000","last_peered":"2023-12-01T23:45:57.887479+0000","last_clean":"2023-12-01T23:45:57.887479+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:45:57.887479+0000","last_undegraded":"2023-12-01T23:45:57.887479+0000","last_fullsized":"2023-12-01T23:45:57.887479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503298+0000","last_change":"2023-12-01T23:18:28.872369+0000","last_active":"2023-12-01T23:46:07.503298+0000","last_peered":"2023-12-01T23:46:07.503298+0000","last_clean":"2023-12-01T23:46:07.503298+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:07.503298+0000","last_undegraded":"2023-12-01T23:46:07.503298+0000","last_fullsized":"2023-12-01T23:46:07.503298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134507+0000","last_change":"2023-12-01T23:19:06.163026+0000","last_active":"2023-12-01T23:45:39.134507+0000","last_peered":"2023-12-01T23:45:39.134507+0000","last_clean":"2023-12-01T23:45:39.134507+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:45:39.134507+0000","last_undegraded":"2023-12-01T23:45:39.134507+0000","last_fullsized":"2023-12-01T23:45:39.134507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'676","reported_seq":706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.469370+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:45:56.469370+0000","last_peered":"2023-12-01T23:45:56.469370+0000","last_clean":"2023-12-01T23:45:56.469370+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:45:56.469370+0000","last_undegraded":"2023-12-01T23:45:56.469370+0000","last_fullsized":"2023-12-01T23:45:56.469370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448156+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:46:07.448156+0000","last_peered":"2023-12-01T23:46:07.448156+0000","last_clean":"2023-12-01T23:46:07.448156+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:07.448156+0000","last_undegraded":"2023-12-01T23:46:07.448156+0000","last_fullsized":"2023-12-01T23:46:07.448156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134413+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:45:39.134413+0000","last_peered":"2023-12-01T23:45:39.134413+0000","last_clean":"2023-12-01T23:45:39.134413+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:45:39.134413+0000","last_undegraded":"2023-12-01T23:45:39.134413+0000","last_fullsized":"2023-12-01T23:45:39.134413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588952+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:46:07.588952+0000","last_peered":"2023-12-01T23:46:07.588952+0000","last_clean":"2023-12-01T23:46:07.588952+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:07.588952+0000","last_undegraded":"2023-12-01T23:46:07.588952+0000","last_fullsized":"2023-12-01T23:46:07.588952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429738+0000","last_change":"2023-12-01T23:19:06.058763+0000","last_active":"2023-12-01T23:46:07.429738+0000","last_peered":"2023-12-01T23:46:07.429738+0000","last_clean":"2023-12-01T23:46:07.429738+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:07.429738+0000","last_undegraded":"2023-12-01T23:46:07.429738+0000","last_fullsized":"2023-12-01T23:46:07.429738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:01.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507283+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:46:07.507283+0000","last_peered":"2023-12-01T23:46:07.507283+0000","last_clean":"2023-12-01T23:46:07.507283+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:46:07.507283+0000","last_undegraded":"2023-12-01T23:46:07.507283+0000","last_fullsized":"2023-12-01T23:46:07.507283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500625+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:46:07.500625+0000","last_peered":"2023-12-01T23:46:07.500625+0000","last_clean":"2023-12-01T23:46:07.500625+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:07.500625+0000","last_undegraded":"2023-12-01T23:46:07.500625+0000","last_fullsized":"2023-12-01T23:46:07.500625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:10.296184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.514310+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:46:07.514310+0000","last_peered":"2023-12-01T23:46:07.514310+0000","last_clean":"2023-12-01T23:46:07.514310+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:07.514310+0000","last_undegraded":"2023-12-01T23:46:07.514310+0000","last_fullsized":"2023-12-01T23:46:07.514310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424251+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:46:07.424251+0000","last_peered":"2023-12-01T23:46:07.424251+0000","last_clean":"2023-12-01T23:46:07.424251+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:07.424251+0000","last_undegraded":"2023-12-01T23:46:07.424251+0000","last_fullsized":"2023-12-01T23:46:07.424251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591499+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:46:07.591499+0000","last_peered":"2023-12-01T23:46:07.591499+0000","last_clean":"2023-12-01T23:46:07.591499+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:07.591499+0000","last_undegraded":"2023-12-01T23:46:07.591499+0000","last_fullsized":"2023-12-01T23:46:07.591499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491852+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:46:07.491852+0000","last_peered":"2023-12-01T23:46:07.491852+0000","last_clean":"2023-12-01T23:46:07.491852+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:07.491852+0000","last_undegraded":"2023-12-01T23:46:07.491852+0000","last_fullsized":"2023-12-01T23:46:07.491852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507294+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:46:07.507294+0000","last_peered":"2023-12-01T23:46:07.507294+0000","last_clean":"2023-12-01T23:46:07.507294+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:07.507294+0000","last_undegraded":"2023-12-01T23:46:07.507294+0000","last_fullsized":"2023-12-01T23:46:07.507294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510325+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:46:07.510325+0000","last_peered":"2023-12-01T23:46:07.510325+0000","last_clean":"2023-12-01T23:46:07.510325+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:07.510325+0000","last_undegraded":"2023-12-01T23:46:07.510325+0000","last_fullsized":"2023-12-01T23:46:07.510325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506232+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:46:07.506232+0000","last_peered":"2023-12-01T23:46:07.506232+0000","last_clean":"2023-12-01T23:46:07.506232+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:46:07.506232+0000","last_undegraded":"2023-12-01T23:46:07.506232+0000","last_fullsized":"2023-12-01T23:46:07.506232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503212+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:46:07.503212+0000","last_peered":"2023-12-01T23:46:07.503212+0000","last_clean":"2023-12-01T23:46:07.503212+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:07.503212+0000","last_undegraded":"2023-12-01T23:46:07.503212+0000","last_fullsized":"2023-12-01T23:46:07.503212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:54:47.049442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588627+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:46:07.588627+0000","last_peered":"2023-12-01T23:46:07.588627+0000","last_clean":"2023-12-01T23:46:07.588627+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:07.588627+0000","last_undegraded":"2023-12-01T23:46:07.588627+0000","last_fullsized":"2023-12-01T23:46:07.588627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578518+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578518+0000","last_peered":"2023-12-01T23:46:07.578518+0000","last_clean":"2023-12-01T23:46:07.578518+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578518+0000","last_undegraded":"2023-12-01T23:46:07.578518+0000","last_fullsized":"2023-12-01T23:46:07.578518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.431852+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:46:07.431852+0000","last_peered":"2023-12-01T23:46:07.431852+0000","last_clean":"2023-12-01T23:46:07.431852+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:07.431852+0000","last_undegraded":"2023-12-01T23:46:07.431852+0000","last_fullsized":"2023-12-01T23:46:07.431852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.497772+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:46:07.497772+0000","last_peered":"2023-12-01T23:46:07.497772+0000","last_clean":"2023-12-01T23:46:07.497772+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:07.497772+0000","last_undegraded":"2023-12-01T23:46:07.497772+0000","last_fullsized":"2023-12-01T23:46:07.497772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504038+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:46:07.504038+0000","last_peered":"2023-12-01T23:46:07.504038+0000","last_clean":"2023-12-01T23:46:07.504038+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:07.504038+0000","last_undegraded":"2023-12-01T23:46:07.504038+0000","last_fullsized":"2023-12-01T23:46:07.504038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.423212+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:46:07.423212+0000","last_peered":"2023-12-01T23:46:07.423212+0000","last_clean":"2023-12-01T23:46:07.423212+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:07.423212+0000","last_undegraded":"2023-12-01T23:46:07.423212+0000","last_fullsized":"2023-12-01T23:46:07.423212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503576+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:46:07.503576+0000","last_peered":"2023-12-01T23:46:07.503576+0000","last_clean":"2023-12-01T23:46:07.503576+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:07.503576+0000","last_undegraded":"2023-12-01T23:46:07.503576+0000","last_fullsized":"2023-12-01T23:46:07.503576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511618+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:46:07.511618+0000","last_peered":"2023-12-01T23:46:07.511618+0000","last_clean":"2023-12-01T23:46:07.511618+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:07.511618+0000","last_undegraded":"2023-12-01T23:46:07.511618+0000","last_fullsized":"2023-12-01T23:46:07.511618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447672+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:46:07.447672+0000","last_peered":"2023-12-01T23:46:07.447672+0000","last_clean":"2023-12-01T23:46:07.447672+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:07.447672+0000","last_undegraded":"2023-12-01T23:46:07.447672+0000","last_fullsized":"2023-12-01T23:46:07.447672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.587639+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:46:07.587639+0000","last_peered":"2023-12-01T23:46:07.587639+0000","last_clean":"2023-12-01T23:46:07.587639+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:07.587639+0000","last_undegraded":"2023-12-01T23:46:07.587639+0000","last_fullsized":"2023-12-01T23:46:07.587639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591637+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:46:07.591637+0000","last_peered":"2023-12-01T23:46:07.591637+0000","last_clean":"2023-12-01T23:46:07.591637+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:07.591637+0000","last_undegraded":"2023-12-01T23:46:07.591637+0000","last_fullsized":"2023-12-01T23:46:07.591637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578993+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.578993+0000","last_peered":"2023-12-01T23:46:07.578993+0000","last_clean":"2023-12-01T23:46:07.578993+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.578993+0000","last_undegraded":"2023-12-01T23:46:07.578993+0000","last_fullsized":"2023-12-01T23:46:07.578993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511817+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:46:07.511817+0000","last_peered":"2023-12-01T23:46:07.511817+0000","last_clean":"2023-12-01T23:46:07.511817+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:07.511817+0000","last_undegraded":"2023-12-01T23:46:07.511817+0000","last_fullsized":"2023-12-01T23:46:07.511817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.572644+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:46:07.572644+0000","last_peered":"2023-12-01T23:46:07.572644+0000","last_clean":"2023-12-01T23:46:07.572644+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:07.572644+0000","last_undegraded":"2023-12-01T23:46:07.572644+0000","last_fullsized":"2023-12-01T23:46:07.572644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504289+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:46:07.504289+0000","last_peered":"2023-12-01T23:46:07.504289+0000","last_clean":"2023-12-01T23:46:07.504289+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:46:07.504289+0000","last_undegraded":"2023-12-01T23:46:07.504289+0000","last_fullsized":"2023-12-01T23:46:07.504289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.571255+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:46:07.571255+0000","last_peered":"2023-12-01T23:46:07.571255+0000","last_clean":"2023-12-01T23:46:07.571255+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:07.571255+0000","last_undegraded":"2023-12-01T23:46:07.571255+0000","last_fullsized":"2023-12-01T23:46:07.571255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507521+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.507521+0000","last_peered":"2023-12-01T23:46:07.507521+0000","last_clean":"2023-12-01T23:46:07.507521+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:07.507521+0000","last_undegraded":"2023-12-01T23:46:07.507521+0000","last_fullsized":"2023-12-01T23:46:07.507521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503340+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:46:07.503340+0000","last_peered":"2023-12-01T23:46:07.503340+0000","last_clean":"2023-12-01T23:46:07.503340+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:07.503340+0000","last_undegraded":"2023-12-01T23:46:07.503340+0000","last_fullsized":"2023-12-01T23:46:07.503340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.421891+0000","last_change":"2023-12-01T23:18:28.854800+0000","last_active":"2023-12-01T23:46:07.421891+0000","last_peered":"2023-12-01T23:46:07.421891+0000","last_clean":"2023-12-01T23:46:07.421891+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:07.421891+0000","last_undegraded":"2023-12-01T23:46:07.421891+0000","last_fullsized":"2023-12-01T23:46:07.421891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578463+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:46:07.578463+0000","last_peered":"2023-12-01T23:46:07.578463+0000","last_clean":"2023-12-01T23:46:07.578463+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:07.578463+0000","last_undegraded":"2023-12-01T23:46:07.578463+0000","last_fullsized":"2023-12-01T23:46:07.578463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8417,"ondisk_log_size":8417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509780,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.505}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.375},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.433}]}]},{"osd":5,"up_from":15,"seq":64424509781,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.28100000000000003,"5min":0.22900000000000001,"15min":0.20999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.68700000000000006},"last":0.435},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.441,"15min":0.436},"min":{"1min":0.312,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.434},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51000000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.376},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.31900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.308,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.63800000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.439,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.71699999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.436,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65700000000000003},"last":0.58199999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509780,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.29899999999999999},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.41099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.40300000000000002,"5min":0.48699999999999999,"15min":0.48899999999999999},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.29999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.314},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.23000000000000001,"15min":0.216},"max":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.56699999999999995},"last":0.27300000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.42899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.315,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.45500000000000002,"5min":0.57199999999999995,"15min":0.58299999999999996},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.68600000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.628},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.66400000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"last":0.41799999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.625,"5min":0.71999999999999997,"15min":0.72599999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.55700000000000005,"5min":0.61599999999999999,"15min":0.70399999999999996},"last":0.40500000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59199999999999997,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.54400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509781,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.25900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.30099999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.314}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.69599999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542484,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40999999999999998,"15min":0.41999999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.54700000000000004,"5min":0.63,"15min":0.66500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.29299999999999998,"5min":0.27500000000000002,"15min":0.255},"max":{"1min":0.61799999999999999,"5min":0.626,"15min":0.68100000000000005},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.39200000000000002,"15min":0.39500000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.71199999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.40100000000000002,"15min":0.41599999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.505,"5min":0.59399999999999997,"15min":0.70299999999999996},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.441},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.41499999999999998},"min":{"1min":0.316,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53100000000000003,"5min":0.53800000000000003,"15min":0.68000000000000005},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32200000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60099999999999998,"5min":0.63100000000000001,"15min":0.66600000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47499999999999998},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57599999999999996,"5min":0.64800000000000002,"15min":0.68000000000000005},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.373},"min":{"1min":0.26700000000000002,"5min":0.253,"15min":0.23999999999999999},"max":{"1min":0.5,"5min":0.54700000000000004,"15min":0.68899999999999995},"last":0.35599999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.372,"15min":0.38200000000000001},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.52100000000000002,"5min":0.52900000000000003,"15min":0.74199999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.44,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.55900000000000005,"5min":0.61899999999999999,"15min":0.69799999999999995},"last":0.42699999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.314,"5min":0.254,"15min":0.249},"max":{"1min":0.61399999999999999,"5min":0.66800000000000004,"15min":0.71799999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.443,"5min":0.42099999999999999,"15min":0.42399999999999999},"min":{"1min":0.315,"5min":0.26700000000000002,"15min":0.249},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.45400000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542484,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40200000000000002},"min":{"1min":0.23599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60699999999999998,"5min":0.625,"15min":0.67400000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38700000000000001,"15min":0.40799999999999997},"min":{"1min":0.23699999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53800000000000003,"5min":0.63700000000000001,"15min":0.68700000000000006},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.42099999999999999},"min":{"1min":0.32600000000000001,"5min":0.25900000000000001,"15min":0.23300000000000001},"max":{"1min":0.59499999999999997,"5min":0.629,"15min":0.65400000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.38800000000000001,"15min":0.40100000000000002},"min":{"1min":0.28999999999999998,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":0.60699999999999998,"15min":0.61599999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42599999999999999,"15min":0.41599999999999998},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.56799999999999995,"5min":0.626,"15min":0.626},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42399999999999999,"15min":0.432},"min":{"1min":0.317,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.442},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.65300000000000002},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34699999999999998,"15min":0.35399999999999998},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.40400000000000003,"5min":0.54200000000000004,"15min":0.61399999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34699999999999998,"15min":0.36099999999999999},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.47599999999999998,"5min":0.56899999999999995,"15min":0.59899999999999998},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27400000000000002,"5min":0.248,"15min":0.245},"max":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.64900000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.37,"5min":0.40100000000000002,"15min":0.40999999999999998},"min":{"1min":0.29399999999999998,"5min":0.23699999999999999,"15min":0.23400000000000001},"max":{"1min":0.46200000000000002,"5min":0.626,"15min":0.73899999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42499999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.51200000000000001,"5min":0.64400000000000002,"15min":0.71799999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39000000000000001,"15min":0.40000000000000002},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.45100000000000001,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57199999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542485,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.52100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575188,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.42199999999999999,"5min":0.623,"15min":0.623},"last":0.217},{"interface":"front","average":{"1min":0.312,"5min":0.316,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.47799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.314,"15min":0.30199999999999999},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.193},"max":{"1min":0.46000000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.254}]},{"osd":3,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.57399999999999995,"15min":0.623},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.26700000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.36099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.59699999999999998},"last":0.375},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.56899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39600000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.441,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.442},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58199999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.432}]},{"osd":6,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67100000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.69799999999999995,"15min":0.71099999999999997},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.745},"last":0.441},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":0.64200000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.44700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:46:15.391 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:46:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.525+0000 7f6060768640 1 Processor -- start 2023-12-01T23:46:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.525+0000 7f6060768640 1 -- start start 2023-12-01T23:46:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6058153890 0x7f605815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6058153c70 0x7f60580c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f60580cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605815a700 con 0x7f6058153890 2023-12-01T23:46:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580ca870 con 0x7f6058153c70 2023-12-01T23:46:15.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f6060768640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6058159af0 con 0x7f60580ceef0 2023-12-01T23:46:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.526+0000 7f605e504640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6058153890 0x7f605815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.527+0000 7f605dd03640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6058153c70 0x7f60580c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.527+0000 7f605ed05640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f60580cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.527+0000 7f605e504640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f6058153890 0x7f605815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53916/0 (socket says 172.21.15.96:53916) 2023-12-01T23:46:15.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.527+0000 7f605e504640 1 -- 172.21.15.96:0/521287432 learned_addr learned my addr 172.21.15.96:0/521287432 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.529+0000 7f605e504640 1 -- 172.21.15.96:0/521287432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 msgr2=0x7f60580cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.529+0000 7f605e504640 1 --2- 172.21.15.96:0/521287432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f60580cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.529+0000 7f605e504640 1 -- 172.21.15.96:0/521287432 >> v2:172.21.15.102:3300/0 conn(0x7f6058153c70 msgr2=0x7f60580c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.529+0000 7f605e504640 1 --2- 172.21.15.96:0/521287432 >> v2:172.21.15.102:3300/0 conn(0x7f6058153c70 0x7f60580c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.529+0000 7f605e504640 1 -- 172.21.15.96:0/521287432 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058159dd0 con 0x7f6058153890 2023-12-01T23:46:15.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.531+0000 7f605e504640 1 --2- 172.21.15.96:0/521287432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f605815d950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f60580c6290 tx=0x7f605402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d50eb96e1f4cb8f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:15.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.534+0000 7f605d502640 1 -- 172.21.15.96:0/521287432 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054030860 con 0x7f6058153890 2023-12-01T23:46:15.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.534+0000 7f605d502640 1 -- 172.21.15.96:0/521287432 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540309c0 con 0x7f6058153890 2023-12-01T23:46:15.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.534+0000 7f605d502640 1 -- 172.21.15.96:0/521287432 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054030d50 con 0x7f6058153890 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 -- 172.21.15.96:0/521287432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 msgr2=0x7f605815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 --2- 172.21.15.96:0/521287432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f605815d950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f60580c6290 tx=0x7f605402b9a0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 -- 172.21.15.96:0/521287432 shutdown_connections 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 --2- 172.21.15.96:0/521287432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f60580cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 --2- 172.21.15.96:0/521287432 >> v2:172.21.15.102:3300/0 conn(0x7f6058153c70 0x7f60580c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 --2- 172.21.15.96:0/521287432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f605815d950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 -- 172.21.15.96:0/521287432 >> 172.21.15.96:0/521287432 conn(0x7f605806ba00 msgr2=0x7f605806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:15.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 -- 172.21.15.96:0/521287432 shutdown_connections 2023-12-01T23:46:15.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.535+0000 7f6060768640 1 -- 172.21.15.96:0/521287432 wait complete. 2023-12-01T23:46:15.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.536+0000 7f6060768640 1 Processor -- start 2023-12-01T23:46:15.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.536+0000 7f6060768640 1 -- start start 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f6058156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058153c70 0x7f60581f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058155ab0 con 0x7f6058153890 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60581f10e0 con 0x7f6058153c70 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.537+0000 7f6060768640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6058154090 con 0x7f60580ceef0 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.538+0000 7f605dd03640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.538+0000 7f605ed05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058153c70 0x7f60581f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.538+0000 7f605e504640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f6058156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.538+0000 7f605dd03640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53930/0 (socket says 172.21.15.96:53930) 2023-12-01T23:46:15.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.538+0000 7f605dd03640 1 -- 172.21.15.96:0/1457071180 learned_addr learned my addr 172.21.15.96:0/1457071180 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.541+0000 7f605dd03640 1 -- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 msgr2=0x7f6058156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.541+0000 7f605dd03640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f6058156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.541+0000 7f605dd03640 1 -- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058153c70 msgr2=0x7f60581f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.541+0000 7f605dd03640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058153c70 0x7f60581f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:15.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.541+0000 7f605dd03640 1 -- 172.21.15.96:0/1457071180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540094d0 con 0x7f6058153890 2023-12-01T23:46:15.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.543+0000 7f605dd03640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f604800e870 tx=0x7f604800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:15.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.547+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480094f0 con 0x7f6058153890 2023-12-01T23:46:15.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.547+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800c940 con 0x7f6058153890 2023-12-01T23:46:15.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.547+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800ccf0 con 0x7f6058153890 2023-12-01T23:46:15.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.547+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058154330 con 0x7f6058153890 2023-12-01T23:46:15.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.547+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60581f1330 con 0x7f6058153890 2023-12-01T23:46:15.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.548+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6058067500 con 0x7f6058153890 2023-12-01T23:46:15.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.567+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6048013470 con 0x7f6058153890 2023-12-01T23:46:15.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.567+0000 7f604effd640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:15.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.567+0000 7f605e504640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:15.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.568+0000 7f605e504640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 0x7f603c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6054036000 tx=0x7f6054008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:15.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.572+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6048058c70 con 0x7f6058153890 2023-12-01T23:46:15.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.818+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6048054fb0 con 0x7f6058153890 2023-12-01T23:46:15.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:15.987+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6058074040 con 0x7f6058153890 2023-12-01T23:46:16.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.024+0000 7f604effd640 1 -- 172.21.15.96:0/1457071180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f6048021090 con 0x7f6058153890 2023-12-01T23:46:16.027 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:16.027 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 msgr2=0x7f603c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 0x7f603c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6054036000 tx=0x7f6054008030 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 msgr2=0x7f6058156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f604800e870 tx=0x7f604800ed30 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 shutdown_connections 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f603c06ae70 0x7f603c06d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058153c70 0x7f60581f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6058153890 0x7f6058156000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 --2- 172.21.15.96:0/1457071180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60580ceef0 0x7f6058156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 >> 172.21.15.96:0/1457071180 conn(0x7f605806ba00 msgr2=0x7f605815ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 shutdown_connections 2023-12-01T23:46:16.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:16.026+0000 7f6060768640 1 -- 172.21.15.96:0/1457071180 wait complete. 2023-12-01T23:46:17.040 INFO:tasks.ceph:Scrubbing osd.0 2023-12-01T23:46:17.041 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:17.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.148+0000 7f3e12939640 1 Processor -- start 2023-12-01T23:46:17.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.148+0000 7f3e12939640 1 -- start start 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.149+0000 7f3e12939640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3e0c15da20 0x7f3e0c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.149+0000 7f3e12939640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.149+0000 7f3e12939640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c0c9510 con 0x7f3e0c0ccef0 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.149+0000 7f3e12939640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c159ad0 con 0x7f3e0c15da20 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.149+0000 7f3e12939640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c159db0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.150+0000 7f3e0b7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f3e0c15da20 0x7f3e0c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.150+0000 7f3e10ed6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.150+0000 7f3e10ed6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:33208/0 (socket says 172.21.15.96:33208) 2023-12-01T23:46:17.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.150+0000 7f3e10ed6640 1 -- 172.21.15.96:0/332009081 learned_addr learned my addr 172.21.15.96:0/332009081 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.153+0000 7f3e10ed6640 1 -- 172.21.15.96:0/332009081 >> v2:172.21.15.96:3300/0 conn(0x7f3e0c15da20 msgr2=0x7f3e0c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.153+0000 7f3e10ed6640 1 --2- 172.21.15.96:0/332009081 >> v2:172.21.15.96:3300/0 conn(0x7f3e0c15da20 0x7f3e0c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.153+0000 7f3e10ed6640 1 -- 172.21.15.96:0/332009081 >> v1:172.21.15.96:6789/0 conn(0x7f3e0c0ccef0 legacy=0x7f3e0c0c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.153+0000 7f3e10ed6640 1 -- 172.21.15.96:0/332009081 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c15a090 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.155+0000 7f3e10ed6640 1 --2- 172.21.15.96:0/332009081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009e50 tx=0x7f3e0402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4952f60c25e49547 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e0affd640 1 -- 172.21.15.96:0/332009081 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0402cb00 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e0affd640 1 -- 172.21.15.96:0/332009081 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0402cc60 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e0affd640 1 -- 172.21.15.96:0/332009081 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040343f0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 -- 172.21.15.96:0/332009081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 msgr2=0x7f3e0c0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 --2- 172.21.15.96:0/332009081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009e50 tx=0x7f3e0402bf60 comp rx=0 tx=0).stop 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 -- 172.21.15.96:0/332009081 shutdown_connections 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 --2- 172.21.15.96:0/332009081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0cd2d0 0x7f3e0c0c9f00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 --2- 172.21.15.96:0/332009081 >> v2:172.21.15.96:3300/0 conn(0x7f3e0c15da20 0x7f3e0c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 -- 172.21.15.96:0/332009081 >> 172.21.15.96:0/332009081 conn(0x7f3e0c060f20 msgr2=0x7f3e0c061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 -- 172.21.15.96:0/332009081 shutdown_connections 2023-12-01T23:46:17.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.159+0000 7f3e12939640 1 -- 172.21.15.96:0/332009081 wait complete. 2023-12-01T23:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 Processor -- start 2023-12-01T23:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 -- start start 2023-12-01T23:46:17.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0ccef0 0x7f3e0c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 0x7f3e0c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e0c15da20 0x7f3e0c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c0c4e40 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c153a50 con 0x7f3e0c15da20 2023-12-01T23:46:17.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.161+0000 7f3e12939640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c153d30 con 0x7f3e0c0ccef0 2023-12-01T23:46:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.162+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 0x7f3e0c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.162+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0ccef0 0x7f3e0c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.162+0000 7f3e0b7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 0x7f3e0c1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40104/0 (socket says 172.21.15.96:40104) 2023-12-01T23:46:17.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.162+0000 7f3e0b7fe640 1 -- 172.21.15.96:0/235087699 learned_addr learned my addr 172.21.15.96:0/235087699 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:17.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.162+0000 7f3e10ed6640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e0c15da20 0x7f3e0c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.166+0000 7f3e0b7fe640 1 -- 172.21.15.96:0/235087699 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0ccef0 msgr2=0x7f3e0c0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.166+0000 7f3e0b7fe640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e0c0ccef0 0x7f3e0c0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.166+0000 7f3e0b7fe640 1 -- 172.21.15.96:0/235087699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e0c15da20 msgr2=0x7f3e0c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.166+0000 7f3e0b7fe640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e0c15da20 0x7f3e0c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.166+0000 7f3e0b7fe640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e04009b30 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.168+0000 7f3e0b7fe640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 0x7f3e0c1544c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000e870 tx=0x7f3e0000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.170+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e000094f0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.170+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c1efc30 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.170+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c0ca2f0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.171+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e0c153bc0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.171+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c153bc0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.171+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00005b90 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.192+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e00005cf0 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.192+0000 7f3e08ff9640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3df806ae70 0x7f3df806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.192+0000 7f3e0bfff640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3df806ae70 0x7f3df806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.193+0000 7f3e0bfff640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3df806ae70 0x7f3df806d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc001780 tx=0x7f3dfc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e00058620 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e08ff9640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7f3df8074650 0x7f3df8076af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3df80771c0 con 0x7f3df8074650 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e00054960 con 0x7f3e0c0cd2d0 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e10ed6640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7f3df8074650 0x7f3df8076af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.195+0000 7f3e10ed6640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7f3df8074650 0x7f3df8076af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.196+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== osd.0 v2:172.21.15.96:6810/904588792 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3df80771c0 con 0x7f3df8074650 2023-12-01T23:46:17.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 --> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e0c15a650 con 0x7f3df8074650 2023-12-01T23:46:17.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e08ff9640 1 -- 172.21.15.96:0/235087699 <== osd.0 v2:172.21.15.96:6810/904588792 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3e0402c9a0 con 0x7f3df8074650 2023-12-01T23:46:17.210 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:17.210 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:17.210 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:17.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7f3df8074650 msgr2=0x7f3df8076af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6810/904588792,v1:172.21.15.96:6813/904588792] conn(0x7f3df8074650 0x7f3df8076af0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3df806ae70 msgr2=0x7f3df806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f3df806ae70 0x7f3df806d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc001780 tx=0x7f3dfc009040 comp rx=0 tx=0).stop 2023-12-01T23:46:17.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 msgr2=0x7f3e0c1544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 --2- 172.21.15.96:0/235087699 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e0c0cd2d0 0x7f3e0c1544c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000e870 tx=0x7f3e0000ed30 comp rx=0 tx=0).stop 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e10ed6640 1 -- 172.21.15.96:0/235087699 reap_dead start 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 shutdown_connections 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 >> 172.21.15.96:0/235087699 conn(0x7f3e0c060f20 msgr2=0x7f3e0c073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 shutdown_connections 2023-12-01T23:46:17.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.209+0000 7f3e12939640 1 -- 172.21.15.96:0/235087699 wait complete. 2023-12-01T23:46:17.221 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-01T23:46:17.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.321+0000 7f18e4a17640 1 Processor -- start 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.321+0000 7f18e4a17640 1 -- start start 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.322+0000 7f18e4a17640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f18e014fd70 0x7f18e0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.322+0000 7f18e4a17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.322+0000 7f18e4a17640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e0071420 con 0x7f18e00c7eb0 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.322+0000 7f18e4a17640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0155b20 con 0x7f18e014fd70 2023-12-01T23:46:17.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.322+0000 7f18e4a17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01592d0 con 0x7f18e0071c40 2023-12-01T23:46:17.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.323+0000 7f18de59c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f18e014fd70 0x7f18e0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.323+0000 7f18ddd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.323+0000 7f18ded9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f18e00c7eb0 0x7f18e0159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:57132/0 (socket says 172.21.15.96:57132) 2023-12-01T23:46:17.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.323+0000 7f18ded9d640 1 -- 172.21.15.96:0/3516117946 learned_addr learned my addr 172.21.15.96:0/3516117946 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:17.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.326+0000 7f18de59c640 1 -- 172.21.15.96:0/3516117946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 msgr2=0x7f18e00c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:17.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.326+0000 7f18de59c640 1 --2- 172.21.15.96:0/3516117946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.326+0000 7f18de59c640 1 -- 172.21.15.96:0/3516117946 >> v1:172.21.15.102:6789/0 conn(0x7f18e00c7eb0 legacy=0x7f18e0159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.326+0000 7f18de59c640 1 -- 172.21.15.96:0/3516117946 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00c65f0 con 0x7f18e014fd70 2023-12-01T23:46:17.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.326+0000 7f18dd59a640 1 -- 172.21.15.96:0/3516117946 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179521133 0 0) 0x7f18d8001110 con 0x7f18e00c7eb0 2023-12-01T23:46:17.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.328+0000 7f18de59c640 1 --2- 172.21.15.96:0/3516117946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e0070ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18d000aea0 tx=0x7f18d002ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5315b3221ef189a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.331+0000 7f18dd59a640 1 -- 172.21.15.96:0/3516117946 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d002da20 con 0x7f18e014fd70 2023-12-01T23:46:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.331+0000 7f18dd59a640 1 -- 172.21.15.96:0/3516117946 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d002db80 con 0x7f18e014fd70 2023-12-01T23:46:17.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.331+0000 7f18dd59a640 1 -- 172.21.15.96:0/3516117946 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000a2e0 con 0x7f18e014fd70 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 -- 172.21.15.96:0/3516117946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 msgr2=0x7f18e0070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 --2- 172.21.15.96:0/3516117946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e0070ee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f18d000aea0 tx=0x7f18d002ce80 comp rx=0 tx=0).stop 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 -- 172.21.15.96:0/3516117946 shutdown_connections 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 --2- 172.21.15.96:0/3516117946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 --2- 172.21.15.96:0/3516117946 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e0070ee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 -- 172.21.15.96:0/3516117946 >> 172.21.15.96:0/3516117946 conn(0x7f18e006cd60 msgr2=0x7f18e006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 -- 172.21.15.96:0/3516117946 shutdown_connections 2023-12-01T23:46:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.332+0000 7f18e4a17640 1 -- 172.21.15.96:0/3516117946 wait complete. 2023-12-01T23:46:17.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 Processor -- start 2023-12-01T23:46:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 -- start start 2023-12-01T23:46:17.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18e00c7eb0 0x7f18e00c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c2cc0 con 0x7f18e014fd70 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c3c80 con 0x7f18e00c7eb0 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.334+0000 7f18e4a17640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00caa10 con 0x7f18e0071c40 2023-12-01T23:46:17.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.335+0000 7f18ded9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.335+0000 7f18ddd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18e00c7eb0 0x7f18e00c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.335+0000 7f18de59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.335+0000 7f18ded9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40122/0 (socket says 172.21.15.96:40122) 2023-12-01T23:46:17.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.335+0000 7f18ded9d640 1 -- 172.21.15.96:0/2520783281 learned_addr learned my addr 172.21.15.96:0/2520783281 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.339+0000 7f18ded9d640 1 -- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 msgr2=0x7f18e00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.339+0000 7f18ded9d640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.339+0000 7f18ded9d640 1 -- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18e00c7eb0 msgr2=0x7f18e00c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.339+0000 7f18ded9d640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18e00c7eb0 0x7f18e00c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.339+0000 7f18ded9d640 1 -- 172.21.15.96:0/2520783281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d000ab80 con 0x7f18e014fd70 2023-12-01T23:46:17.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.341+0000 7f18ded9d640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c650 tx=0x7f18d800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.344+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8007370 con 0x7f18e014fd70 2023-12-01T23:46:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.344+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d80074f0 con 0x7f18e014fd70 2023-12-01T23:46:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.344+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8001970 con 0x7f18e014fd70 2023-12-01T23:46:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.344+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00cacf0 con 0x7f18e014fd70 2023-12-01T23:46:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.344+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00c3220 con 0x7f18e014fd70 2023-12-01T23:46:17.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.345+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00c3440 con 0x7f18e014fd70 2023-12-01T23:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.584+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f18d8001ad0 con 0x7f18e014fd70 2023-12-01T23:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.584+0000 7f18ceffd640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 0x7f18c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.585+0000 7f18de59c640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 0x7f18c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.585+0000 7f18de59c640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 0x7f18c006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18d0036000 tx=0x7f18d0031000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.598+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18d805adb0 con 0x7f18e014fd70 2023-12-01T23:46:17.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.598+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18d80570f0 con 0x7f18e014fd70 2023-12-01T23:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.792+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e00c6e90 con 0x7f18c006ae40 2023-12-01T23:46:17.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.793+0000 7f18ceffd640 1 -- 172.21.15.96:0/2520783281 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f18d002d820 con 0x7f18c006ae40 2023-12-01T23:46:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 msgr2=0x7f18c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 0x7f18c006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18d0036000 tx=0x7f18d0031000 comp rx=0 tx=0).stop 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 msgr2=0x7f18e01ed550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18d800c650 tx=0x7f18d800cb10 comp rx=0 tx=0).stop 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 shutdown_connections 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f18c006ae40 0x7f18c006d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18e014fd70 0x7f18e01ed550 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18e00c7eb0 0x7f18e00c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 --2- 172.21.15.96:0/2520783281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18e0071c40 0x7f18e00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 >> 172.21.15.96:0/2520783281 conn(0x7f18e006cd60 msgr2=0x7f18e0155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 shutdown_connections 2023-12-01T23:46:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.795+0000 7f18e4a17640 1 -- 172.21.15.96:0/2520783281 wait complete. 2023-12-01T23:46:17.807 INFO:tasks.ceph:Scrubbing osd.1 2023-12-01T23:46:17.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:17.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.910+0000 7f9ef296e640 1 Processor -- start 2023-12-01T23:46:17.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.910+0000 7f9ef296e640 1 -- start start 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.911+0000 7f9ef296e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9eec1515b0 0x7f9eec060f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.911+0000 7f9ef296e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec1578d0 con 0x7f9eec151990 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.911+0000 7f9ef296e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eec157bb0 con 0x7f9eec0c5e60 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.911+0000 7f9ef296e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eec0b7100 con 0x7f9eec1515b0 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.912+0000 7f9eeb7fe640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f9eec151990 0x7f9eec0c4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47088/0 (socket says 172.21.15.96:47088) 2023-12-01T23:46:17.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.912+0000 7f9eeb7fe640 1 -- 172.21.15.96:0/1155955464 learned_addr learned my addr 172.21.15.96:0/1155955464 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:17.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.912+0000 7f9eebfff640 1 --2- 172.21.15.96:0/1155955464 >> v2:172.21.15.102:3300/0 conn(0x7f9eec1515b0 0x7f9eec060f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.914+0000 7f9eeaffd640 1 -- 172.21.15.96:0/1155955464 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116050287 0 0) 0x7f9eec1578d0 con 0x7f9eec151990 2023-12-01T23:46:17.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.914+0000 7f9eeaffd640 1 -- 172.21.15.96:0/1155955464 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed4003520 con 0x7f9eec151990 2023-12-01T23:46:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.917+0000 7f9eebfff640 1 -- 172.21.15.96:0/1155955464 >> v1:172.21.15.102:6789/0 conn(0x7f9eec0c5e60 legacy=0x7f9eec06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.917+0000 7f9eebfff640 1 -- 172.21.15.96:0/1155955464 >> v1:172.21.15.96:6789/0 conn(0x7f9eec151990 legacy=0x7f9eec0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.917+0000 7f9eebfff640 1 -- 172.21.15.96:0/1155955464 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec157e90 con 0x7f9eec1515b0 2023-12-01T23:46:17.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.921+0000 7f9eebfff640 1 --2- 172.21.15.96:0/1155955464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec1515b0 0x7f9eec060f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0097a0 tx=0x7f9edc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ca390eefa7397b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9eeaffd640 1 -- 172.21.15.96:0/1155955464 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc02f810 con 0x7f9eec1515b0 2023-12-01T23:46:17.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9eeaffd640 1 -- 172.21.15.96:0/1155955464 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc02f970 con 0x7f9eec1515b0 2023-12-01T23:46:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9eeaffd640 1 -- 172.21.15.96:0/1155955464 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc02fd00 con 0x7f9eec1515b0 2023-12-01T23:46:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 -- 172.21.15.96:0/1155955464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec1515b0 msgr2=0x7f9eec060f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 --2- 172.21.15.96:0/1155955464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec1515b0 0x7f9eec060f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0097a0 tx=0x7f9edc02b9f0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 -- 172.21.15.96:0/1155955464 shutdown_connections 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 --2- 172.21.15.96:0/1155955464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec1515b0 0x7f9eec060f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 -- 172.21.15.96:0/1155955464 >> 172.21.15.96:0/1155955464 conn(0x7f9eec0c7f60 msgr2=0x7f9eec0c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 -- 172.21.15.96:0/1155955464 shutdown_connections 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.926+0000 7f9ef296e640 1 -- 172.21.15.96:0/1155955464 wait complete. 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.928+0000 7f9ef296e640 1 Processor -- start 2023-12-01T23:46:17.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.928+0000 7f9ef296e640 1 -- start start 2023-12-01T23:46:17.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.928+0000 7f9ef296e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec0c5e60 0x7f9eec1ee120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.928+0000 7f9ef296e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 0x7f9eec14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.928+0000 7f9ef296e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eec151990 0x7f9eec0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9ef296e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec148780 con 0x7f9eec1515b0 2023-12-01T23:46:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9ef296e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec148a40 con 0x7f9eec0c5e60 2023-12-01T23:46:17.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9ef296e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec148d20 con 0x7f9eec151990 2023-12-01T23:46:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 0x7f9eec14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec0c5e60 0x7f9eec1ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9ef0f0b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eec151990 0x7f9eec0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9eeb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 0x7f9eec14b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40126/0 (socket says 172.21.15.96:40126) 2023-12-01T23:46:17.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.929+0000 7f9eeb7fe640 1 -- 172.21.15.96:0/660605688 learned_addr learned my addr 172.21.15.96:0/660605688 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:17.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.933+0000 7f9eeb7fe640 1 -- 172.21.15.96:0/660605688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eec151990 msgr2=0x7f9eec0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.933+0000 7f9eeb7fe640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9eec151990 0x7f9eec0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.933+0000 7f9eeb7fe640 1 -- 172.21.15.96:0/660605688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec0c5e60 msgr2=0x7f9eec1ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.933+0000 7f9eeb7fe640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eec0c5e60 0x7f9eec1ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.933+0000 7f9eeb7fe640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009400 con 0x7f9eec1515b0 2023-12-01T23:46:17.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.935+0000 7f9eeb7fe640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 0x7f9eec14b850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c410 tx=0x7f9ee000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.938+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0005ce0 con 0x7f9eec1515b0 2023-12-01T23:46:17.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.938+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee0005e40 con 0x7f9eec1515b0 2023-12-01T23:46:17.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.938+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eec149000 con 0x7f9eec1515b0 2023-12-01T23:46:17.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.939+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00072f0 con 0x7f9eec1515b0 2023-12-01T23:46:17.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.939+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1edc00 con 0x7f9eec1515b0 2023-12-01T23:46:17.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.939+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9eec158450 con 0x7f9eec1515b0 2023-12-01T23:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.959+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ee0007510 con 0x7f9eec1515b0 2023-12-01T23:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.959+0000 7f9ee8ff9640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9ed806ae40 0x7f9ed806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.959+0000 7f9eebfff640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9ed806ae40 0x7f9ed806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.960+0000 7f9eebfff640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9ed806ae40 0x7f9ed806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036000 tx=0x7f9edc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.963+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9ee0058230 con 0x7f9eec1515b0 2023-12-01T23:46:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.963+0000 7f9ee8ff9640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9ed80746a0 0x7f9ed8076b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.963+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ed8077210 con 0x7f9ed80746a0 2023-12-01T23:46:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.963+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee0054570 con 0x7f9eec1515b0 2023-12-01T23:46:17.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.963+0000 7f9ef0f0b640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9ed80746a0 0x7f9ed8076b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:17.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.964+0000 7f9ef0f0b640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9ed80746a0 0x7f9ed8076b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:17.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.964+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== osd.1 v2:172.21.15.96:6802/3966350993 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9ed8077210 con 0x7f9ed80746a0 2023-12-01T23:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.988+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 --> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9eec067570 con 0x7f9ed80746a0 2023-12-01T23:46:17.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.988+0000 7f9ee8ff9640 1 -- 172.21.15.96:0/660605688 <== osd.1 v2:172.21.15.96:6802/3966350993 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9eec067570 con 0x7f9ed80746a0 2023-12-01T23:46:17.990 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:17.990 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:17.990 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9ed80746a0 msgr2=0x7f9ed8076b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6802/3966350993,v1:172.21.15.96:6803/3966350993] conn(0x7f9ed80746a0 0x7f9ed8076b40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9ed806ae40 msgr2=0x7f9ed806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f9ed806ae40 0x7f9ed806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9edc036000 tx=0x7f9edc008030 comp rx=0 tx=0).stop 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 msgr2=0x7f9eec14b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 --2- 172.21.15.96:0/660605688 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eec1515b0 0x7f9eec14b850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000c410 tx=0x7f9ee000c8d0 comp rx=0 tx=0).stop 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef0f0b640 1 -- 172.21.15.96:0/660605688 reap_dead start 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 shutdown_connections 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 >> 172.21.15.96:0/660605688 conn(0x7f9eec0c7f60 msgr2=0x7f9eec147180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 shutdown_connections 2023-12-01T23:46:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:17.989+0000 7f9ef296e640 1 -- 172.21.15.96:0/660605688 wait complete. 2023-12-01T23:46:18.001 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-01T23:46:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.101+0000 7f871bac9640 1 Processor -- start 2023-12-01T23:46:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.101+0000 7f871bac9640 1 -- start start 2023-12-01T23:46:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.101+0000 7f871bac9640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8714153be0 0x7f8714159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f871bac9640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8714153fc0 con 0x7f871406fa00 2023-12-01T23:46:18.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f871bac9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871406b7b0 con 0x7f87140c5e60 2023-12-01T23:46:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f871bac9640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140c3340 con 0x7f8714153be0 2023-12-01T23:46:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f8719865640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f8714153be0 0x7f8714159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f871a066640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f87140c5e60 0x7f87141641b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:57150/0 (socket says 172.21.15.96:57150) 2023-12-01T23:46:18.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.102+0000 7f871a066640 1 -- 172.21.15.96:0/337708203 learned_addr learned my addr 172.21.15.96:0/337708203 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:18.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.105+0000 7f8718863640 1 -- 172.21.15.96:0/337708203 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247366279 0 0) 0x7f871406b7b0 con 0x7f87140c5e60 2023-12-01T23:46:18.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.105+0000 7f8718863640 1 -- 172.21.15.96:0/337708203 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8700003520 con 0x7f87140c5e60 2023-12-01T23:46:18.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.106+0000 7f8719865640 1 -- 172.21.15.96:0/337708203 >> v1:172.21.15.102:6789/0 conn(0x7f87140c5e60 legacy=0x7f87141641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.106+0000 7f8719865640 1 -- 172.21.15.96:0/337708203 >> v1:172.21.15.96:6789/0 conn(0x7f871406fa00 legacy=0x7f87140c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.106+0000 7f8719865640 1 -- 172.21.15.96:0/337708203 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871406ba90 con 0x7f8714153be0 2023-12-01T23:46:18.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.110+0000 7f8719865640 1 --2- 172.21.15.96:0/337708203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714153be0 0x7f8714159890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7777d606de891b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f8718863640 1 -- 172.21.15.96:0/337708203 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710030610 con 0x7f8714153be0 2023-12-01T23:46:18.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f8718863640 1 -- 172.21.15.96:0/337708203 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710030770 con 0x7f8714153be0 2023-12-01T23:46:18.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f8718863640 1 -- 172.21.15.96:0/337708203 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710030b00 con 0x7f8714153be0 2023-12-01T23:46:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f871bac9640 1 -- 172.21.15.96:0/337708203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714153be0 msgr2=0x7f8714159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f871bac9640 1 --2- 172.21.15.96:0/337708203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714153be0 0x7f8714159890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002b960 comp rx=0 tx=0).stop 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f871bac9640 1 -- 172.21.15.96:0/337708203 shutdown_connections 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f871bac9640 1 --2- 172.21.15.96:0/337708203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714153be0 0x7f8714159890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.114+0000 7f871bac9640 1 -- 172.21.15.96:0/337708203 >> 172.21.15.96:0/337708203 conn(0x7f87140c7f60 msgr2=0x7f87140c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.115+0000 7f871bac9640 1 -- 172.21.15.96:0/337708203 shutdown_connections 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.115+0000 7f871bac9640 1 -- 172.21.15.96:0/337708203 wait complete. 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 Processor -- start 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 -- start start 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87140c5e60 0x7f87141f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8714153be0 0x7f8714144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141f0250 con 0x7f871406fa00 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141f36e0 con 0x7f87140c5e60 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.116+0000 7f871bac9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87141ef360 con 0x7f8714153be0 2023-12-01T23:46:18.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.117+0000 7f8719865640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.117+0000 7f871a066640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8714153be0 0x7f8714144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.117+0000 7f8719865640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40140/0 (socket says 172.21.15.96:40140) 2023-12-01T23:46:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.117+0000 7f8719865640 1 -- 172.21.15.96:0/3264929086 learned_addr learned my addr 172.21.15.96:0/3264929086 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:18.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.117+0000 7f8719064640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87140c5e60 0x7f87141f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.121+0000 7f8719865640 1 -- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8714153be0 msgr2=0x7f8714144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.121+0000 7f8719865640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8714153be0 0x7f8714144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.121+0000 7f8719865640 1 -- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87140c5e60 msgr2=0x7f87141f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.121+0000 7f8719865640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87140c5e60 0x7f87141f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.121+0000 7f8719865640 1 -- 172.21.15.96:0/3264929086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009400 con 0x7f871406fa00 2023-12-01T23:46:18.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.125+0000 7f8719865640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8710009890 tx=0x7f87100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.129+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871003e070 con 0x7f871406fa00 2023-12-01T23:46:18.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.129+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710030e10 con 0x7f871406fa00 2023-12-01T23:46:18.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.129+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710039c60 con 0x7f871406fa00 2023-12-01T23:46:18.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.129+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87141ef640 con 0x7f871406fa00 2023-12-01T23:46:18.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.129+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87141efc00 con 0x7f871406fa00 2023-12-01T23:46:18.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.130+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714067500 con 0x7f871406fa00 2023-12-01T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.371+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8710055430 con 0x7f871406fa00 2023-12-01T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.371+0000 7f870a7fc640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 0x7f86f806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.371+0000 7f8719064640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 0x7f86f806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.371+0000 7f8719064640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 0x7f86f806d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87140cae80 tx=0x7f8704009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.383+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f871007b150 con 0x7f871406fa00 2023-12-01T23:46:18.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.384+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8710077490 con 0x7f871406fa00 2023-12-01T23:46:18.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.567+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f871406ef20 con 0x7f86f806ae90 2023-12-01T23:46:18.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.567+0000 7f870a7fc640 1 -- 172.21.15.96:0/3264929086 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f87040014c0 con 0x7f86f806ae90 2023-12-01T23:46:18.569 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2023-12-01T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 msgr2=0x7f86f806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 0x7f86f806d350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87140cae80 tx=0x7f8704009040 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 msgr2=0x7f871414cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8710009890 tx=0x7f87100046c0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 shutdown_connections 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f86f806ae90 0x7f86f806d350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8714153be0 0x7f8714144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87140c5e60 0x7f87141f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 --2- 172.21.15.96:0/3264929086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f871406fa00 0x7f871414cd50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 >> 172.21.15.96:0/3264929086 conn(0x7f87140c7f60 msgr2=0x7f8714151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 shutdown_connections 2023-12-01T23:46:18.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.569+0000 7f871bac9640 1 -- 172.21.15.96:0/3264929086 wait complete. 2023-12-01T23:46:18.581 INFO:tasks.ceph:Scrubbing osd.2 2023-12-01T23:46:18.581 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.688+0000 7f03c9ee7640 1 Processor -- start 2023-12-01T23:46:18.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.688+0000 7f03c9ee7640 1 -- start start 2023-12-01T23:46:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.689+0000 7f03c9ee7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03c40c8790 0x7f03c40c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.689+0000 7f03c9ee7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 0x7f03c40ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.689+0000 7f03c9ee7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c4157e30 con 0x7f03c41515f0 2023-12-01T23:46:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.689+0000 7f03c9ee7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40b2460 con 0x7f03c40c8240 2023-12-01T23:46:18.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.689+0000 7f03c9ee7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40c3400 con 0x7f03c40c8790 2023-12-01T23:46:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.690+0000 7f03c3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 0x7f03c40ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.690+0000 7f03c3fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 0x7f03c40ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40156/0 (socket says 172.21.15.96:40156) 2023-12-01T23:46:18.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.690+0000 7f03c3fff640 1 -- 172.21.15.96:0/2817977579 learned_addr learned my addr 172.21.15.96:0/2817977579 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:18.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.691+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2817977579 >> v2:172.21.15.102:3300/0 conn(0x7f03c40c8790 0x7f03c40c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.694+0000 7f03c2ffd640 1 -- 172.21.15.96:0/2817977579 >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 msgr2=0x7f03c40ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.694+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2817977579 >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 0x7f03c40ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.694+0000 7f03c2ffd640 1 -- 172.21.15.96:0/2817977579 >> v1:172.21.15.96:6789/0 conn(0x7f03c41515f0 legacy=0x7f03c40c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.694+0000 7f03c2ffd640 1 -- 172.21.15.96:0/2817977579 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4158360 con 0x7f03c40c8790 2023-12-01T23:46:18.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.696+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2817977579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c40c8790 0x7f03c40c7840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3695800347b986cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.700+0000 7f03c27fc640 1 -- 172.21.15.96:0/2817977579 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8031830 con 0x7f03c40c8790 2023-12-01T23:46:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.700+0000 7f03c27fc640 1 -- 172.21.15.96:0/2817977579 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b8031990 con 0x7f03c40c8790 2023-12-01T23:46:18.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.700+0000 7f03c27fc640 1 -- 172.21.15.96:0/2817977579 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b8031d20 con 0x7f03c40c8790 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2817977579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c40c8790 msgr2=0x7f03c40c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2817977579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c40c8790 0x7f03c40c7840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b802b8d0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2817977579 shutdown_connections 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2817977579 >> v2:172.21.15.96:3300/0 conn(0x7f03c40c8240 0x7f03c40ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2817977579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c40c8790 0x7f03c40c7840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2817977579 >> 172.21.15.96:0/2817977579 conn(0x7f03c4060f20 msgr2=0x7f03c4061330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2817977579 shutdown_connections 2023-12-01T23:46:18.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.701+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2817977579 wait complete. 2023-12-01T23:46:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.702+0000 7f03c9ee7640 1 Processor -- start 2023-12-01T23:46:18.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.702+0000 7f03c9ee7640 1 -- start start 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03c40c8240 0x7f03c41e2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03c40c8790 0x7f03c41e2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c41515f0 0x7f03c41e18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4144440 con 0x7f03c40c8790 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4150190 con 0x7f03c41515f0 2023-12-01T23:46:18.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.703+0000 7f03c9ee7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c406c490 con 0x7f03c40c8240 2023-12-01T23:46:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.704+0000 7f03c37fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03c40c8240 0x7f03c41e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.704+0000 7f03c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c41515f0 0x7f03c41e18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.704+0000 7f03c3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c41515f0 0x7f03c41e18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:36970/0 (socket says 172.21.15.96:36970) 2023-12-01T23:46:18.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.704+0000 7f03c3fff640 1 -- 172.21.15.96:0/2163512597 learned_addr learned my addr 172.21.15.96:0/2163512597 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:18.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.706+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03c40c8790 0x7f03c41e2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.708+0000 7f03c37fe640 1 -- 172.21.15.96:0/2163512597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c41515f0 msgr2=0x7f03c41e18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.708+0000 7f03c37fe640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03c41515f0 0x7f03c41e18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.708+0000 7f03c37fe640 1 -- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03c40c8790 msgr2=0x7f03c41e2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.708+0000 7f03c37fe640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f03c40c8790 0x7f03c41e2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.708+0000 7f03c37fe640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8009400 con 0x7f03c40c8240 2023-12-01T23:46:18.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.711+0000 7f03c37fe640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03c40c8240 0x7f03c41e2800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c3c0 tx=0x7f03b400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.714+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40052d0 con 0x7f03c40c8240 2023-12-01T23:46:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.714+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b4005450 con 0x7f03c40c8240 2023-12-01T23:46:18.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.714+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4007260 con 0x7f03c40c8240 2023-12-01T23:46:18.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.714+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c4150540 con 0x7f03c40c8240 2023-12-01T23:46:18.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.714+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c406ca30 con 0x7f03c40c8240 2023-12-01T23:46:18.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.715+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03c40c24f0 con 0x7f03c40c8240 2023-12-01T23:46:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.735+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03b40073c0 con 0x7f03c40c8240 2023-12-01T23:46:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.735+0000 7f03abfff640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f03b006ae90 0x7f03b006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.735+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f03b006ae90 0x7f03b006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.736+0000 7f03c2ffd640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f03b006ae90 0x7f03b006d350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.738+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03b4058130 con 0x7f03c40c8240 2023-12-01T23:46:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.738+0000 7f03abfff640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7f03b00746f0 0x7f03b0076b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.738+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03b0077260 con 0x7f03b00746f0 2023-12-01T23:46:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.738+0000 7f03c3fff640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7f03b00746f0 0x7f03b0076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.739+0000 7f03c3fff640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7f03b00746f0 0x7f03b0076b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.739+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== osd.2 v2:172.21.15.96:6811/3916123530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f03b0077260 con 0x7f03b00746f0 2023-12-01T23:46:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.753+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 --> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f03c40c2210 con 0x7f03b00746f0 2023-12-01T23:46:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03abfff640 1 -- 172.21.15.96:0/2163512597 <== osd.2 v2:172.21.15.96:6811/3916123530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f03bc00f040 con 0x7f03b00746f0 2023-12-01T23:46:18.755 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:18.755 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:18.755 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7f03b00746f0 msgr2=0x7f03b0076b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6811/3916123530,v1:172.21.15.96:6812/3916123530] conn(0x7f03b00746f0 0x7f03b0076b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f03b006ae90 msgr2=0x7f03b006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f03b006ae90 0x7f03b006d350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f03b80097a0 tx=0x7f03b8008030 comp rx=0 tx=0).stop 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03c40c8240 msgr2=0x7f03c41e2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 --2- 172.21.15.96:0/2163512597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03c40c8240 0x7f03c41e2800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c3c0 tx=0x7f03b400c880 comp rx=0 tx=0).stop 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c3fff640 1 -- 172.21.15.96:0/2163512597 reap_dead start 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 shutdown_connections 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 >> 172.21.15.96:0/2163512597 conn(0x7f03c4060f20 msgr2=0x7f03c4156640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 shutdown_connections 2023-12-01T23:46:18.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.754+0000 7f03c9ee7640 1 -- 172.21.15.96:0/2163512597 wait complete. 2023-12-01T23:46:18.766 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-01T23:46:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.866+0000 7fd23d1a5640 1 Processor -- start 2023-12-01T23:46:18.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.866+0000 7fd23d1a5640 1 -- start start 2023-12-01T23:46:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.867+0000 7fd23d1a5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 0x7fd2380c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.867+0000 7fd23d1a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 0x7fd2381533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.867+0000 7fd23d1a5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23815cc90 con 0x7fd2380ca1b0 2023-12-01T23:46:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.867+0000 7fd23d1a5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2381596a0 con 0x7fd2380c9dd0 2023-12-01T23:46:18.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.867+0000 7fd23d1a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380c7c40 con 0x7fd23815d830 2023-12-01T23:46:18.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.868+0000 7fd23659c640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fd2380ca1b0 0x7fd23815d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47104/0 (socket says 172.21.15.96:47104) 2023-12-01T23:46:18.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.868+0000 7fd23659c640 1 -- 172.21.15.96:0/4096982544 learned_addr learned my addr 172.21.15.96:0/4096982544 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:18.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.868+0000 7fd23759e640 1 --2- 172.21.15.96:0/4096982544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 0x7fd2381533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.868+0000 7fd236d9d640 1 --2- 172.21.15.96:0/4096982544 >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 0x7fd2380c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd235d9b640 1 -- 172.21.15.96:0/4096982544 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254047408 0 0) 0x7fd23815cc90 con 0x7fd2380ca1b0 2023-12-01T23:46:18.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd235d9b640 1 -- 172.21.15.96:0/4096982544 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd220003520 con 0x7fd2380ca1b0 2023-12-01T23:46:18.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd23759e640 1 -- 172.21.15.96:0/4096982544 >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 msgr2=0x7fd2380c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:18.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd23759e640 1 --2- 172.21.15.96:0/4096982544 >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 0x7fd2380c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd23759e640 1 -- 172.21.15.96:0/4096982544 >> v1:172.21.15.96:6789/0 conn(0x7fd2380ca1b0 legacy=0x7fd23815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd23759e640 1 -- 172.21.15.96:0/4096982544 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2381598b0 con 0x7fd23815d830 2023-12-01T23:46:18.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.870+0000 7fd236d9d640 1 --2- 172.21.15.96:0/4096982544 >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 0x7fd2380c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:18.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.873+0000 7fd23759e640 1 --2- 172.21.15.96:0/4096982544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 0x7fd2381533e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097a0 tx=0x7fd23002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb102c6739694e06 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.876+0000 7fd235d9b640 1 -- 172.21.15.96:0/4096982544 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230030610 con 0x7fd23815d830 2023-12-01T23:46:18.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.876+0000 7fd235d9b640 1 -- 172.21.15.96:0/4096982544 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230030770 con 0x7fd23815d830 2023-12-01T23:46:18.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.876+0000 7fd235d9b640 1 -- 172.21.15.96:0/4096982544 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230030b00 con 0x7fd23815d830 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4096982544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 msgr2=0x7fd2381533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4096982544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 0x7fd2381533e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097a0 tx=0x7fd23002b960 comp rx=0 tx=0).stop 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4096982544 shutdown_connections 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4096982544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd23815d830 0x7fd2381533e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4096982544 >> v2:172.21.15.102:3300/0 conn(0x7fd2380c9dd0 0x7fd2380c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4096982544 >> 172.21.15.96:0/4096982544 conn(0x7fd238061100 msgr2=0x7fd2380614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4096982544 shutdown_connections 2023-12-01T23:46:18.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.877+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4096982544 wait complete. 2023-12-01T23:46:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.878+0000 7fd23d1a5640 1 Processor -- start 2023-12-01T23:46:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.878+0000 7fd23d1a5640 1 -- start start 2023-12-01T23:46:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2380c9dd0 0x7fd2381528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 0x7fd2381543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 0x7fd23815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238155140 con 0x7fd2380c9dd0 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd238152e10 con 0x7fd23815d830 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.879+0000 7fd23d1a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380ad670 con 0x7fd2380ca1b0 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.880+0000 7fd23659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 0x7fd2381543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.880+0000 7fd23759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 0x7fd23815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.880+0000 7fd236d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2380c9dd0 0x7fd2381528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:18.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.880+0000 7fd23659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 0x7fd2381543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:33300/0 (socket says 172.21.15.96:33300) 2023-12-01T23:46:18.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.880+0000 7fd23659c640 1 -- 172.21.15.96:0/4122590783 learned_addr learned my addr 172.21.15.96:0/4122590783 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:18.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.883+0000 7fd23759e640 1 -- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 msgr2=0x7fd2381543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.883+0000 7fd23759e640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 0x7fd2381543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.883+0000 7fd23759e640 1 -- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2380c9dd0 msgr2=0x7fd2381528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:18.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.883+0000 7fd23759e640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2380c9dd0 0x7fd2381528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:18.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.883+0000 7fd23759e640 1 -- 172.21.15.96:0/4122590783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228009a70 con 0x7fd23815d830 2023-12-01T23:46:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.886+0000 7fd23759e640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 0x7fd23815c370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd230033000 tx=0x7fd2300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.890+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23003e070 con 0x7fd23815d830 2023-12-01T23:46:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.890+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230039720 con 0x7fd23815d830 2023-12-01T23:46:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.890+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230039af0 con 0x7fd23815d830 2023-12-01T23:46:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.891+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd230009400 con 0x7fd23815d830 2023-12-01T23:46:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.891+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd238156600 con 0x7fd23815d830 2023-12-01T23:46:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:18.891+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd238156790 con 0x7fd23815d830 2023-12-01T23:46:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.133+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd230039c50 con 0x7fd23815d830 2023-12-01T23:46:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.133+0000 7fd21f7fe640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 0x7fd22406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.133+0000 7fd236d9d640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 0x7fd22406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.134+0000 7fd236d9d640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 0x7fd22406d350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd228009fd0 tx=0x7fd22800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.136+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd23007a4c0 con 0x7fd23815d830 2023-12-01T23:46:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.146+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd230076800 con 0x7fd23815d830 2023-12-01T23:46:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.313+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd238153600 con 0x7fd22406ae90 2023-12-01T23:46:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.313+0000 7fd21f7fe640 1 -- 172.21.15.96:0/4122590783 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd238153600 con 0x7fd22406ae90 2023-12-01T23:46:19.314 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2023-12-01T23:46:19.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 msgr2=0x7fd22406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 0x7fd22406d350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd228009fd0 tx=0x7fd22800b040 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 msgr2=0x7fd23815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 0x7fd23815c370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd230033000 tx=0x7fd2300046c0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 shutdown_connections 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd22406ae90 0x7fd22406d350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd23815d830 0x7fd23815c370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2380ca1b0 0x7fd2381543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 --2- 172.21.15.96:0/4122590783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2380c9dd0 0x7fd2381528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 >> 172.21.15.96:0/4122590783 conn(0x7fd238061100 msgr2=0x7fd2381583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.315+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 shutdown_connections 2023-12-01T23:46:19.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.316+0000 7fd23d1a5640 1 -- 172.21.15.96:0/4122590783 wait complete. 2023-12-01T23:46:19.327 INFO:tasks.ceph:Scrubbing osd.3 2023-12-01T23:46:19.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.430+0000 7f77cc62b640 1 Processor -- start 2023-12-01T23:46:19.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.430+0000 7f77cc62b640 1 -- start start 2023-12-01T23:46:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.431+0000 7f77cc62b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f77c406c7f0 0x7f77c406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.431+0000 7f77cc62b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c406bef0 0x7f77c40c4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.431+0000 7f77cc62b640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c415cdb0 con 0x7f77c4153ba0 2023-12-01T23:46:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.431+0000 7f77cc62b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40b2a60 con 0x7f77c406c7f0 2023-12-01T23:46:19.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.431+0000 7f77cc62b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c415d090 con 0x7f77c406bef0 2023-12-01T23:46:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.432+0000 7f77ca3c7640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f77c4153ba0 0x7f77c415a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47106/0 (socket says 172.21.15.96:47106) 2023-12-01T23:46:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.432+0000 7f77ca3c7640 1 -- 172.21.15.96:0/2957361905 learned_addr learned my addr 172.21.15.96:0/2957361905 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.432+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/2957361905 >> v2:172.21.15.102:3300/0 conn(0x7f77c406c7f0 0x7f77c406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.432+0000 7f77cabc8640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c406bef0 0x7f77c40c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.434+0000 7f77c93c5640 1 -- 172.21.15.96:0/2957361905 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934938987 0 0) 0x7f77c415cdb0 con 0x7f77c4153ba0 2023-12-01T23:46:19.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.434+0000 7f77c93c5640 1 -- 172.21.15.96:0/2957361905 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b0003520 con 0x7f77c4153ba0 2023-12-01T23:46:19.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.435+0000 7f77c9bc6640 1 -- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c406bef0 msgr2=0x7f77c40c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:19.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.435+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c406bef0 0x7f77c40c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.435+0000 7f77c9bc6640 1 -- 172.21.15.96:0/2957361905 >> v1:172.21.15.96:6789/0 conn(0x7f77c4153ba0 legacy=0x7f77c415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.435+0000 7f77c9bc6640 1 -- 172.21.15.96:0/2957361905 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c415d370 con 0x7f77c406c7f0 2023-12-01T23:46:19.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.436+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406c7f0 0x7f77c406b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77b40097a0 tx=0x7f77b402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2816e2514ca2e1c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.440+0000 7f77c93c5640 1 -- 172.21.15.96:0/2957361905 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b402e070 con 0x7f77c406c7f0 2023-12-01T23:46:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.440+0000 7f77c93c5640 1 -- 172.21.15.96:0/2957361905 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40315a0 con 0x7f77c406c7f0 2023-12-01T23:46:19.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.440+0000 7f77c93c5640 1 -- 172.21.15.96:0/2957361905 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4031930 con 0x7f77c406c7f0 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 -- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406c7f0 msgr2=0x7f77c406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406c7f0 0x7f77c406b9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f77b40097a0 tx=0x7f77b402b840 comp rx=0 tx=0).stop 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 -- 172.21.15.96:0/2957361905 shutdown_connections 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c406bef0 0x7f77c40c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 --2- 172.21.15.96:0/2957361905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406c7f0 0x7f77c406b9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 -- 172.21.15.96:0/2957361905 >> 172.21.15.96:0/2957361905 conn(0x7f77c40cee20 msgr2=0x7f77c40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 -- 172.21.15.96:0/2957361905 shutdown_connections 2023-12-01T23:46:19.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.441+0000 7f77cc62b640 1 -- 172.21.15.96:0/2957361905 wait complete. 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.442+0000 7f77cc62b640 1 Processor -- start 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.442+0000 7f77cc62b640 1 -- start start 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406bef0 0x7f77c41f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 0x7f77c41e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c4153ba0 0x7f77c40b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c41f3890 con 0x7f77c406c7f0 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c41e3460 con 0x7f77c406bef0 2023-12-01T23:46:19.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77cc62b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40b1c80 con 0x7f77c4153ba0 2023-12-01T23:46:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.443+0000 7f77c9bc6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 0x7f77c41e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.444+0000 7f77c9bc6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 0x7f77c41e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40168/0 (socket says 172.21.15.96:40168) 2023-12-01T23:46:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.444+0000 7f77c9bc6640 1 -- 172.21.15.96:0/3738258818 learned_addr learned my addr 172.21.15.96:0/3738258818 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.444+0000 7f77cabc8640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c4153ba0 0x7f77c40b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.444+0000 7f77ca3c7640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406bef0 0x7f77c41f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.447+0000 7f77c9bc6640 1 -- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c4153ba0 msgr2=0x7f77c40b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.447+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f77c4153ba0 0x7f77c40b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.447+0000 7f77c9bc6640 1 -- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406bef0 msgr2=0x7f77c41f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.447+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77c406bef0 0x7f77c41f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.447+0000 7f77c9bc6640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4009400 con 0x7f77c406c7f0 2023-12-01T23:46:19.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.449+0000 7f77c9bc6640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 0x7f77c41e2f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77b4034040 tx=0x7f77b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.453+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4032840 con 0x7f77c406c7f0 2023-12-01T23:46:19.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.453+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b40329c0 con 0x7f77c406c7f0 2023-12-01T23:46:19.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.453+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4032d70 con 0x7f77c406c7f0 2023-12-01T23:46:19.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.453+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c41ef3d0 con 0x7f77c406c7f0 2023-12-01T23:46:19.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.453+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c41e39d0 con 0x7f77c406c7f0 2023-12-01T23:46:19.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.454+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77c415d930 con 0x7f77c406c7f0 2023-12-01T23:46:19.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.472+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77b404e430 con 0x7f77c406c7f0 2023-12-01T23:46:19.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.473+0000 7f77baffd640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f77a806ae90 0x7f77a806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.473+0000 7f77ca3c7640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f77a806ae90 0x7f77a806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.473+0000 7f77ca3c7640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f77a806ae90 0x7f77a806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77c0005c00 tx=0x7f77c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77b407a700 con 0x7f77c406c7f0 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77baffd640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f77a80746f0 0x7f77a8076b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77a8077260 con 0x7f77a80746f0 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b4076a40 con 0x7f77c406c7f0 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77cabc8640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f77a80746f0 0x7f77a8076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.476+0000 7f77cabc8640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f77a80746f0 0x7f77a8076b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.477+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== osd.3 v2:172.21.15.96:6826/4247342649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f77a8077260 con 0x7f77a80746f0 2023-12-01T23:46:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.490+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 --> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77c40728d0 con 0x7f77a80746f0 2023-12-01T23:46:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77baffd640 1 -- 172.21.15.96:0/3738258818 <== osd.3 v2:172.21.15.96:6826/4247342649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f77c40728d0 con 0x7f77a80746f0 2023-12-01T23:46:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:19.492 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:19.492 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f77a80746f0 msgr2=0x7f77a8076b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6826/4247342649,v1:172.21.15.96:6827/4247342649] conn(0x7f77a80746f0 0x7f77a8076b90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f77a806ae90 msgr2=0x7f77a806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f77a806ae90 0x7f77a806d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f77c0005c00 tx=0x7f77c0009040 comp rx=0 tx=0).stop 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 msgr2=0x7f77c41e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 --2- 172.21.15.96:0/3738258818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77c406c7f0 0x7f77c41e2f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77b4034040 tx=0x7f77b40046c0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cabc8640 1 -- 172.21.15.96:0/3738258818 reap_dead start 2023-12-01T23:46:19.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 shutdown_connections 2023-12-01T23:46:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 >> 172.21.15.96:0/3738258818 conn(0x7f77c40cee20 msgr2=0x7f77c40ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 shutdown_connections 2023-12-01T23:46:19.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.491+0000 7f77cc62b640 1 -- 172.21.15.96:0/3738258818 wait complete. 2023-12-01T23:46:19.503 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.603+0000 7f546e7ec640 1 Processor -- start 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 -- start start 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5468153890 0x7f546815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5468153c70 0x7f54680c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546815a700 con 0x7f54680ceef0 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54680ca870 con 0x7f5468153c70 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.604+0000 7f546e7ec640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5468159af0 con 0x7f5468153890 2023-12-01T23:46:19.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.605+0000 7f5467fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5468153890 0x7f546815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.605+0000 7f545f7fe640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5468153c70 0x7f54680c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.605+0000 7f5467fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5468153890 0x7f546815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37020/0 (socket says 172.21.15.96:37020) 2023-12-01T23:46:19.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.605+0000 7f5467fff640 1 -- 172.21.15.96:0/4284524281 learned_addr learned my addr 172.21.15.96:0/4284524281 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:19.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.608+0000 7f5467fff640 1 -- 172.21.15.96:0/4284524281 >> v2:172.21.15.96:3300/0 conn(0x7f5468153c70 msgr2=0x7f54680c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:19.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.608+0000 7f5467fff640 1 --2- 172.21.15.96:0/4284524281 >> v2:172.21.15.96:3300/0 conn(0x7f5468153c70 0x7f54680c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.608+0000 7f5467fff640 1 -- 172.21.15.96:0/4284524281 >> v1:172.21.15.102:6789/0 conn(0x7f54680ceef0 legacy=0x7f546815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:19.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.608+0000 7f5467fff640 1 -- 172.21.15.96:0/4284524281 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468159dd0 con 0x7f5468153890 2023-12-01T23:46:19.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.611+0000 7f5467fff640 1 --2- 172.21.15.96:0/4284524281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153890 0x7f546815d950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54680ccaa0 tx=0x7f545802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf3acd4bbe3c187 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f54677fe640 1 -- 172.21.15.96:0/4284524281 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458030860 con 0x7f5468153890 2023-12-01T23:46:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f54677fe640 1 -- 172.21.15.96:0/4284524281 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54580309c0 con 0x7f5468153890 2023-12-01T23:46:19.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f54677fe640 1 -- 172.21.15.96:0/4284524281 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458030d50 con 0x7f5468153890 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 -- 172.21.15.96:0/4284524281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153890 msgr2=0x7f546815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 --2- 172.21.15.96:0/4284524281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153890 0x7f546815d950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f54680ccaa0 tx=0x7f545802b9a0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 -- 172.21.15.96:0/4284524281 shutdown_connections 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 --2- 172.21.15.96:0/4284524281 >> v2:172.21.15.96:3300/0 conn(0x7f5468153c70 0x7f54680c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 --2- 172.21.15.96:0/4284524281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153890 0x7f546815d950 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 -- 172.21.15.96:0/4284524281 >> 172.21.15.96:0/4284524281 conn(0x7f546806ba00 msgr2=0x7f546806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 -- 172.21.15.96:0/4284524281 shutdown_connections 2023-12-01T23:46:19.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.617+0000 7f546e7ec640 1 -- 172.21.15.96:0/4284524281 wait complete. 2023-12-01T23:46:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.619+0000 7f546e7ec640 1 Processor -- start 2023-12-01T23:46:19.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.619+0000 7f546e7ec640 1 -- start start 2023-12-01T23:46:19.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5468153890 0x7f54680c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153c70 0x7f54681f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681f2c40 con 0x7f54680ceef0 2023-12-01T23:46:19.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54681f28a0 con 0x7f5468153c70 2023-12-01T23:46:19.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546e7ec640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5468151b50 con 0x7f5468153890 2023-12-01T23:46:19.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f5467fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.620+0000 7f546cd89640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153c70 0x7f54681f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.621+0000 7f545f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5468153890 0x7f54680c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.621+0000 7f5467fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40198/0 (socket says 172.21.15.96:40198) 2023-12-01T23:46:19.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.621+0000 7f5467fff640 1 -- 172.21.15.96:0/3190708736 learned_addr learned my addr 172.21.15.96:0/3190708736 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.624+0000 7f5467fff640 1 -- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5468153890 msgr2=0x7f54680c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.624+0000 7f5467fff640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5468153890 0x7f54680c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.624+0000 7f5467fff640 1 -- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153c70 msgr2=0x7f54681f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.624+0000 7f5467fff640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153c70 0x7f54681f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:19.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.624+0000 7f5467fff640 1 -- 172.21.15.96:0/3190708736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580094d0 con 0x7f54680ceef0 2023-12-01T23:46:19.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.626+0000 7f5467fff640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.634+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458039c90 con 0x7f54680ceef0 2023-12-01T23:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.634+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458039df0 con 0x7f54680ceef0 2023-12-01T23:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.634+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458043640 con 0x7f54680ceef0 2023-12-01T23:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.634+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546814db30 con 0x7f54680ceef0 2023-12-01T23:46:19.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.634+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546814e0f0 con 0x7f54680ceef0 2023-12-01T23:46:19.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.635+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54681f2eb0 con 0x7f54680ceef0 2023-12-01T23:46:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.655+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54580437a0 con 0x7f54680ceef0 2023-12-01T23:46:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.655+0000 7f54657fa640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 0x7f544806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:19.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.656+0000 7f545f7fe640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 0x7f544806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:19.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.656+0000 7f545f7fe640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 0x7f544806d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f546815db30 tx=0x7f5450009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:19.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.659+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f545803e070 con 0x7f54680ceef0 2023-12-01T23:46:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:19.891+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5458078190 con 0x7f54680ceef0 2023-12-01T23:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.072+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f54681597a0 con 0x7f544806ae90 2023-12-01T23:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.072+0000 7f54657fa640 1 -- 172.21.15.96:0/3190708736 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5450011a30 con 0x7f544806ae90 2023-12-01T23:46:20.073 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 3 to deep-scrub 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 msgr2=0x7f544806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 0x7f544806d350 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f546815db30 tx=0x7f5450009190 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 msgr2=0x7f54680b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5458000c00 tx=0x7f5458004730 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 shutdown_connections 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f544806ae90 0x7f544806d350 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5468153c70 0x7f54681f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5468153890 0x7f54680c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 --2- 172.21.15.96:0/3190708736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54680ceef0 0x7f54680b4c10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 >> 172.21.15.96:0/3190708736 conn(0x7f546806ba00 msgr2=0x7f546815b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:20.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 shutdown_connections 2023-12-01T23:46:20.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.075+0000 7f546e7ec640 1 -- 172.21.15.96:0/3190708736 wait complete. 2023-12-01T23:46:20.087 INFO:tasks.ceph:Scrubbing osd.4 2023-12-01T23:46:20.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.190+0000 7f7dfc5b7640 1 Processor -- start 2023-12-01T23:46:20.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.190+0000 7f7dfc5b7640 1 -- start start 2023-12-01T23:46:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.191+0000 7f7dfc5b7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7df40c2d50 0x7f7df40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.191+0000 7f7dfc5b7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7df406f330 0x7f7df40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.191+0000 7f7dfc5b7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df41610e0 con 0x7f7df40c7b70 2023-12-01T23:46:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.191+0000 7f7dfc5b7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df40c3670 con 0x7f7df406f330 2023-12-01T23:46:20.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.191+0000 7f7dfc5b7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df41613c0 con 0x7f7df40c2d50 2023-12-01T23:46:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.192+0000 7f7dfa353640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7df40c2d50 0x7f7df40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.192+0000 7f7dfab54640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7df40c7b70 0x7f7df40c7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:57158/0 (socket says 172.21.15.96:57158) 2023-12-01T23:46:20.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.192+0000 7f7dfab54640 1 -- 172.21.15.96:0/2530531433 learned_addr learned my addr 172.21.15.96:0/2530531433 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.195+0000 7f7df9b52640 1 --2- 172.21.15.96:0/2530531433 >> v2:172.21.15.96:3300/0 conn(0x7f7df406f330 0x7f7df40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.195+0000 7f7dfa353640 1 -- 172.21.15.96:0/2530531433 >> v2:172.21.15.96:3300/0 conn(0x7f7df406f330 msgr2=0x7f7df40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.195+0000 7f7dfa353640 1 --2- 172.21.15.96:0/2530531433 >> v2:172.21.15.96:3300/0 conn(0x7f7df406f330 0x7f7df40c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.195+0000 7f7dfa353640 1 -- 172.21.15.96:0/2530531433 >> v1:172.21.15.102:6789/0 conn(0x7f7df40c7b70 legacy=0x7f7df40c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.195+0000 7f7dfa353640 1 -- 172.21.15.96:0/2530531433 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df41616a0 con 0x7f7df40c2d50 2023-12-01T23:46:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.200+0000 7f7dfa353640 1 --2- 172.21.15.96:0/2530531433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df40c3130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7df4071bc0 tx=0x7f7df002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f2c99dd15a196a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.204+0000 7f7df9351640 1 -- 172.21.15.96:0/2530531433 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0031830 con 0x7f7df40c2d50 2023-12-01T23:46:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.204+0000 7f7df9351640 1 -- 172.21.15.96:0/2530531433 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0031990 con 0x7f7df40c2d50 2023-12-01T23:46:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7df9351640 1 -- 172.21.15.96:0/2530531433 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0031d20 con 0x7f7df40c2d50 2023-12-01T23:46:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/2530531433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 msgr2=0x7f7df40c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/2530531433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df40c3130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7df4071bc0 tx=0x7f7df002b8d0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/2530531433 shutdown_connections 2023-12-01T23:46:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/2530531433 >> v2:172.21.15.96:3300/0 conn(0x7f7df406f330 0x7f7df40c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/2530531433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df40c3130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/2530531433 >> 172.21.15.96:0/2530531433 conn(0x7f7df40ccd90 msgr2=0x7f7df40cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/2530531433 shutdown_connections 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.205+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/2530531433 wait complete. 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.206+0000 7f7dfc5b7640 1 Processor -- start 2023-12-01T23:46:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.206+0000 7f7dfc5b7640 1 -- start start 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7df406f330 0x7f7df40cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df41f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 0x7f7df4152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df41f6de0 con 0x7f7df40c7b70 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df415bcc0 con 0x7f7df40c2d50 2023-12-01T23:46:20.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.207+0000 7f7dfc5b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df415b740 con 0x7f7df406f330 2023-12-01T23:46:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.208+0000 7f7dfab54640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 0x7f7df4152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.208+0000 7f7df9b52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df41f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.208+0000 7f7dfa353640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7df406f330 0x7f7df40cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.208+0000 7f7dfab54640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 0x7f7df4152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40220/0 (socket says 172.21.15.96:40220) 2023-12-01T23:46:20.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.208+0000 7f7dfab54640 1 -- 172.21.15.96:0/3323154422 learned_addr learned my addr 172.21.15.96:0/3323154422 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:20.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.211+0000 7f7dfab54640 1 -- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7df406f330 msgr2=0x7f7df40cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.211+0000 7f7dfab54640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7df406f330 0x7f7df40cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.211+0000 7f7dfab54640 1 -- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 msgr2=0x7f7df41f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.211+0000 7f7dfab54640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7df40c2d50 0x7f7df41f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.211+0000 7f7dfab54640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009400 con 0x7f7df40c7b70 2023-12-01T23:46:20.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.214+0000 7f7dfab54640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 0x7f7df4152db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00ca80 tx=0x7f7dec00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.217+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00ac30 con 0x7f7df40c7b70 2023-12-01T23:46:20.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.217+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00ad90 con 0x7f7df40c7b70 2023-12-01T23:46:20.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.217+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec012600 con 0x7f7df40c7b70 2023-12-01T23:46:20.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.217+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df415b9e0 con 0x7f7df40c7b70 2023-12-01T23:46:20.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.217+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df41e90c0 con 0x7f7df40c7b70 2023-12-01T23:46:20.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.218+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7df40cbe10 con 0x7f7df40c7b70 2023-12-01T23:46:20.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.236+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7dec007070 con 0x7f7df40c7b70 2023-12-01T23:46:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.237+0000 7f7deaffd640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7dd806aec0 0x7f7dd806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.237+0000 7f7dfa353640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7dd806aec0 0x7f7dd806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.237+0000 7f7dfa353640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7dd806aec0 0x7f7dd806d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.240+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7dec058a00 con 0x7f7df40c7b70 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.240+0000 7f7deaffd640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f7dd80747a0 0x7f7dd8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.240+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7dd8077310 con 0x7f7dd80747a0 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.240+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7dec001b60 con 0x7f7df40c7b70 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.240+0000 7f7df9b52640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f7dd80747a0 0x7f7dd8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.241+0000 7f7df9b52640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f7dd80747a0 0x7f7dd8076c40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.241+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== osd.4 v2:172.21.15.102:6800/1035724866 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7dd8077310 con 0x7f7dd80747a0 2023-12-01T23:46:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.254+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 --> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7df40c9600 con 0x7f7dd80747a0 2023-12-01T23:46:20.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.254+0000 7f7deaffd640 1 -- 172.21.15.96:0/3323154422 <== osd.4 v2:172.21.15.102:6800/1035724866 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7de400c040 con 0x7f7dd80747a0 2023-12-01T23:46:20.256 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:20.256 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:20.256 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f7dd80747a0 msgr2=0x7f7dd8076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.102:6800/1035724866,v1:172.21.15.102:6801/1035724866] conn(0x7f7dd80747a0 0x7f7dd8076c40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7dd806aec0 msgr2=0x7f7dd806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7dd806aec0 0x7f7dd806d380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7df0036000 tx=0x7f7df003c040 comp rx=0 tx=0).stop 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 msgr2=0x7f7df4152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 --2- 172.21.15.96:0/3323154422 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7df40c7b70 0x7f7df4152db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00ca80 tx=0x7f7dec00cf40 comp rx=0 tx=0).stop 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfab54640 1 -- 172.21.15.96:0/3323154422 reap_dead start 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 shutdown_connections 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 >> 172.21.15.96:0/3323154422 conn(0x7f7df40ccd90 msgr2=0x7f7df4073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 shutdown_connections 2023-12-01T23:46:20.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.255+0000 7f7dfc5b7640 1 -- 172.21.15.96:0/3323154422 wait complete. 2023-12-01T23:46:20.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-01T23:46:20.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.369+0000 7f477f67c640 1 Processor -- start 2023-12-01T23:46:20.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.369+0000 7f477f67c640 1 -- start start 2023-12-01T23:46:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.370+0000 7f477f67c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.370+0000 7f477f67c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f47780ceef0 0x7f47780cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.370+0000 7f477f67c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477815a700 con 0x7f4778153c70 2023-12-01T23:46:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.370+0000 7f477f67c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47780ca870 con 0x7f47780ceef0 2023-12-01T23:46:20.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.370+0000 7f477f67c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4778159af0 con 0x7f4778153890 2023-12-01T23:46:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.371+0000 7f477d418640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.371+0000 7f477dc19640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f47780ceef0 0x7f47780cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.371+0000 7f477d418640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:33342/0 (socket says 172.21.15.96:33342) 2023-12-01T23:46:20.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.371+0000 7f477d418640 1 -- 172.21.15.96:0/2877896880 learned_addr learned my addr 172.21.15.96:0/2877896880 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.373+0000 7f477dc19640 1 -- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 msgr2=0x7f477815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.373+0000 7f477dc19640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.373+0000 7f477dc19640 1 -- 172.21.15.96:0/2877896880 >> v1:172.21.15.96:6789/0 conn(0x7f4778153c70 legacy=0x7f47780c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.373+0000 7f477dc19640 1 -- 172.21.15.96:0/2877896880 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778159dd0 con 0x7f47780ceef0 2023-12-01T23:46:20.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.373+0000 7f477d418640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:20.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.375+0000 7f477dc19640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47780ceef0 0x7f47780cf340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4770009d90 tx=0x7f477002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab6e8c8d9fe3c670 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.379+0000 7f476ffff640 1 -- 172.21.15.96:0/2877896880 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477002cc50 con 0x7f47780ceef0 2023-12-01T23:46:20.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.379+0000 7f476ffff640 1 -- 172.21.15.96:0/2877896880 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477002cdb0 con 0x7f47780ceef0 2023-12-01T23:46:20.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.379+0000 7f476ffff640 1 -- 172.21.15.96:0/2877896880 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770034660 con 0x7f47780ceef0 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 -- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47780ceef0 msgr2=0x7f47780cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47780ceef0 0x7f47780cf340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4770009d90 tx=0x7f477002bea0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 -- 172.21.15.96:0/2877896880 shutdown_connections 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47780ceef0 0x7f47780cf340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 --2- 172.21.15.96:0/2877896880 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153890 0x7f477815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 -- 172.21.15.96:0/2877896880 >> 172.21.15.96:0/2877896880 conn(0x7f477806ba00 msgr2=0x7f477806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 -- 172.21.15.96:0/2877896880 shutdown_connections 2023-12-01T23:46:20.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.380+0000 7f477f67c640 1 -- 172.21.15.96:0/2877896880 wait complete. 2023-12-01T23:46:20.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.381+0000 7f477f67c640 1 Processor -- start 2023-12-01T23:46:20.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.381+0000 7f477f67c640 1 -- start start 2023-12-01T23:46:20.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47780ceef0 0x7f47781f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 0x7f4778152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4778152540 con 0x7f47780ceef0 2023-12-01T23:46:20.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c5590 con 0x7f4778153890 2023-12-01T23:46:20.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477f67c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47780c57f0 con 0x7f4778153c70 2023-12-01T23:46:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477dc19640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 0x7f4778152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.382+0000 7f477cc17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.383+0000 7f477cc17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37082/0 (socket says 172.21.15.96:37082) 2023-12-01T23:46:20.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.383+0000 7f477cc17640 1 -- 172.21.15.96:0/2028990513 learned_addr learned my addr 172.21.15.96:0/2028990513 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477dc19640 1 -- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 msgr2=0x7f47780c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477dc19640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477dc19640 1 -- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47780ceef0 msgr2=0x7f47781f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477dc19640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47780ceef0 0x7f47781f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477dc19640 1 -- 172.21.15.96:0/2028990513 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680094d0 con 0x7f4778153c70 2023-12-01T23:46:20.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.386+0000 7f477cc17640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:20.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.388+0000 7f477dc19640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 0x7f4778152000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f477806c700 tx=0x7f4770004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.392+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770040650 con 0x7f4778153c70 2023-12-01T23:46:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.392+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47700407b0 con 0x7f4778153c70 2023-12-01T23:46:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.392+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770009a70 con 0x7f4778153c70 2023-12-01T23:46:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.393+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770040b60 con 0x7f4778153c70 2023-12-01T23:46:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.393+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47780c5d90 con 0x7f4778153c70 2023-12-01T23:46:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.394+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4778067500 con 0x7f4778153c70 2023-12-01T23:46:20.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.683+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4770040cc0 con 0x7f4778153c70 2023-12-01T23:46:20.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.684+0000 7f476dffb640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 0x7f475c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.684+0000 7f477d418640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 0x7f475c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:20.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.684+0000 7f477d418640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 0x7f475c06d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4768006f40 tx=0x7f4768006e90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:20.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.688+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f477007bba0 con 0x7f4778153c70 2023-12-01T23:46:20.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.701+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47700777e0 con 0x7f4778153c70 2023-12-01T23:46:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.870+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f47781597a0 con 0x7f475c06aec0 2023-12-01T23:46:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.870+0000 7f476dffb640 1 -- 172.21.15.96:0/2028990513 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4768004020 con 0x7f475c06aec0 2023-12-01T23:46:20.871 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 4 to deep-scrub 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 msgr2=0x7f475c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 0x7f475c06d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4768006f40 tx=0x7f4768006e90 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 msgr2=0x7f4778152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 0x7f4778152000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f477806c700 tx=0x7f4770004a40 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 shutdown_connections 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f475c06aec0 0x7f475c06d380 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4778153c70 0x7f4778152000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4778153890 0x7f47780c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 --2- 172.21.15.96:0/2028990513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f47780ceef0 0x7f47781f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 >> 172.21.15.96:0/2028990513 conn(0x7f477806ba00 msgr2=0x7f477815ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 shutdown_connections 2023-12-01T23:46:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.872+0000 7f477f67c640 1 -- 172.21.15.96:0/2028990513 wait complete. 2023-12-01T23:46:20.884 INFO:tasks.ceph:Scrubbing osd.5 2023-12-01T23:46:20.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:20.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.991+0000 7fcb2ca07640 1 Processor -- start 2023-12-01T23:46:20.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.991+0000 7fcb2ca07640 1 -- start start 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.991+0000 7fcb2ca07640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 0x7fcb280c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.992+0000 7fcb2ca07640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb280c6ec0 con 0x7fcb28072530 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.992+0000 7fcb2ca07640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb281509f0 con 0x7fcb280bff00 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.992+0000 7fcb2ca07640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28072a30 con 0x7fcb28150610 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.992+0000 7fcb1ffff640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fcb28072530 0x7fcb280cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47120/0 (socket says 172.21.15.96:47120) 2023-12-01T23:46:20.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.992+0000 7fcb1ffff640 1 -- 172.21.15.96:0/1573090840 learned_addr learned my addr 172.21.15.96:0/1573090840 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.995+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214222168 0 0) 0x7fcb280c6ec0 con 0x7fcb28072530 2023-12-01T23:46:20.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.995+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb14003520 con 0x7fcb28072530 2023-12-01T23:46:21.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068052285 0 0) 0x7fcb14003520 con 0x7fcb28072530 2023-12-01T23:46:21.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 msgr2=0x7fcb280c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 0x7fcb280c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 >> v1:172.21.15.102:6789/0 conn(0x7fcb280bff00 legacy=0x7fcb28160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28071df0 con 0x7fcb28072530 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7fcb10001670 con 0x7fcb28072530 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 >> v1:172.21.15.96:6789/0 conn(0x7fcb28072530 legacy=0x7fcb280cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 0x7fcb140039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb140040e0 0x7fcb140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb14004e20 0x7fcb1400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28072a30 con 0x7fcb140040e0 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb140055c0 con 0x7fcb14004e20 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:20.998+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1400e0d0 con 0x7fcb28150610 2023-12-01T23:46:21.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.000+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb140040e0 0x7fcb140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.004+0000 7fcb1ffff640 1 -- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 msgr2=0x7fcb140039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.004+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb28150610 0x7fcb140039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.004+0000 7fcb1ffff640 1 -- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb14004e20 msgr2=0x7fcb1400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.004+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb14004e20 0x7fcb1400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.004+0000 7fcb1ffff640 1 -- 172.21.15.96:0/1573090840 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14003520 con 0x7fcb140040e0 2023-12-01T23:46:21.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.006+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb140040e0 0x7fcb140047c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c0e0 tx=0x7fcb140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148a867452d8d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10005ad0 con 0x7fcb140040e0 2023-12-01T23:46:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10005c30 con 0x7fcb140040e0 2023-12-01T23:46:21.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb25d9b640 1 -- 172.21.15.96:0/1573090840 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1002c7d0 con 0x7fcb140040e0 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 -- 172.21.15.96:0/1573090840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb140040e0 msgr2=0x7fcb140047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 --2- 172.21.15.96:0/1573090840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb140040e0 0x7fcb140047c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c0e0 tx=0x7fcb140057f0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb26d9d640 1 -- 172.21.15.96:0/1573090840 reap_dead start 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 -- 172.21.15.96:0/1573090840 shutdown_connections 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 -- 172.21.15.96:0/1573090840 >> 172.21.15.96:0/1573090840 conn(0x7fcb2806cd60 msgr2=0x7fcb2806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 -- 172.21.15.96:0/1573090840 shutdown_connections 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.012+0000 7fcb2ca07640 1 -- 172.21.15.96:0/1573090840 wait complete. 2023-12-01T23:46:21.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.014+0000 7fcb2ca07640 1 Processor -- start 2023-12-01T23:46:21.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.014+0000 7fcb2ca07640 1 -- start start 2023-12-01T23:46:21.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.014+0000 7fcb2ca07640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb280ad170 0x7fcb280ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb2ca07640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 0x7fcb281f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb2ca07640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb28151640 0x7fcb280aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb2ca07640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28152a10 con 0x7fcb28151640 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb2ca07640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb281efd60 con 0x7fcb280ad550 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb2ca07640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28151ad0 con 0x7fcb280ad170 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 0x7fcb281f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb1ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 0x7fcb281f01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37102/0 (socket says 172.21.15.96:37102) 2023-12-01T23:46:21.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.015+0000 7fcb1ffff640 1 -- 172.21.15.96:0/3626234286 learned_addr learned my addr 172.21.15.96:0/3626234286 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.017+0000 7fcb2659c640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb280ad170 0x7fcb280ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.019+0000 7fcb1ffff640 1 -- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb280ad170 msgr2=0x7fcb280ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.019+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb280ad170 0x7fcb280ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.019+0000 7fcb1ffff640 1 -- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb28151640 msgr2=0x7fcb280aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.019+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb28151640 0x7fcb280aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.019+0000 7fcb1ffff640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb281ef730 con 0x7fcb280ad550 2023-12-01T23:46:21.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.021+0000 7fcb1ffff640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 0x7fcb281f01f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c200 tx=0x7fcb1002e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.024+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1003c040 con 0x7fcb280ad550 2023-12-01T23:46:21.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.024+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1002cce0 con 0x7fcb280ad550 2023-12-01T23:46:21.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.024+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb281533e0 con 0x7fcb280ad550 2023-12-01T23:46:21.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.024+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10007290 con 0x7fcb280ad550 2023-12-01T23:46:21.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.025+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb281539a0 con 0x7fcb280ad550 2023-12-01T23:46:21.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.026+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb280c6b50 con 0x7fcb280ad550 2023-12-01T23:46:21.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.045+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb10032070 con 0x7fcb280ad550 2023-12-01T23:46:21.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.046+0000 7fcb1effd640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcb0806aec0 0x7fcb0806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.046+0000 7fcb2659c640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcb0806aec0 0x7fcb0806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.046+0000 7fcb2659c640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcb0806aec0 0x7fcb0806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb180099a0 tx=0x7fcb18006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.050+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb1007a080 con 0x7fcb280ad550 2023-12-01T23:46:21.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.050+0000 7fcb1effd640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7fcb08074720 0x7fcb08076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.050+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb08077290 con 0x7fcb08074720 2023-12-01T23:46:21.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.050+0000 7fcb26d9d640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7fcb08074720 0x7fcb08076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.051+0000 7fcb26d9d640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7fcb08074720 0x7fcb08076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.052+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== osd.5 v2:172.21.15.102:6809/3442167732 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcb08077290 con 0x7fcb08074720 2023-12-01T23:46:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.065+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 --> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb280c6870 con 0x7fcb08074720 2023-12-01T23:46:21.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.065+0000 7fcb1effd640 1 -- 172.21.15.96:0/3626234286 <== osd.5 v2:172.21.15.102:6809/3442167732 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb200016c0 con 0x7fcb08074720 2023-12-01T23:46:21.066 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:21.067 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:21.067 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:21.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7fcb08074720 msgr2=0x7fcb08076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:6809/3442167732,v1:172.21.15.102:6811/3442167732] conn(0x7fcb08074720 0x7fcb08076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcb0806aec0 msgr2=0x7fcb0806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fcb0806aec0 0x7fcb0806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb180099a0 tx=0x7fcb18006f90 comp rx=0 tx=0).stop 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 msgr2=0x7fcb281f01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 --2- 172.21.15.96:0/3626234286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb280ad550 0x7fcb281f01f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000c200 tx=0x7fcb1002e070 comp rx=0 tx=0).stop 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb26d9d640 1 -- 172.21.15.96:0/3626234286 reap_dead start 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 shutdown_connections 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 >> 172.21.15.96:0/3626234286 conn(0x7fcb2806cd60 msgr2=0x7fcb280cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 shutdown_connections 2023-12-01T23:46:21.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.066+0000 7fcb2ca07640 1 -- 172.21.15.96:0/3626234286 wait complete. 2023-12-01T23:46:21.077 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-01T23:46:21.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.177+0000 7fd1720e5640 1 Processor -- start 2023-12-01T23:46:21.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.177+0000 7fd1720e5640 1 -- start start 2023-12-01T23:46:21.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.178+0000 7fd1720e5640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd16c153c70 0x7fd16c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.178+0000 7fd1720e5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd16c0ceef0 0x7fd16c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.178+0000 7fd1720e5640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c15a700 con 0x7fd16c153890 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.178+0000 7fd1720e5640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0cf840 con 0x7fd16c153c70 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.178+0000 7fd1720e5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0ca870 con 0x7fd16c0ceef0 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.179+0000 7fd16affd640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fd16c153c70 0x7fd16c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.179+0000 7fd16bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd16c0ceef0 0x7fd16c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.179+0000 7fd16bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd16c0ceef0 0x7fd16c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37110/0 (socket says 172.21.15.96:37110) 2023-12-01T23:46:21.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.179+0000 7fd16bfff640 1 -- 172.21.15.96:0/133710631 learned_addr learned my addr 172.21.15.96:0/133710631 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.181+0000 7fd16bfff640 1 -- 172.21.15.96:0/133710631 >> v2:172.21.15.96:3300/0 conn(0x7fd16c153c70 msgr2=0x7fd16c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.181+0000 7fd16bfff640 1 --2- 172.21.15.96:0/133710631 >> v2:172.21.15.96:3300/0 conn(0x7fd16c153c70 0x7fd16c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.181+0000 7fd16bfff640 1 -- 172.21.15.96:0/133710631 >> v1:172.21.15.96:6789/0 conn(0x7fd16c153890 legacy=0x7fd16c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.182+0000 7fd16bfff640 1 -- 172.21.15.96:0/133710631 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c159af0 con 0x7fd16c0ceef0 2023-12-01T23:46:21.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.183+0000 7fd16bfff640 1 --2- 172.21.15.96:0/133710631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c0ceef0 0x7fd16c0cf300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0c9ab0 tx=0x7fd16402c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee75487b7201ecef server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd16a7fc640 1 -- 172.21.15.96:0/133710631 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16402cbb0 con 0x7fd16c0ceef0 2023-12-01T23:46:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd16a7fc640 1 -- 172.21.15.96:0/133710631 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16402cd10 con 0x7fd16c0ceef0 2023-12-01T23:46:21.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd16a7fc640 1 -- 172.21.15.96:0/133710631 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164034610 con 0x7fd16c0ceef0 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 -- 172.21.15.96:0/133710631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c0ceef0 msgr2=0x7fd16c0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 --2- 172.21.15.96:0/133710631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c0ceef0 0x7fd16c0cf300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0c9ab0 tx=0x7fd16402c010 comp rx=0 tx=0).stop 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 -- 172.21.15.96:0/133710631 shutdown_connections 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 --2- 172.21.15.96:0/133710631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c0ceef0 0x7fd16c0cf300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 --2- 172.21.15.96:0/133710631 >> v2:172.21.15.96:3300/0 conn(0x7fd16c153c70 0x7fd16c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 -- 172.21.15.96:0/133710631 >> 172.21.15.96:0/133710631 conn(0x7fd16c06ba00 msgr2=0x7fd16c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 -- 172.21.15.96:0/133710631 shutdown_connections 2023-12-01T23:46:21.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.189+0000 7fd1720e5640 1 -- 172.21.15.96:0/133710631 wait complete. 2023-12-01T23:46:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.191+0000 7fd1720e5640 1 Processor -- start 2023-12-01T23:46:21.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.191+0000 7fd1720e5640 1 -- start start 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.191+0000 7fd1720e5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd16c0ceef0 0x7fd16c1ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd1720e5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd1720e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c153c70 0x7fd16c14e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd1720e5640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c1527f0 con 0x7fd16c153890 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd1720e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0cddb0 con 0x7fd16c153c70 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd1720e5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c153150 con 0x7fd16c0ceef0 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd16affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd16bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c153c70 0x7fd16c14e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd16b7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd16c0ceef0 0x7fd16c1ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd16affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40274/0 (socket says 172.21.15.96:40274) 2023-12-01T23:46:21.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.192+0000 7fd16affd640 1 -- 172.21.15.96:0/1325444733 learned_addr learned my addr 172.21.15.96:0/1325444733 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.196+0000 7fd16affd640 1 -- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd16c0ceef0 msgr2=0x7fd16c1ef0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.196+0000 7fd16affd640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd16c0ceef0 0x7fd16c1ef0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.196+0000 7fd16affd640 1 -- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c153c70 msgr2=0x7fd16c14e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.196+0000 7fd16affd640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c153c70 0x7fd16c14e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.196+0000 7fd16affd640 1 -- 172.21.15.96:0/1325444733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd164009b30 con 0x7fd16c153890 2023-12-01T23:46:21.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.198+0000 7fd16affd640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd16000e870 tx=0x7fd16000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.202+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600094f0 con 0x7fd16c153890 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.202+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000c940 con 0x7fd16c153890 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.202+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000ccf0 con 0x7fd16c153890 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.202+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0cdfa0 con 0x7fd16c153890 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.202+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0ce560 con 0x7fd16c153890 2023-12-01T23:46:21.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.203+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c067500 con 0x7fd16c153890 2023-12-01T23:46:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.221+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd160013470 con 0x7fd16c153890 2023-12-01T23:46:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.221+0000 7fd153fff640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 0x7fd15806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.222+0000 7fd16b7fe640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 0x7fd15806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.222+0000 7fd16b7fe640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 0x7fd15806d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001780 tx=0x7fd15c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.454+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd160058c10 con 0x7fd16c153890 2023-12-01T23:46:21.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.454+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd160054f50 con 0x7fd16c153890 2023-12-01T23:46:21.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.623+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd16c15a0b0 con 0x7fd15806aec0 2023-12-01T23:46:21.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.624+0000 7fd153fff640 1 -- 172.21.15.96:0/1325444733 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd15c001420 con 0x7fd15806aec0 2023-12-01T23:46:21.625 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 5 to deep-scrub 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.625+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 msgr2=0x7fd15806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 0x7fd15806d380 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd15c001780 tx=0x7fd15c009040 comp rx=0 tx=0).stop 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 msgr2=0x7fd16c152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd16000e870 tx=0x7fd16000ed30 comp rx=0 tx=0).stop 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 shutdown_connections 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fd15806aec0 0x7fd15806d380 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd16c153c70 0x7fd16c14e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd16c153890 0x7fd16c152c10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 --2- 172.21.15.96:0/1325444733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd16c0ceef0 0x7fd16c1ef0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 >> 172.21.15.96:0/1325444733 conn(0x7fd16c06ba00 msgr2=0x7fd16c15c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 shutdown_connections 2023-12-01T23:46:21.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.626+0000 7fd1720e5640 1 -- 172.21.15.96:0/1325444733 wait complete. 2023-12-01T23:46:21.638 INFO:tasks.ceph:Scrubbing osd.6 2023-12-01T23:46:21.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:21.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.742+0000 7ffb48ee0640 1 Processor -- start 2023-12-01T23:46:21.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.742+0000 7ffb48ee0640 1 -- start start 2023-12-01T23:46:21.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.743+0000 7ffb48ee0640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffb440c56a0 0x7ffb4406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.743+0000 7ffb48ee0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb440c2960 0x7ffb440c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.743+0000 7ffb48ee0640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4415a2e0 con 0x7ffb44153d70 2023-12-01T23:46:21.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.743+0000 7ffb48ee0640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb44159a10 con 0x7ffb440c56a0 2023-12-01T23:46:21.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.743+0000 7ffb48ee0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4406f7d0 con 0x7ffb440c2960 2023-12-01T23:46:21.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.744+0000 7ffb41d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ffb440c56a0 0x7ffb4406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.744+0000 7ffb42d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb440c2960 0x7ffb440c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.744+0000 7ffb42d9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb440c2960 0x7ffb440c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37128/0 (socket says 172.21.15.96:37128) 2023-12-01T23:46:21.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.744+0000 7ffb42d9d640 1 -- 172.21.15.96:0/1992550884 learned_addr learned my addr 172.21.15.96:0/1992550884 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.746+0000 7ffb42d9d640 1 -- 172.21.15.96:0/1992550884 >> v2:172.21.15.96:3300/0 conn(0x7ffb440c56a0 msgr2=0x7ffb4406f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.746+0000 7ffb42d9d640 1 --2- 172.21.15.96:0/1992550884 >> v2:172.21.15.96:3300/0 conn(0x7ffb440c56a0 0x7ffb4406f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.746+0000 7ffb42d9d640 1 -- 172.21.15.96:0/1992550884 >> v1:172.21.15.96:6789/0 conn(0x7ffb44153d70 legacy=0x7ffb4406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.746+0000 7ffb42d9d640 1 -- 172.21.15.96:0/1992550884 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4406b6a0 con 0x7ffb440c2960 2023-12-01T23:46:21.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.748+0000 7ffb42d9d640 1 --2- 172.21.15.96:0/1992550884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c2960 0x7ffb440c42f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb440610d0 tx=0x7ffb3c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afea95efe4aec94 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.752+0000 7ffb4159a640 1 -- 172.21.15.96:0/1992550884 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c030860 con 0x7ffb440c2960 2023-12-01T23:46:21.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.752+0000 7ffb4159a640 1 -- 172.21.15.96:0/1992550884 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0309c0 con 0x7ffb440c2960 2023-12-01T23:46:21.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.752+0000 7ffb4159a640 1 -- 172.21.15.96:0/1992550884 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c030d50 con 0x7ffb440c2960 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 -- 172.21.15.96:0/1992550884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c2960 msgr2=0x7ffb440c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/1992550884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c2960 0x7ffb440c42f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb440610d0 tx=0x7ffb3c02b9a0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 -- 172.21.15.96:0/1992550884 shutdown_connections 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/1992550884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c2960 0x7ffb440c42f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/1992550884 >> v2:172.21.15.96:3300/0 conn(0x7ffb440c56a0 0x7ffb4406f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 -- 172.21.15.96:0/1992550884 >> 172.21.15.96:0/1992550884 conn(0x7ffb440c7f60 msgr2=0x7ffb440c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 -- 172.21.15.96:0/1992550884 shutdown_connections 2023-12-01T23:46:21.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.753+0000 7ffb48ee0640 1 -- 172.21.15.96:0/1992550884 wait complete. 2023-12-01T23:46:21.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.754+0000 7ffb48ee0640 1 Processor -- start 2023-12-01T23:46:21.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.754+0000 7ffb48ee0640 1 -- start start 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb440c2960 0x7ffb4415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 0x7ffb440c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb44153d70 0x7ffb441ef680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414c860 con 0x7ffb440c2960 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414b510 con 0x7ffb440c56a0 2023-12-01T23:46:21.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.755+0000 7ffb48ee0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4414b7e0 con 0x7ffb44153d70 2023-12-01T23:46:21.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.756+0000 7ffb41d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 0x7ffb440c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.756+0000 7ffb42d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb44153d70 0x7ffb441ef680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.756+0000 7ffb41d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 0x7ffb440c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37140/0 (socket says 172.21.15.96:37140) 2023-12-01T23:46:21.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.756+0000 7ffb41d9b640 1 -- 172.21.15.96:0/2445479348 learned_addr learned my addr 172.21.15.96:0/2445479348 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.759+0000 7ffb41d9b640 1 -- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb44153d70 msgr2=0x7ffb441ef680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.759+0000 7ffb41d9b640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb44153d70 0x7ffb441ef680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.759+0000 7ffb41d9b640 1 -- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb440c2960 msgr2=0x7ffb4415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.759+0000 7ffb41d9b640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb440c2960 0x7ffb4415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.759+0000 7ffb41d9b640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0094d0 con 0x7ffb440c56a0 2023-12-01T23:46:21.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.761+0000 7ffb41d9b640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 0x7ffb440c5dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e9b0 tx=0x7ffb2c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.765+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c009670 con 0x7ffb440c56a0 2023-12-01T23:46:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.765+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00c9a0 con 0x7ffb440c56a0 2023-12-01T23:46:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.765+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00cd50 con 0x7ffb440c56a0 2023-12-01T23:46:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.765+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb441f3350 con 0x7ffb440c56a0 2023-12-01T23:46:21.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.765+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4414cab0 con 0x7ffb440c56a0 2023-12-01T23:46:21.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.766+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb44159c90 con 0x7ffb440c56a0 2023-12-01T23:46:21.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.785+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb2c013470 con 0x7ffb440c56a0 2023-12-01T23:46:21.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.785+0000 7ffb3affd640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ffb2406aec0 0x7ffb2406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.785+0000 7ffb4259c640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ffb2406aec0 0x7ffb2406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.785+0000 7ffb4259c640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ffb2406aec0 0x7ffb2406d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb340012e0 tx=0x7ffb34007d50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb2c058860 con 0x7ffb440c56a0 2023-12-01T23:46:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb3affd640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7ffb24074720 0x7ffb24076bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb24077290 con 0x7ffb24074720 2023-12-01T23:46:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb42d9d640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7ffb24074720 0x7ffb24076bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb2c004640 con 0x7ffb440c56a0 2023-12-01T23:46:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.789+0000 7ffb42d9d640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7ffb24074720 0x7ffb24076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.790+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== osd.6 v2:172.21.15.102:6808/3935229295 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffb24077290 con 0x7ffb24074720 2023-12-01T23:46:21.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 --> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb4406b960 con 0x7ffb24074720 2023-12-01T23:46:21.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb3affd640 1 -- 172.21.15.96:0/2445479348 <== osd.6 v2:172.21.15.102:6808/3935229295 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb3c030b30 con 0x7ffb24074720 2023-12-01T23:46:21.804 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:21.804 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:21.805 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:21.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7ffb24074720 msgr2=0x7ffb24076bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:6808/3935229295,v1:172.21.15.102:6810/3935229295] conn(0x7ffb24074720 0x7ffb24076bc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ffb2406aec0 msgr2=0x7ffb2406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ffb2406aec0 0x7ffb2406d380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffb340012e0 tx=0x7ffb34007d50 comp rx=0 tx=0).stop 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 msgr2=0x7ffb440c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 --2- 172.21.15.96:0/2445479348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb440c56a0 0x7ffb440c5dc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e9b0 tx=0x7ffb2c00ee70 comp rx=0 tx=0).stop 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb42d9d640 1 -- 172.21.15.96:0/2445479348 reap_dead start 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 shutdown_connections 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.803+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 >> 172.21.15.96:0/2445479348 conn(0x7ffb440c7f60 msgr2=0x7ffb44151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.804+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 shutdown_connections 2023-12-01T23:46:21.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.804+0000 7ffb48ee0640 1 -- 172.21.15.96:0/2445479348 wait complete. 2023-12-01T23:46:21.815 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-01T23:46:21.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.914+0000 7f5c6c16e640 1 Processor -- start 2023-12-01T23:46:21.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.914+0000 7f5c6c16e640 1 -- start start 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.915+0000 7f5c6c16e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c640c4de0 0x7f5c6406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.915+0000 7f5c6c16e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5c640c51c0 0x7f5c64161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.915+0000 7f5c6c16e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640c7dd0 con 0x7f5c6406f940 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.915+0000 7f5c6c16e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c64158640 con 0x7f5c640c4de0 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.915+0000 7f5c6c16e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6406ec40 con 0x7f5c640c51c0 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.916+0000 7f5c6a70b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5c640c51c0 0x7f5c64161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.916+0000 7f5c69f0a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f5c640c4de0 0x7f5c6406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.916+0000 7f5c6a70b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5c640c51c0 0x7f5c64161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:37156/0 (socket says 172.21.15.96:37156) 2023-12-01T23:46:21.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.916+0000 7f5c6a70b640 1 -- 172.21.15.96:0/2174495890 learned_addr learned my addr 172.21.15.96:0/2174495890 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.918+0000 7f5c6a70b640 1 -- 172.21.15.96:0/2174495890 >> v2:172.21.15.96:3300/0 conn(0x7f5c640c4de0 msgr2=0x7f5c6406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:21.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.918+0000 7f5c6a70b640 1 --2- 172.21.15.96:0/2174495890 >> v2:172.21.15.96:3300/0 conn(0x7f5c640c4de0 0x7f5c6406f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.918+0000 7f5c6a70b640 1 -- 172.21.15.96:0/2174495890 >> v1:172.21.15.96:6789/0 conn(0x7f5c6406f940 legacy=0x7f5c641514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.918+0000 7f5c6a70b640 1 -- 172.21.15.96:0/2174495890 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6406a8b0 con 0x7f5c640c51c0 2023-12-01T23:46:21.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.920+0000 7f5c6a70b640 1 --2- 172.21.15.96:0/2174495890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c51c0 0x7f5c64161fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c7930 tx=0x7f5c5c02bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c61924f82144e6d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.924+0000 7f5c68f08640 1 -- 172.21.15.96:0/2174495890 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c02cb20 con 0x7f5c640c51c0 2023-12-01T23:46:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.924+0000 7f5c68f08640 1 -- 172.21.15.96:0/2174495890 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c02cc80 con 0x7f5c640c51c0 2023-12-01T23:46:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.924+0000 7f5c68f08640 1 -- 172.21.15.96:0/2174495890 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0343f0 con 0x7f5c640c51c0 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2174495890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c51c0 msgr2=0x7f5c64161fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2174495890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c51c0 0x7f5c64161fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c7930 tx=0x7f5c5c02bf80 comp rx=0 tx=0).stop 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2174495890 shutdown_connections 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2174495890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c51c0 0x7f5c64161fe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2174495890 >> v2:172.21.15.96:3300/0 conn(0x7f5c640c4de0 0x7f5c6406f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2174495890 >> 172.21.15.96:0/2174495890 conn(0x7f5c640c7f60 msgr2=0x7f5c640c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2174495890 shutdown_connections 2023-12-01T23:46:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.925+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2174495890 wait complete. 2023-12-01T23:46:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.926+0000 7f5c6c16e640 1 Processor -- start 2023-12-01T23:46:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.926+0000 7f5c6c16e640 1 -- start start 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c4de0 0x7f5c641478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c640c51c0 0x7f5c64147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64146300 con 0x7f5c6406f940 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641457f0 con 0x7f5c640c4de0 2023-12-01T23:46:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c6c16e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641f25d0 con 0x7f5c640c51c0 2023-12-01T23:46:21.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c69f0a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.927+0000 7f5c69709640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c4de0 0x7f5c641478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.928+0000 7f5c6a70b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c640c51c0 0x7f5c64147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:21.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.928+0000 7f5c69f0a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40314/0 (socket says 172.21.15.96:40314) 2023-12-01T23:46:21.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.928+0000 7f5c69f0a640 1 -- 172.21.15.96:0/2761638794 learned_addr learned my addr 172.21.15.96:0/2761638794 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:21.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.931+0000 7f5c69f0a640 1 -- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c640c51c0 msgr2=0x7f5c64147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.931+0000 7f5c69f0a640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c640c51c0 0x7f5c64147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.931+0000 7f5c69f0a640 1 -- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c4de0 msgr2=0x7f5c641478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:21.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.931+0000 7f5c69f0a640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c4de0 0x7f5c641478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:21.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.931+0000 7f5c69f0a640 1 -- 172.21.15.96:0/2761638794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009b30 con 0x7f5c6406f940 2023-12-01T23:46:21.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.933+0000 7f5c69f0a640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e9b0 tx=0x7f5c5400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.937+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54009670 con 0x7f5c6406f940 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.937+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400c9a0 con 0x7f5c6406f940 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.937+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400cd50 con 0x7f5c6406f940 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.937+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c641eefe0 con 0x7f5c6406f940 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.937+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c641ef560 con 0x7f5c6406f940 2023-12-01T23:46:21.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:21.938+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640c8340 con 0x7f5c6406f940 2023-12-01T23:46:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.181+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c54013470 con 0x7f5c6406f940 2023-12-01T23:46:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.181+0000 7f5c5a7fc640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 0x7f5c4806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.182+0000 7f5c69709640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 0x7f5c4806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.182+0000 7f5c69709640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 0x7f5c4806d380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c6406e690 tx=0x7f5c60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.196+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c54058d60 con 0x7f5c6406f940 2023-12-01T23:46:22.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.196+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c540550a0 con 0x7f5c6406f940 2023-12-01T23:46:22.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.371+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c6406ae70 con 0x7f5c4806aec0 2023-12-01T23:46:22.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.371+0000 7f5c5a7fc640 1 -- 172.21.15.96:0/2761638794 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c600014a0 con 0x7f5c4806aec0 2023-12-01T23:46:22.372 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 6 to deep-scrub 2023-12-01T23:46:22.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 msgr2=0x7f5c4806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 0x7f5c4806d380 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5c6406e690 tx=0x7f5c60009040 comp rx=0 tx=0).stop 2023-12-01T23:46:22.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 msgr2=0x7f5c64072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e9b0 tx=0x7f5c5400ee70 comp rx=0 tx=0).stop 2023-12-01T23:46:22.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 shutdown_connections 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5c4806aec0 0x7f5c4806d380 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c640c51c0 0x7f5c64147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c640c4de0 0x7f5c641478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 --2- 172.21.15.96:0/2761638794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c6406f940 0x7f5c64072070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 >> 172.21.15.96:0/2761638794 conn(0x7f5c640c7f60 msgr2=0x7f5c6414df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 shutdown_connections 2023-12-01T23:46:22.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.373+0000 7f5c6c16e640 1 -- 172.21.15.96:0/2761638794 wait complete. 2023-12-01T23:46:22.385 INFO:tasks.ceph:Scrubbing osd.7 2023-12-01T23:46:22.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-01T23:46:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.489+0000 7f7d10ad7640 1 Processor -- start 2023-12-01T23:46:22.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.489+0000 7f7d10ad7640 1 -- start start 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 0x7f7d0c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7d0c0ca420 0x7f7d0c151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0cd2d0 0x7f7d0c151870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c9a50 con 0x7f7d0c0ca420 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c9140 con 0x7f7d0c0ccef0 2023-12-01T23:46:22.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d10ad7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c158100 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d0a59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 0x7f7d0c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d03fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7d0c0ca420 0x7f7d0c151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.490+0000 7f7d0ad9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0cd2d0 0x7f7d0c151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.491+0000 7f7d03fff640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f7d0c0ca420 0x7f7d0c151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40324/0 (socket says 172.21.15.96:40324) 2023-12-01T23:46:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.491+0000 7f7d03fff640 1 -- 172.21.15.96:0/1736026932 learned_addr learned my addr 172.21.15.96:0/1736026932 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d03fff640 1 -- 172.21.15.96:0/1736026932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0cd2d0 msgr2=0x7f7d0c151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d03fff640 1 --2- 172.21.15.96:0/1736026932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0cd2d0 0x7f7d0c151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d03fff640 1 -- 172.21.15.96:0/1736026932 >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 msgr2=0x7f7d0c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d03fff640 1 --2- 172.21.15.96:0/1736026932 >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 0x7f7d0c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d03fff640 1 -- 172.21.15.96:0/1736026932 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c1583e0 con 0x7f7d0c0ca420 2023-12-01T23:46:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.493+0000 7f7d0a59c640 1 --2- 172.21.15.96:0/1736026932 >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 0x7f7d0c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.494+0000 7f7d03fff640 1 --2- 172.21.15.96:0/1736026932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c151330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c061a60 tx=0x7f7cf402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f336c81cd6407aff server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d09d9b640 1 -- 172.21.15.96:0/1736026932 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40317e0 con 0x7f7d0c0ca420 2023-12-01T23:46:22.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d09d9b640 1 -- 172.21.15.96:0/1736026932 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4031940 con 0x7f7d0c0ca420 2023-12-01T23:46:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d09d9b640 1 -- 172.21.15.96:0/1736026932 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4031cd0 con 0x7f7d0c0ca420 2023-12-01T23:46:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 -- 172.21.15.96:0/1736026932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 msgr2=0x7f7d0c151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/1736026932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c151330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c061a60 tx=0x7f7cf402b880 comp rx=0 tx=0).stop 2023-12-01T23:46:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 -- 172.21.15.96:0/1736026932 shutdown_connections 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/1736026932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0cd2d0 0x7f7d0c151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/1736026932 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c151330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/1736026932 >> v2:172.21.15.102:3300/0 conn(0x7f7d0c0ccef0 0x7f7d0c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 -- 172.21.15.96:0/1736026932 >> 172.21.15.96:0/1736026932 conn(0x7f7d0c060f20 msgr2=0x7f7d0c061300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 -- 172.21.15.96:0/1736026932 shutdown_connections 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.498+0000 7f7d10ad7640 1 -- 172.21.15.96:0/1736026932 wait complete. 2023-12-01T23:46:22.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 Processor -- start 2023-12-01T23:46:22.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 -- start start 2023-12-01T23:46:22.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c1ecc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0ccef0 0x7f7d0c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d0c0cd2d0 0x7f7d0c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c148a00 con 0x7f7d0c0ca420 2023-12-01T23:46:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c158780 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.500+0000 7f7d10ad7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1595a0 con 0x7f7d0c0ccef0 2023-12-01T23:46:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.501+0000 7f7d0a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c1ecc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.501+0000 7f7d03fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0ccef0 0x7f7d0c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.501+0000 7f7d0ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d0c0cd2d0 0x7f7d0c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.501+0000 7f7d0a59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c1ecc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40330/0 (socket says 172.21.15.96:40330) 2023-12-01T23:46:22.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.501+0000 7f7d0a59c640 1 -- 172.21.15.96:0/3253627633 learned_addr learned my addr 172.21.15.96:0/3253627633 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.505+0000 7f7d0ad9d640 1 -- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0ccef0 msgr2=0x7f7d0c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.505+0000 7f7d0ad9d640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d0c0ccef0 0x7f7d0c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.505+0000 7f7d0ad9d640 1 -- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 msgr2=0x7f7d0c1ecc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.505+0000 7f7d0ad9d640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d0c0ca420 0x7f7d0c1ecc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.505+0000 7f7d0ad9d640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009400 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.507+0000 7f7d0ad9d640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d0c0cd2d0 0x7f7d0c159a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0cd6e0 tx=0x7f7d0400c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.510+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400cc80 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.510+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400f040 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.510+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04014480 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.510+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf40094d0 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.510+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1589b0 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.511+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7d0c0c2580 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.530+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d040145e0 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.531+0000 7f7d02ffd640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7cec06ae40 0x7f7cec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.531+0000 7f7d0a59c640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7cec06ae40 0x7f7cec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.531+0000 7f7d0a59c640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7cec06ae40 0x7f7cec06d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d50 tx=0x7f7cfc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.532+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d040598f0 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.533+0000 7f7d02ffd640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f7cec074620 0x7f7cec076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.533+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7cec077190 con 0x7f7cec074620 2023-12-01T23:46:22.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.533+0000 7f7d03fff640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f7cec074620 0x7f7cec076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.533+0000 7f7d03fff640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f7cec074620 0x7f7cec076ac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.534+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d04055c30 con 0x7f7d0c0cd2d0 2023-12-01T23:46:22.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.534+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== osd.7 v2:172.21.15.102:6824/725358453 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7cec077190 con 0x7f7cec074620 2023-12-01T23:46:22.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.547+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 --> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7d0c0c96e0 con 0x7f7cec074620 2023-12-01T23:46:22.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.547+0000 7f7d02ffd640 1 -- 172.21.15.96:0/3253627633 <== osd.7 v2:172.21.15.102:6824/725358453 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7cf4031b30 con 0x7f7cec074620 2023-12-01T23:46:22.548 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-12-01T23:46:22.549 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-01T23:46:22.549 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-12-01T23:46:22.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.547+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f7cec074620 msgr2=0x7f7cec076ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.547+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:6824/725358453,v1:172.21.15.102:6825/725358453] conn(0x7f7cec074620 0x7f7cec076ac0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7cec06ae40 msgr2=0x7f7cec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f7cec06ae40 0x7f7cec06d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d50 tx=0x7f7cfc009190 comp rx=0 tx=0).stop 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d0c0cd2d0 msgr2=0x7f7d0c159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 --2- 172.21.15.96:0/3253627633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d0c0cd2d0 0x7f7d0c159a30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c0cd6e0 tx=0x7f7d0400c0c0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d0ad9d640 1 -- 172.21.15.96:0/3253627633 reap_dead start 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 shutdown_connections 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 >> 172.21.15.96:0/3253627633 conn(0x7f7d0c060f20 msgr2=0x7f7d0c0caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 shutdown_connections 2023-12-01T23:46:22.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.548+0000 7f7d10ad7640 1 -- 172.21.15.96:0/3253627633 wait complete. 2023-12-01T23:46:22.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-01T23:46:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.664+0000 7ff57a39e640 1 Processor -- start 2023-12-01T23:46:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.664+0000 7ff57a39e640 1 -- start start 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57a39e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5741501c0 0x7ff574159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57a39e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff574072b60 con 0x7ff574156e60 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57a39e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5740c1a90 con 0x7ff5740bff00 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57a39e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5741572d0 con 0x7ff5741501c0 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57893b640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7ff574156e60 0x7ff574071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47174/0 (socket says 172.21.15.96:47174) 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff57893b640 1 -- 172.21.15.96:0/646622733 learned_addr learned my addr 172.21.15.96:0/646622733 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.665+0000 7ff573fff640 1 --2- 172.21.15.96:0/646622733 >> v2:172.21.15.102:3300/0 conn(0x7ff5741501c0 0x7ff574159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.668+0000 7ff572ffd640 1 -- 172.21.15.96:0/646622733 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203725092 0 0) 0x7ff574072b60 con 0x7ff574156e60 2023-12-01T23:46:22.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.668+0000 7ff572ffd640 1 -- 172.21.15.96:0/646622733 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff55c003520 con 0x7ff574156e60 2023-12-01T23:46:22.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.668+0000 7ff573fff640 1 -- 172.21.15.96:0/646622733 >> v1:172.21.15.102:6789/0 conn(0x7ff5740bff00 legacy=0x7ff574072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.668+0000 7ff573fff640 1 -- 172.21.15.96:0/646622733 >> v1:172.21.15.96:6789/0 conn(0x7ff574156e60 legacy=0x7ff574071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.668+0000 7ff573fff640 1 -- 172.21.15.96:0/646622733 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740c1d30 con 0x7ff5741501c0 2023-12-01T23:46:22.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.671+0000 7ff573fff640 1 --2- 172.21.15.96:0/646622733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff574159860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5640097a0 tx=0x7ff56402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187680b8b6203b39 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff572ffd640 1 -- 172.21.15.96:0/646622733 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56402f810 con 0x7ff5741501c0 2023-12-01T23:46:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff572ffd640 1 -- 172.21.15.96:0/646622733 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56402f970 con 0x7ff5741501c0 2023-12-01T23:46:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff572ffd640 1 -- 172.21.15.96:0/646622733 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56402fd00 con 0x7ff5741501c0 2023-12-01T23:46:22.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 -- 172.21.15.96:0/646622733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 msgr2=0x7ff574159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 --2- 172.21.15.96:0/646622733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff574159860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5640097a0 tx=0x7ff56402b9f0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 -- 172.21.15.96:0/646622733 shutdown_connections 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 --2- 172.21.15.96:0/646622733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff574159860 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 -- 172.21.15.96:0/646622733 >> 172.21.15.96:0/646622733 conn(0x7ff57406cd60 msgr2=0x7ff57406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 -- 172.21.15.96:0/646622733 shutdown_connections 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.676+0000 7ff57a39e640 1 -- 172.21.15.96:0/646622733 wait complete. 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 Processor -- start 2023-12-01T23:46:22.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 -- start start 2023-12-01T23:46:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 0x7ff5741f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff5741ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 0x7ff5741e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574150c80 con 0x7ff574156e60 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741f0b40 con 0x7ff5741501c0 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.678+0000 7ff57a39e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740c71d0 con 0x7ff5740bff00 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.679+0000 7ff57893b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 0x7ff5741e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.679+0000 7ff5737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff5741ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.679+0000 7ff573fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 0x7ff5741f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.679+0000 7ff57893b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 0x7ff5741e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40346/0 (socket says 172.21.15.96:40346) 2023-12-01T23:46:22.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.679+0000 7ff57893b640 1 -- 172.21.15.96:0/1676420950 learned_addr learned my addr 172.21.15.96:0/1676420950 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.683+0000 7ff573fff640 1 -- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 msgr2=0x7ff5741ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.683+0000 7ff573fff640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff5741ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.683+0000 7ff573fff640 1 -- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 msgr2=0x7ff5741e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.683+0000 7ff573fff640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 0x7ff5741e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:22.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.683+0000 7ff573fff640 1 -- 172.21.15.96:0/1676420950 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009400 con 0x7ff5740bff00 2023-12-01T23:46:22.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.685+0000 7ff573fff640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 0x7ff5741f0fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff564033000 tx=0x7ff564004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.689+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56403c040 con 0x7ff5740bff00 2023-12-01T23:46:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.689+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5640378f0 con 0x7ff5740bff00 2023-12-01T23:46:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.689+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564037ca0 con 0x7ff5740bff00 2023-12-01T23:46:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.689+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff574156020 con 0x7ff5740bff00 2023-12-01T23:46:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.689+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5741f07d0 con 0x7ff5740bff00 2023-12-01T23:46:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.690+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff574156300 con 0x7ff5740bff00 2023-12-01T23:46:22.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.709+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5640403e0 con 0x7ff5740bff00 2023-12-01T23:46:22.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.709+0000 7ff570ff9640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:22.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.709+0000 7ff5737fe640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:22.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.710+0000 7ff5737fe640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 0x7ff56006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c83d0 tx=0x7ff568009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:22.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.936+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff56407a2e0 con 0x7ff5740bff00 2023-12-01T23:46:22.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:22.948+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff564076620 con 0x7ff5740bff00 2023-12-01T23:46:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.115+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff574156660 con 0x7ff56006ae40 2023-12-01T23:46:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.115+0000 7ff570ff9640 1 -- 172.21.15.96:0/1676420950 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff568001d10 con 0x7ff56006ae40 2023-12-01T23:46:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 7 to deep-scrub 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 msgr2=0x7ff56006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 0x7ff56006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c83d0 tx=0x7ff568009040 comp rx=0 tx=0).stop 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 msgr2=0x7ff5741f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 0x7ff5741f0fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff564033000 tx=0x7ff564004730 comp rx=0 tx=0).stop 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 shutdown_connections 2023-12-01T23:46:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff56006ae40 0x7ff56006d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff574156e60 0x7ff5741e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5741501c0 0x7ff5741ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 --2- 172.21.15.96:0/1676420950 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5740bff00 0x7ff5741f0fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 >> 172.21.15.96:0/1676420950 conn(0x7ff57406cd60 msgr2=0x7ff57406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 shutdown_connections 2023-12-01T23:46:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.117+0000 7ff57a39e640 1 -- 172.21.15.96:0/1676420950 wait complete. 2023-12-01T23:46:23.129 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:46:23.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.227+0000 7f768f4e7640 1 Processor -- start 2023-12-01T23:46:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 -- start start 2023-12-01T23:46:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7688153890 0x7f768815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153c70 0x7f76880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768815a700 con 0x7f76880ceef0 2023-12-01T23:46:23.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76880ca870 con 0x7f7688153890 2023-12-01T23:46:23.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.228+0000 7f768f4e7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7688159af0 con 0x7f7688153c70 2023-12-01T23:46:23.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.229+0000 7f768ca82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153c70 0x7f76880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.229+0000 7f768da84640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f76880ceef0 0x7f768815aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:47184/0 (socket says 172.21.15.96:47184) 2023-12-01T23:46:23.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.229+0000 7f768da84640 1 -- 172.21.15.96:0/4265257728 learned_addr learned my addr 172.21.15.96:0/4265257728 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:46:23.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.229+0000 7f768d283640 1 --2- 172.21.15.96:0/4265257728 >> v2:172.21.15.102:3300/0 conn(0x7f7688153890 0x7f768815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f767bfff640 1 -- 172.21.15.96:0/4265257728 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574290163 0 0) 0x7f768815a700 con 0x7f76880ceef0 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f767bfff640 1 -- 172.21.15.96:0/4265257728 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7674003520 con 0x7f76880ceef0 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f768d283640 1 -- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153c70 msgr2=0x7f76880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f768d283640 1 --2- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153c70 0x7f76880c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f768d283640 1 -- 172.21.15.96:0/4265257728 >> v1:172.21.15.96:6789/0 conn(0x7f76880ceef0 legacy=0x7f768815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.232+0000 7f768d283640 1 -- 172.21.15.96:0/4265257728 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7688159dd0 con 0x7f7688153890 2023-12-01T23:46:23.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.234+0000 7f768d283640 1 --2- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7688153890 0x7f768815d950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097a0 tx=0x7f767c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7da2cd64a2a70b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:23.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f767bfff640 1 -- 172.21.15.96:0/4265257728 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c030610 con 0x7f7688153890 2023-12-01T23:46:23.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f767bfff640 1 -- 172.21.15.96:0/4265257728 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c030770 con 0x7f7688153890 2023-12-01T23:46:23.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f767bfff640 1 -- 172.21.15.96:0/4265257728 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c030b00 con 0x7f7688153890 2023-12-01T23:46:23.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 -- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7688153890 msgr2=0x7f768815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7688153890 0x7f768815d950 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097a0 tx=0x7f767c02b960 comp rx=0 tx=0).stop 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 -- 172.21.15.96:0/4265257728 shutdown_connections 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153c70 0x7f76880c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4265257728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7688153890 0x7f768815d950 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 -- 172.21.15.96:0/4265257728 >> 172.21.15.96:0/4265257728 conn(0x7f768806ba00 msgr2=0x7f768806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 -- 172.21.15.96:0/4265257728 shutdown_connections 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.238+0000 7f768f4e7640 1 -- 172.21.15.96:0/4265257728 wait complete. 2023-12-01T23:46:23.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.239+0000 7f768f4e7640 1 Processor -- start 2023-12-01T23:46:23.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 -- start start 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76880ceef0 0x7f7688154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 0x7f76881f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b4880 con 0x7f7688153c70 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7688154a40 con 0x7f76880ceef0 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.240+0000 7f768f4e7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b34d0 con 0x7f7688153890 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768da84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768ca82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 0x7f76881f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768d283640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76880ceef0 0x7f7688154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768da84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:40352/0 (socket says 172.21.15.96:40352) 2023-12-01T23:46:23.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768ca82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 0x7f76881f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:33440/0 (socket says 172.21.15.96:33440) 2023-12-01T23:46:23.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.241+0000 7f768da84640 1 -- 172.21.15.96:0/4011703100 learned_addr learned my addr 172.21.15.96:0/4011703100 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:23.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.244+0000 7f768da84640 1 -- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 msgr2=0x7f76881f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.244+0000 7f768da84640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 0x7f76881f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.244+0000 7f768da84640 1 -- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76880ceef0 msgr2=0x7f7688154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.244+0000 7f768da84640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76880ceef0 0x7f7688154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.244+0000 7f768da84640 1 -- 172.21.15.96:0/4011703100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009400 con 0x7f7688153c70 2023-12-01T23:46:23.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.246+0000 7f768da84640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f768000cb70 tx=0x7f768000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.250+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000ad40 con 0x7f7688153c70 2023-12-01T23:46:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.250+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680012400 con 0x7f7688153c70 2023-12-01T23:46:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.250+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000aea0 con 0x7f7688153c70 2023-12-01T23:46:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.250+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880ce7f0 con 0x7f7688153c70 2023-12-01T23:46:23.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.250+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880b36c0 con 0x7f7688153c70 2023-12-01T23:46:23.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.251+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880b49c0 con 0x7f7688153c70 2023-12-01T23:46:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.268+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7680007070 con 0x7f7688153c70 2023-12-01T23:46:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.269+0000 7f7679ffb640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 0x7f766c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.269+0000 7f768d283640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 0x7f766c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:23.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.269+0000 7f768d283640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 0x7f766c06d350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f767c036000 tx=0x7f767c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:23.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.271+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f76800586e0 con 0x7f7688153c70 2023-12-01T23:46:23.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.505+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7680054a20 con 0x7f7688153c70 2023-12-01T23:46:23.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.685+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76881597a0 con 0x7f766c06ae90 2023-12-01T23:46:23.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.694+0000 7f7679ffb640 1 -- 172.21.15.96:0/4011703100 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369851 (secure 0 0 0) 0x7f767c0308e0 con 0x7f766c06ae90 2023-12-01T23:46:23.698 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:23.700 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 msgr2=0x7f766c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 0x7f766c06d350 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f767c036000 tx=0x7f767c008030 comp rx=0 tx=0).stop 2023-12-01T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 msgr2=0x7f76880c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f768000cb70 tx=0x7f768000a430 comp rx=0 tx=0).stop 2023-12-01T23:46:23.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 shutdown_connections 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f766c06ae90 0x7f766c06d350 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7688153c70 0x7f76880c3ee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7688153890 0x7f76881f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 --2- 172.21.15.96:0/4011703100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76880ceef0 0x7f7688154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 >> 172.21.15.96:0/4011703100 conn(0x7f768806ba00 msgr2=0x7f768815b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 shutdown_connections 2023-12-01T23:46:23.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:23.697+0000 7f768f4e7640 1 -- 172.21.15.96:0/4011703100 wait complete. 2023-12-01T23:46:23.709 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":868,"stamp":"2023-12-01T23:46:22.179003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15659,"ondisk_log_size":15659,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002982"},"pg_stats":[{"pgid":"2.1f","version":"29'584","reported_seq":617,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.562196+0000","last_change":"2023-12-01T23:18:27.886789+0000","last_active":"2023-12-01T23:46:01.562196+0000","last_peered":"2023-12-01T23:46:01.562196+0000","last_clean":"2023-12-01T23:46:01.562196+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:01.562196+0000","last_undegraded":"2023-12-01T23:46:01.562196+0000","last_fullsized":"2023-12-01T23:46:01.562196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.488155+0000","last_change":"2023-12-01T23:18:28.871826+0000","last_active":"2023-12-01T23:46:07.488155+0000","last_peered":"2023-12-01T23:46:07.488155+0000","last_clean":"2023-12-01T23:46:07.488155+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:07.488155+0000","last_undegraded":"2023-12-01T23:46:07.488155+0000","last_fullsized":"2023-12-01T23:46:07.488155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:21.572489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137759+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.137759+0000","last_peered":"2023-12-01T23:45:40.137759+0000","last_clean":"2023-12-01T23:45:40.137759+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.137759+0000","last_undegraded":"2023-12-01T23:45:40.137759+0000","last_fullsized":"2023-12-01T23:45:40.137759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'721","reported_seq":753,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.383573+0000","last_change":"2023-12-01T23:18:27.835021+0000","last_active":"2023-12-01T23:45:48.383573+0000","last_peered":"2023-12-01T23:45:48.383573+0000","last_clean":"2023-12-01T23:45:48.383573+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:45:48.383573+0000","last_undegraded":"2023-12-01T23:45:48.383573+0000","last_fullsized":"2023-12-01T23:45:48.383573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506353+0000","last_change":"2023-12-01T23:18:28.877295+0000","last_active":"2023-12-01T23:46:07.506353+0000","last_peered":"2023-12-01T23:46:07.506353+0000","last_clean":"2023-12-01T23:46:07.506353+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:07.506353+0000","last_undegraded":"2023-12-01T23:46:07.506353+0000","last_fullsized":"2023-12-01T23:46:07.506353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:35.302116+0000","last_change":"2023-12-01T23:19:06.103620+0000","last_active":"2023-12-01T23:45:35.302116+0000","last_peered":"2023-12-01T23:45:35.302116+0000","last_clean":"2023-12-01T23:45:35.302116+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:45:35.302116+0000","last_undegraded":"2023-12-01T23:45:35.302116+0000","last_fullsized":"2023-12-01T23:45:35.302116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:18:06.190136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1374","reported_seq":1404,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565136+0000","last_change":"2023-12-01T23:18:27.894281+0000","last_active":"2023-12-01T23:45:58.565136+0000","last_peered":"2023-12-01T23:45:58.565136+0000","last_clean":"2023-12-01T23:45:58.565136+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:45:58.565136+0000","last_undegraded":"2023-12-01T23:45:58.565136+0000","last_fullsized":"2023-12-01T23:45:58.565136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1374,"log_dups_size":0,"ondisk_log_size":1374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:15:20.452665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504046+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:46:07.504046+0000","last_peered":"2023-12-01T23:46:07.504046+0000","last_clean":"2023-12-01T23:46:07.504046+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:07.504046+0000","last_undegraded":"2023-12-01T23:46:07.504046+0000","last_fullsized":"2023-12-01T23:46:07.504046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143603+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:45:40.143603+0000","last_peered":"2023-12-01T23:45:40.143603+0000","last_clean":"2023-12-01T23:45:40.143603+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:45:40.143603+0000","last_undegraded":"2023-12-01T23:45:40.143603+0000","last_fullsized":"2023-12-01T23:45:40.143603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:07.974643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:59.111214+0000","last_change":"2023-12-01T23:18:27.893253+0000","last_active":"2023-12-01T23:45:59.111214+0000","last_peered":"2023-12-01T23:45:59.111214+0000","last_clean":"2023-12-01T23:45:59.111214+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:45:59.111214+0000","last_undegraded":"2023-12-01T23:45:59.111214+0000","last_fullsized":"2023-12-01T23:45:59.111214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504109+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:46:07.504109+0000","last_peered":"2023-12-01T23:46:07.504109+0000","last_clean":"2023-12-01T23:46:07.504109+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:07.504109+0000","last_undegraded":"2023-12-01T23:46:07.504109+0000","last_fullsized":"2023-12-01T23:46:07.504109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":174,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:33.156414+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:45:33.156414+0000","last_peered":"2023-12-01T23:45:33.156414+0000","last_clean":"2023-12-01T23:45:33.156414+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:45:33.156414+0000","last_undegraded":"2023-12-01T23:45:33.156414+0000","last_fullsized":"2023-12-01T23:45:33.156414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:40.253986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588270+0000","last_change":"2023-12-01T23:18:28.870563+0000","last_active":"2023-12-01T23:46:07.588270+0000","last_peered":"2023-12-01T23:46:07.588270+0000","last_clean":"2023-12-01T23:46:07.588270+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:07.588270+0000","last_undegraded":"2023-12-01T23:46:07.588270+0000","last_fullsized":"2023-12-01T23:46:07.588270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:47:12.106982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'634","reported_seq":665,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.532741+0000","last_change":"2023-12-01T23:18:27.890568+0000","last_active":"2023-12-01T23:45:58.532741+0000","last_peered":"2023-12-01T23:45:58.532741+0000","last_clean":"2023-12-01T23:45:58.532741+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:45:58.532741+0000","last_undegraded":"2023-12-01T23:45:58.532741+0000","last_fullsized":"2023-12-01T23:45:58.532741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:43.563896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.284663+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:45:39.284663+0000","last_peered":"2023-12-01T23:45:39.284663+0000","last_clean":"2023-12-01T23:45:39.284663+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:45:39.284663+0000","last_undegraded":"2023-12-01T23:45:39.284663+0000","last_fullsized":"2023-12-01T23:45:39.284663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:21:08.307666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491511+0000","last_change":"2023-12-01T23:18:28.857191+0000","last_active":"2023-12-01T23:46:07.491511+0000","last_peered":"2023-12-01T23:46:07.491511+0000","last_clean":"2023-12-01T23:46:07.491511+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:07.491511+0000","last_undegraded":"2023-12-01T23:46:07.491511+0000","last_fullsized":"2023-12-01T23:46:07.491511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:51.379008+0000","last_change":"2023-12-01T23:18:27.831823+0000","last_active":"2023-12-01T23:45:51.379008+0000","last_peered":"2023-12-01T23:45:51.379008+0000","last_clean":"2023-12-01T23:45:51.379008+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:45:51.379008+0000","last_undegraded":"2023-12-01T23:45:51.379008+0000","last_fullsized":"2023-12-01T23:45:51.379008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":209,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143684+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143684+0000","last_peered":"2023-12-01T23:45:40.143684+0000","last_clean":"2023-12-01T23:45:40.143684+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143684+0000","last_undegraded":"2023-12-01T23:45:40.143684+0000","last_fullsized":"2023-12-01T23:45:40.143684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507118+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:46:07.507118+0000","last_peered":"2023-12-01T23:46:07.507118+0000","last_clean":"2023-12-01T23:46:07.507118+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:07.507118+0000","last_undegraded":"2023-12-01T23:46:07.507118+0000","last_fullsized":"2023-12-01T23:46:07.507118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.443544+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:45:52.443544+0000","last_peered":"2023-12-01T23:45:52.443544+0000","last_clean":"2023-12-01T23:45:52.443544+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:45:52.443544+0000","last_undegraded":"2023-12-01T23:45:52.443544+0000","last_fullsized":"2023-12-01T23:45:52.443544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.154704+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:40.154704+0000","last_peered":"2023-12-01T23:45:40.154704+0000","last_clean":"2023-12-01T23:45:40.154704+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:40.154704+0000","last_undegraded":"2023-12-01T23:45:40.154704+0000","last_fullsized":"2023-12-01T23:45:40.154704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.994567+0000","last_change":"2023-12-01T23:18:28.872858+0000","last_active":"2023-12-01T23:45:37.994567+0000","last_peered":"2023-12-01T23:45:37.994567+0000","last_clean":"2023-12-01T23:45:37.994567+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:45:37.994567+0000","last_undegraded":"2023-12-01T23:45:37.994567+0000","last_fullsized":"2023-12-01T23:45:37.994567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:58.139936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.470358+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:45:56.470358+0000","last_peered":"2023-12-01T23:45:56.470358+0000","last_clean":"2023-12-01T23:45:56.470358+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:45:56.470358+0000","last_undegraded":"2023-12-01T23:45:56.470358+0000","last_fullsized":"2023-12-01T23:45:56.470358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:59.948115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.849137+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:45:37.849137+0000","last_peered":"2023-12-01T23:45:37.849137+0000","last_clean":"2023-12-01T23:45:37.849137+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:45:37.849137+0000","last_undegraded":"2023-12-01T23:45:37.849137+0000","last_fullsized":"2023-12-01T23:45:37.849137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504250+0000","last_change":"2023-12-01T23:18:28.857041+0000","last_active":"2023-12-01T23:46:07.504250+0000","last_peered":"2023-12-01T23:46:07.504250+0000","last_clean":"2023-12-01T23:46:07.504250+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:07.504250+0000","last_undegraded":"2023-12-01T23:46:07.504250+0000","last_fullsized":"2023-12-01T23:46:07.504250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.891567+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:06.775470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135804+0000","last_change":"2023-12-01T23:18:34.792070+0000","last_active":"2023-12-01T23:45:39.135804+0000","last_peered":"2023-12-01T23:45:39.135804+0000","last_clean":"2023-12-01T23:45:39.135804+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:45:39.135804+0000","last_undegraded":"2023-12-01T23:45:39.135804+0000","last_fullsized":"2023-12-01T23:45:39.135804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:16:01.992491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511306+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:46:07.511306+0000","last_peered":"2023-12-01T23:46:07.511306+0000","last_clean":"2023-12-01T23:46:07.511306+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:07.511306+0000","last_undegraded":"2023-12-01T23:46:07.511306+0000","last_fullsized":"2023-12-01T23:46:07.511306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'309","reported_seq":341,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:06.805651+0000","last_change":"2023-12-01T23:18:27.892057+0000","last_active":"2023-12-01T23:46:06.805651+0000","last_peered":"2023-12-01T23:46:06.805651+0000","last_clean":"2023-12-01T23:46:06.805651+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:06.805651+0000","last_undegraded":"2023-12-01T23:46:06.805651+0000","last_fullsized":"2023-12-01T23:46:06.805651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.975866+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:45:37.975866+0000","last_peered":"2023-12-01T23:45:37.975866+0000","last_clean":"2023-12-01T23:45:37.975866+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:45:37.975866+0000","last_undegraded":"2023-12-01T23:45:37.975866+0000","last_fullsized":"2023-12-01T23:45:37.975866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:45:10.618019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429149+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:46:07.429149+0000","last_peered":"2023-12-01T23:46:07.429149+0000","last_clean":"2023-12-01T23:46:07.429149+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:07.429149+0000","last_undegraded":"2023-12-01T23:46:07.429149+0000","last_fullsized":"2023-12-01T23:46:07.429149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:50.389391+0000","last_change":"2023-12-01T23:18:27.893904+0000","last_active":"2023-12-01T23:45:50.389391+0000","last_peered":"2023-12-01T23:45:50.389391+0000","last_clean":"2023-12-01T23:45:50.389391+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:45:50.389391+0000","last_undegraded":"2023-12-01T23:45:50.389391+0000","last_fullsized":"2023-12-01T23:45:50.389391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.135298+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:45:40.135298+0000","last_peered":"2023-12-01T23:45:40.135298+0000","last_clean":"2023-12-01T23:45:40.135298+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:45:40.135298+0000","last_undegraded":"2023-12-01T23:45:40.135298+0000","last_fullsized":"2023-12-01T23:45:40.135298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507506+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:46:07.507506+0000","last_peered":"2023-12-01T23:46:07.507506+0000","last_clean":"2023-12-01T23:46:07.507506+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:07.507506+0000","last_undegraded":"2023-12-01T23:46:07.507506+0000","last_fullsized":"2023-12-01T23:46:07.507506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988848+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:41.988848+0000","last_peered":"2023-12-01T23:45:41.988848+0000","last_clean":"2023-12-01T23:45:41.988848+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:41.988848+0000","last_undegraded":"2023-12-01T23:45:41.988848+0000","last_fullsized":"2023-12-01T23:45:41.988848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447483+0000","last_change":"2023-12-01T23:18:28.876973+0000","last_active":"2023-12-01T23:46:07.447483+0000","last_peered":"2023-12-01T23:46:07.447483+0000","last_clean":"2023-12-01T23:46:07.447483+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:07.447483+0000","last_undegraded":"2023-12-01T23:46:07.447483+0000","last_fullsized":"2023-12-01T23:46:07.447483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:28.978217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565477+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:45:58.565477+0000","last_peered":"2023-12-01T23:45:58.565477+0000","last_clean":"2023-12-01T23:45:58.565477+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:45:58.565477+0000","last_undegraded":"2023-12-01T23:45:58.565477+0000","last_fullsized":"2023-12-01T23:45:58.565477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:43.600556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988880+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:41.988880+0000","last_peered":"2023-12-01T23:45:41.988880+0000","last_clean":"2023-12-01T23:45:41.988880+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:41.988880+0000","last_undegraded":"2023-12-01T23:45:41.988880+0000","last_fullsized":"2023-12-01T23:45:41.988880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.425062+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:07.425062+0000","last_peered":"2023-12-01T23:46:07.425062+0000","last_clean":"2023-12-01T23:46:07.425062+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:07.425062+0000","last_undegraded":"2023-12-01T23:46:07.425062+0000","last_fullsized":"2023-12-01T23:46:07.425062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2094,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.534843+0000","last_change":"2023-12-01T23:18:27.825995+0000","last_active":"2023-12-01T23:46:01.534843+0000","last_peered":"2023-12-01T23:46:01.534843+0000","last_clean":"2023-12-01T23:46:01.534843+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:01.534843+0000","last_undegraded":"2023-12-01T23:46:01.534843+0000","last_fullsized":"2023-12-01T23:46:01.534843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:38.410973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.162571+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:45:39.162571+0000","last_peered":"2023-12-01T23:45:39.162571+0000","last_clean":"2023-12-01T23:45:39.162571+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:45:39.162571+0000","last_undegraded":"2023-12-01T23:45:39.162571+0000","last_fullsized":"2023-12-01T23:45:39.162571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506557+0000","last_change":"2023-12-01T23:18:28.871518+0000","last_active":"2023-12-01T23:46:07.506557+0000","last_peered":"2023-12-01T23:46:07.506557+0000","last_clean":"2023-12-01T23:46:07.506557+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:07.506557+0000","last_undegraded":"2023-12-01T23:46:07.506557+0000","last_fullsized":"2023-12-01T23:46:07.506557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'521","reported_seq":553,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446851+0000","last_change":"2023-12-01T23:18:27.889364+0000","last_active":"2023-12-01T23:45:52.446851+0000","last_peered":"2023-12-01T23:45:52.446851+0000","last_clean":"2023-12-01T23:45:52.446851+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:45:52.446851+0000","last_undegraded":"2023-12-01T23:45:52.446851+0000","last_fullsized":"2023-12-01T23:45:52.446851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:05:26.676126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.129826+0000","last_change":"2023-12-01T23:18:34.840445+0000","last_active":"2023-12-01T23:45:40.129826+0000","last_peered":"2023-12-01T23:45:40.129826+0000","last_clean":"2023-12-01T23:45:40.129826+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:45:40.129826+0000","last_undegraded":"2023-12-01T23:45:40.129826+0000","last_fullsized":"2023-12-01T23:45:40.129826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.499828+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:46:07.499828+0000","last_peered":"2023-12-01T23:46:07.499828+0000","last_clean":"2023-12-01T23:46:07.499828+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:07.499828+0000","last_undegraded":"2023-12-01T23:46:07.499828+0000","last_fullsized":"2023-12-01T23:46:07.499828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:22:57.267218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.085700+0000","last_change":"2023-12-01T23:18:27.887167+0000","last_active":"2023-12-01T23:45:34.085700+0000","last_peered":"2023-12-01T23:45:34.085700+0000","last_clean":"2023-12-01T23:45:34.085700+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:45:34.085700+0000","last_undegraded":"2023-12-01T23:45:34.085700+0000","last_fullsized":"2023-12-01T23:45:34.085700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:52:04.088757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:42:24.091255+0000","last_change":"2023-12-01T23:18:16.123632+0000","last_active":"2023-12-01T23:42:24.091255+0000","last_peered":"2023-12-01T23:42:24.091255+0000","last_clean":"2023-12-01T23:42:24.091255+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:42:24.091255+0000","last_undegraded":"2023-12-01T23:42:24.091255+0000","last_fullsized":"2023-12-01T23:42:24.091255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:14.448978+0000","last_clean_scrub_stamp":"2023-12-01T23:18:14.448978+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:51.988973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":215,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152410+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:45:40.152410+0000","last_peered":"2023-12-01T23:45:40.152410+0000","last_clean":"2023-12-01T23:45:40.152410+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:45:40.152410+0000","last_undegraded":"2023-12-01T23:45:40.152410+0000","last_fullsized":"2023-12-01T23:45:40.152410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:03.354674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578898+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:46:07.578898+0000","last_peered":"2023-12-01T23:46:07.578898+0000","last_clean":"2023-12-01T23:46:07.578898+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:46:07.578898+0000","last_undegraded":"2023-12-01T23:46:07.578898+0000","last_fullsized":"2023-12-01T23:46:07.578898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:58.252568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317219+0000","last_change":"2023-12-01T23:18:27.887400+0000","last_active":"2023-12-01T23:45:46.317219+0000","last_peered":"2023-12-01T23:45:46.317219+0000","last_clean":"2023-12-01T23:45:46.317219+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:45:46.317219+0000","last_undegraded":"2023-12-01T23:45:46.317219+0000","last_fullsized":"2023-12-01T23:45:46.317219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:02:27.858393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:34.581319+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:45:34.581319+0000","last_peered":"2023-12-01T23:45:34.581319+0000","last_clean":"2023-12-01T23:45:34.581319+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:45:34.581319+0000","last_undegraded":"2023-12-01T23:45:34.581319+0000","last_fullsized":"2023-12-01T23:45:34.581319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:17:08.523167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429551+0000","last_change":"2023-12-01T23:19:06.056259+0000","last_active":"2023-12-01T23:46:07.429551+0000","last_peered":"2023-12-01T23:46:07.429551+0000","last_clean":"2023-12-01T23:46:07.429551+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:07.429551+0000","last_undegraded":"2023-12-01T23:46:07.429551+0000","last_fullsized":"2023-12-01T23:46:07.429551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:12:02.070575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.557295+0000","last_change":"2023-12-01T23:18:27.832460+0000","last_active":"2023-12-01T23:46:01.557295+0000","last_peered":"2023-12-01T23:46:01.557295+0000","last_clean":"2023-12-01T23:46:01.557295+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:01.557295+0000","last_undegraded":"2023-12-01T23:46:01.557295+0000","last_fullsized":"2023-12-01T23:46:01.557295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":223,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.272040+0000","last_change":"2023-12-01T23:19:06.163021+0000","last_active":"2023-12-01T23:45:39.272040+0000","last_peered":"2023-12-01T23:45:39.272040+0000","last_clean":"2023-12-01T23:45:39.272040+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:45:39.272040+0000","last_undegraded":"2023-12-01T23:45:39.272040+0000","last_fullsized":"2023-12-01T23:45:39.272040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578723+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.578723+0000","last_peered":"2023-12-01T23:46:07.578723+0000","last_clean":"2023-12-01T23:46:07.578723+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.578723+0000","last_undegraded":"2023-12-01T23:46:07.578723+0000","last_fullsized":"2023-12-01T23:46:07.578723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:46:09.447515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:43.162322+0000","last_change":"2023-12-01T23:18:27.826123+0000","last_active":"2023-12-01T23:45:43.162322+0000","last_peered":"2023-12-01T23:45:43.162322+0000","last_clean":"2023-12-01T23:45:43.162322+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:45:43.162322+0000","last_undegraded":"2023-12-01T23:45:43.162322+0000","last_fullsized":"2023-12-01T23:45:43.162322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:33:57.020112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.280157+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:45:39.280157+0000","last_peered":"2023-12-01T23:45:39.280157+0000","last_clean":"2023-12-01T23:45:39.280157+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:45:39.280157+0000","last_undegraded":"2023-12-01T23:45:39.280157+0000","last_fullsized":"2023-12-01T23:45:39.280157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:54:04.395230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575841+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.575841+0000","last_peered":"2023-12-01T23:46:07.575841+0000","last_clean":"2023-12-01T23:46:07.575841+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:46:07.575841+0000","last_undegraded":"2023-12-01T23:46:07.575841+0000","last_fullsized":"2023-12-01T23:46:07.575841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:45:57.620732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.564741+0000","last_change":"2023-12-01T23:18:27.834828+0000","last_active":"2023-12-01T23:45:58.564741+0000","last_peered":"2023-12-01T23:45:58.564741+0000","last_clean":"2023-12-01T23:45:58.564741+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:45:58.564741+0000","last_undegraded":"2023-12-01T23:45:58.564741+0000","last_fullsized":"2023-12-01T23:45:58.564741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:53:13.658150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135509+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:45:39.135509+0000","last_peered":"2023-12-01T23:45:39.135509+0000","last_clean":"2023-12-01T23:45:39.135509+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:45:39.135509+0000","last_undegraded":"2023-12-01T23:45:39.135509+0000","last_fullsized":"2023-12-01T23:45:39.135509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:07.443860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.575888+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:46:07.575888+0000","last_peered":"2023-12-01T23:46:07.575888+0000","last_clean":"2023-12-01T23:46:07.575888+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:07.575888+0000","last_undegraded":"2023-12-01T23:46:07.575888+0000","last_fullsized":"2023-12-01T23:46:07.575888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:46.317486+0000","last_change":"2023-12-01T23:18:27.834708+0000","last_active":"2023-12-01T23:45:46.317486+0000","last_peered":"2023-12-01T23:45:46.317486+0000","last_clean":"2023-12-01T23:45:46.317486+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:45:46.317486+0000","last_undegraded":"2023-12-01T23:45:46.317486+0000","last_fullsized":"2023-12-01T23:45:46.317486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:08.151813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":157,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137856+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:45:40.137856+0000","last_peered":"2023-12-01T23:45:40.137856+0000","last_clean":"2023-12-01T23:45:40.137856+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:45:40.137856+0000","last_undegraded":"2023-12-01T23:45:40.137856+0000","last_fullsized":"2023-12-01T23:45:40.137856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.586320+0000","last_change":"2023-12-01T23:18:28.866548+0000","last_active":"2023-12-01T23:46:07.586320+0000","last_peered":"2023-12-01T23:46:07.586320+0000","last_clean":"2023-12-01T23:46:07.586320+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:07.586320+0000","last_undegraded":"2023-12-01T23:46:07.586320+0000","last_fullsized":"2023-12-01T23:46:07.586320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:39.219710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:48.384828+0000","last_change":"2023-12-01T23:18:27.895520+0000","last_active":"2023-12-01T23:45:48.384828+0000","last_peered":"2023-12-01T23:45:48.384828+0000","last_clean":"2023-12-01T23:45:48.384828+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:45:48.384828+0000","last_undegraded":"2023-12-01T23:45:48.384828+0000","last_fullsized":"2023-12-01T23:45:48.384828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:33.550423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.278999+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:39.278999+0000","last_peered":"2023-12-01T23:45:39.278999+0000","last_clean":"2023-12-01T23:45:39.278999+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:39.278999+0000","last_undegraded":"2023-12-01T23:45:39.278999+0000","last_fullsized":"2023-12-01T23:45:39.278999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:26:28.739907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.432398+0000","last_change":"2023-12-01T23:19:06.056474+0000","last_active":"2023-12-01T23:46:07.432398+0000","last_peered":"2023-12-01T23:46:07.432398+0000","last_clean":"2023-12-01T23:46:07.432398+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:07.432398+0000","last_undegraded":"2023-12-01T23:46:07.432398+0000","last_fullsized":"2023-12-01T23:46:07.432398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:00.298932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565262+0000","last_change":"2023-12-01T23:18:27.886420+0000","last_active":"2023-12-01T23:45:58.565262+0000","last_peered":"2023-12-01T23:45:58.565262+0000","last_clean":"2023-12-01T23:45:58.565262+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:45:58.565262+0000","last_undegraded":"2023-12-01T23:45:58.565262+0000","last_fullsized":"2023-12-01T23:45:58.565262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:28.925995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":144,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137373+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:45:40.137373+0000","last_peered":"2023-12-01T23:45:40.137373+0000","last_clean":"2023-12-01T23:45:40.137373+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:45:40.137373+0000","last_undegraded":"2023-12-01T23:45:40.137373+0000","last_fullsized":"2023-12-01T23:45:40.137373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:33:03.957816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503832+0000","last_change":"2023-12-01T23:18:28.858138+0000","last_active":"2023-12-01T23:46:07.503832+0000","last_peered":"2023-12-01T23:46:07.503832+0000","last_clean":"2023-12-01T23:46:07.503832+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:07.503832+0000","last_undegraded":"2023-12-01T23:46:07.503832+0000","last_fullsized":"2023-12-01T23:46:07.503832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'256","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.705554+0000","last_change":"2023-12-01T23:18:27.834766+0000","last_active":"2023-12-01T23:46:07.705554+0000","last_peered":"2023-12-01T23:46:07.705554+0000","last_clean":"2023-12-01T23:46:07.705554+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:07.705554+0000","last_undegraded":"2023-12-01T23:46:07.705554+0000","last_fullsized":"2023-12-01T23:46:07.705554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.211620+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.211620+0000","last_peered":"2023-12-01T23:45:39.211620+0000","last_clean":"2023-12-01T23:45:39.211620+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.211620+0000","last_undegraded":"2023-12-01T23:45:39.211620+0000","last_fullsized":"2023-12-01T23:45:39.211620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578590+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:46:07.578590+0000","last_peered":"2023-12-01T23:46:07.578590+0000","last_clean":"2023-12-01T23:46:07.578590+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:07.578590+0000","last_undegraded":"2023-12-01T23:46:07.578590+0000","last_fullsized":"2023-12-01T23:46:07.578590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:28.489661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'834","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.992466+0000","last_change":"2023-12-01T23:18:27.889399+0000","last_active":"2023-12-01T23:45:56.992466+0000","last_peered":"2023-12-01T23:45:56.992466+0000","last_clean":"2023-12-01T23:45:56.992466+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:45:56.992466+0000","last_undegraded":"2023-12-01T23:45:56.992466+0000","last_fullsized":"2023-12-01T23:45:56.992466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:29:33.745923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.157200+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:45:40.157200+0000","last_peered":"2023-12-01T23:45:40.157200+0000","last_clean":"2023-12-01T23:45:40.157200+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:45:40.157200+0000","last_undegraded":"2023-12-01T23:45:40.157200+0000","last_fullsized":"2023-12-01T23:45:40.157200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448442+0000","last_change":"2023-12-01T23:18:28.875762+0000","last_active":"2023-12-01T23:46:07.448442+0000","last_peered":"2023-12-01T23:46:07.448442+0000","last_clean":"2023-12-01T23:46:07.448442+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:07.448442+0000","last_undegraded":"2023-12-01T23:46:07.448442+0000","last_fullsized":"2023-12-01T23:46:07.448442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:35:56.774051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'696","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:01.566876+0000","last_change":"2023-12-01T23:18:27.887363+0000","last_active":"2023-12-01T23:46:01.566876+0000","last_peered":"2023-12-01T23:46:01.566876+0000","last_clean":"2023-12-01T23:46:01.566876+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:01.566876+0000","last_undegraded":"2023-12-01T23:46:01.566876+0000","last_fullsized":"2023-12-01T23:46:01.566876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.207440+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:45:39.207440+0000","last_peered":"2023-12-01T23:45:39.207440+0000","last_clean":"2023-12-01T23:45:39.207440+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:45:39.207440+0000","last_undegraded":"2023-12-01T23:45:39.207440+0000","last_fullsized":"2023-12-01T23:45:39.207440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:17:06.202999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503970+0000","last_change":"2023-12-01T23:18:28.877300+0000","last_active":"2023-12-01T23:46:07.503970+0000","last_peered":"2023-12-01T23:46:07.503970+0000","last_clean":"2023-12-01T23:46:07.503970+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:07.503970+0000","last_undegraded":"2023-12-01T23:46:07.503970+0000","last_fullsized":"2023-12-01T23:46:07.503970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.354784+0000","last_change":"2023-12-01T23:18:27.892586+0000","last_active":"2023-12-01T23:45:49.354784+0000","last_peered":"2023-12-01T23:45:49.354784+0000","last_clean":"2023-12-01T23:45:49.354784+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:45:49.354784+0000","last_undegraded":"2023-12-01T23:45:49.354784+0000","last_fullsized":"2023-12-01T23:45:49.354784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:51:11.281279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:37.976384+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:45:37.976384+0000","last_peered":"2023-12-01T23:45:37.976384+0000","last_clean":"2023-12-01T23:45:37.976384+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:45:37.976384+0000","last_undegraded":"2023-12-01T23:45:37.976384+0000","last_fullsized":"2023-12-01T23:45:37.976384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:53:44.012361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.500976+0000","last_change":"2023-12-01T23:18:28.876419+0000","last_active":"2023-12-01T23:46:07.500976+0000","last_peered":"2023-12-01T23:46:07.500976+0000","last_clean":"2023-12-01T23:46:07.500976+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:07.500976+0000","last_undegraded":"2023-12-01T23:46:07.500976+0000","last_fullsized":"2023-12-01T23:46:07.500976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:49.340217+0000","last_change":"2023-12-01T23:18:27.897838+0000","last_active":"2023-12-01T23:45:49.340217+0000","last_peered":"2023-12-01T23:45:49.340217+0000","last_clean":"2023-12-01T23:45:49.340217+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:45:49.340217+0000","last_undegraded":"2023-12-01T23:45:49.340217+0000","last_fullsized":"2023-12-01T23:45:49.340217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:58:34.134793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.276183+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:45:39.276183+0000","last_peered":"2023-12-01T23:45:39.276183+0000","last_clean":"2023-12-01T23:45:39.276183+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:45:39.276183+0000","last_undegraded":"2023-12-01T23:45:39.276183+0000","last_fullsized":"2023-12-01T23:45:39.276183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:09.124671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.266395+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:45:39.266395+0000","last_peered":"2023-12-01T23:45:39.266395+0000","last_clean":"2023-12-01T23:45:39.266395+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:45:39.266395+0000","last_undegraded":"2023-12-01T23:45:39.266395+0000","last_fullsized":"2023-12-01T23:45:39.266395+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429322+0000","last_change":"2023-12-01T23:19:06.057281+0000","last_active":"2023-12-01T23:46:07.429322+0000","last_peered":"2023-12-01T23:46:07.429322+0000","last_clean":"2023-12-01T23:46:07.429322+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:07.429322+0000","last_undegraded":"2023-12-01T23:46:07.429322+0000","last_fullsized":"2023-12-01T23:46:07.429322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:00.532515+0000","last_change":"2023-12-01T23:18:27.886316+0000","last_active":"2023-12-01T23:46:00.532515+0000","last_peered":"2023-12-01T23:46:00.532515+0000","last_clean":"2023-12-01T23:46:00.532515+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:00.532515+0000","last_undegraded":"2023-12-01T23:46:00.532515+0000","last_fullsized":"2023-12-01T23:46:00.532515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:09.176360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":167,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.071949+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:45:40.071949+0000","last_peered":"2023-12-01T23:45:40.071949+0000","last_clean":"2023-12-01T23:45:40.071949+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:45:40.071949+0000","last_undegraded":"2023-12-01T23:45:40.071949+0000","last_fullsized":"2023-12-01T23:45:40.071949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:08.373711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510478+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:46:07.510478+0000","last_peered":"2023-12-01T23:46:07.510478+0000","last_clean":"2023-12-01T23:46:07.510478+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:07.510478+0000","last_undegraded":"2023-12-01T23:46:07.510478+0000","last_fullsized":"2023-12-01T23:46:07.510478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:20:44.720379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:52.446752+0000","last_change":"2023-12-01T23:18:27.891994+0000","last_active":"2023-12-01T23:45:52.446752+0000","last_peered":"2023-12-01T23:45:52.446752+0000","last_clean":"2023-12-01T23:45:52.446752+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:45:52.446752+0000","last_undegraded":"2023-12-01T23:45:52.446752+0000","last_fullsized":"2023-12-01T23:45:52.446752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:52:38.062416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'687","reported_seq":717,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.887479+0000","last_change":"2023-12-01T23:18:27.894912+0000","last_active":"2023-12-01T23:45:57.887479+0000","last_peered":"2023-12-01T23:45:57.887479+0000","last_clean":"2023-12-01T23:45:57.887479+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:45:57.887479+0000","last_undegraded":"2023-12-01T23:45:57.887479+0000","last_fullsized":"2023-12-01T23:45:57.887479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:55:19.136226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.913858+0000","last_change":"2023-12-01T23:46:17.913876+0000","last_active":"2023-12-01T23:46:17.913858+0000","last_peered":"2023-12-01T23:46:17.913858+0000","last_clean":"2023-12-01T23:46:17.913858+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:17.913858+0000","last_undegraded":"2023-12-01T23:46:17.913858+0000","last_fullsized":"2023-12-01T23:46:17.913858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_clean_scrub_stamp":"2023-12-01T23:46:17.913795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:35.764452+0000","scrub_duration":0.0020485220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134507+0000","last_change":"2023-12-01T23:19:06.163026+0000","last_active":"2023-12-01T23:45:39.134507+0000","last_peered":"2023-12-01T23:45:39.134507+0000","last_clean":"2023-12-01T23:45:39.134507+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:45:39.134507+0000","last_undegraded":"2023-12-01T23:45:39.134507+0000","last_fullsized":"2023-12-01T23:45:39.134507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:38:01.380449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'676","reported_seq":706,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:56.469370+0000","last_change":"2023-12-01T23:18:27.894646+0000","last_active":"2023-12-01T23:45:56.469370+0000","last_peered":"2023-12-01T23:45:56.469370+0000","last_clean":"2023-12-01T23:45:56.469370+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:45:56.469370+0000","last_undegraded":"2023-12-01T23:45:56.469370+0000","last_fullsized":"2023-12-01T23:45:56.469370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:44:46.994628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.448156+0000","last_change":"2023-12-01T23:18:28.876121+0000","last_active":"2023-12-01T23:46:07.448156+0000","last_peered":"2023-12-01T23:46:07.448156+0000","last_clean":"2023-12-01T23:46:07.448156+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:07.448156+0000","last_undegraded":"2023-12-01T23:46:07.448156+0000","last_fullsized":"2023-12-01T23:46:07.448156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:40:39.530797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.134413+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:45:39.134413+0000","last_peered":"2023-12-01T23:45:39.134413+0000","last_clean":"2023-12-01T23:45:39.134413+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:45:39.134413+0000","last_undegraded":"2023-12-01T23:45:39.134413+0000","last_fullsized":"2023-12-01T23:45:39.134413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:02:21.905239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588952+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:46:07.588952+0000","last_peered":"2023-12-01T23:46:07.588952+0000","last_clean":"2023-12-01T23:46:07.588952+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:07.588952+0000","last_undegraded":"2023-12-01T23:46:07.588952+0000","last_fullsized":"2023-12-01T23:46:07.588952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:55:02.378055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429738+0000","last_change":"2023-12-01T23:19:06.058763+0000","last_active":"2023-12-01T23:46:07.429738+0000","last_peered":"2023-12-01T23:46:07.429738+0000","last_clean":"2023-12-01T23:46:07.429738+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:07.429738+0000","last_undegraded":"2023-12-01T23:46:07.429738+0000","last_fullsized":"2023-12-01T23:46:07.429738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:43:01.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507283+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:46:07.507283+0000","last_peered":"2023-12-01T23:46:07.507283+0000","last_clean":"2023-12-01T23:46:07.507283+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:46:07.507283+0000","last_undegraded":"2023-12-01T23:46:07.507283+0000","last_fullsized":"2023-12-01T23:46:07.507283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:06:58.513139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.501385+0000","last_change":"2023-12-01T23:18:28.859595+0000","last_active":"2023-12-01T23:46:07.501385+0000","last_peered":"2023-12-01T23:46:07.501385+0000","last_clean":"2023-12-01T23:46:07.501385+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:07.501385+0000","last_undegraded":"2023-12-01T23:46:07.501385+0000","last_fullsized":"2023-12-01T23:46:07.501385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.514310+0000","last_change":"2023-12-01T23:18:28.872992+0000","last_active":"2023-12-01T23:46:07.514310+0000","last_peered":"2023-12-01T23:46:07.514310+0000","last_clean":"2023-12-01T23:46:07.514310+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:07.514310+0000","last_undegraded":"2023-12-01T23:46:07.514310+0000","last_fullsized":"2023-12-01T23:46:07.514310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424490+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:46:07.424490+0000","last_peered":"2023-12-01T23:46:07.424490+0000","last_clean":"2023-12-01T23:46:07.424490+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:07.424490+0000","last_undegraded":"2023-12-01T23:46:07.424490+0000","last_fullsized":"2023-12-01T23:46:07.424490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591499+0000","last_change":"2023-12-01T23:18:28.864149+0000","last_active":"2023-12-01T23:46:07.591499+0000","last_peered":"2023-12-01T23:46:07.591499+0000","last_clean":"2023-12-01T23:46:07.591499+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:07.591499+0000","last_undegraded":"2023-12-01T23:46:07.591499+0000","last_fullsized":"2023-12-01T23:46:07.591499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:37:55.476381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.491852+0000","last_change":"2023-12-01T23:18:28.872156+0000","last_active":"2023-12-01T23:46:07.491852+0000","last_peered":"2023-12-01T23:46:07.491852+0000","last_clean":"2023-12-01T23:46:07.491852+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:07.491852+0000","last_undegraded":"2023-12-01T23:46:07.491852+0000","last_fullsized":"2023-12-01T23:46:07.491852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507294+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:46:07.507294+0000","last_peered":"2023-12-01T23:46:07.507294+0000","last_clean":"2023-12-01T23:46:07.507294+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:07.507294+0000","last_undegraded":"2023-12-01T23:46:07.507294+0000","last_fullsized":"2023-12-01T23:46:07.507294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:42:03.569338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510325+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:46:07.510325+0000","last_peered":"2023-12-01T23:46:07.510325+0000","last_clean":"2023-12-01T23:46:07.510325+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:07.510325+0000","last_undegraded":"2023-12-01T23:46:07.510325+0000","last_fullsized":"2023-12-01T23:46:07.510325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:49:27.367353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506232+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:46:07.506232+0000","last_peered":"2023-12-01T23:46:07.506232+0000","last_clean":"2023-12-01T23:46:07.506232+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:46:07.506232+0000","last_undegraded":"2023-12-01T23:46:07.506232+0000","last_fullsized":"2023-12-01T23:46:07.506232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503364+0000","last_change":"2023-12-01T23:18:28.861092+0000","last_active":"2023-12-01T23:46:07.503364+0000","last_peered":"2023-12-01T23:46:07.503364+0000","last_clean":"2023-12-01T23:46:07.503364+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:07.503364+0000","last_undegraded":"2023-12-01T23:46:07.503364+0000","last_fullsized":"2023-12-01T23:46:07.503364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.588627+0000","last_change":"2023-12-01T23:18:28.873139+0000","last_active":"2023-12-01T23:46:07.588627+0000","last_peered":"2023-12-01T23:46:07.588627+0000","last_clean":"2023-12-01T23:46:07.588627+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:07.588627+0000","last_undegraded":"2023-12-01T23:46:07.588627+0000","last_fullsized":"2023-12-01T23:46:07.588627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:19:29.932853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578518+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578518+0000","last_peered":"2023-12-01T23:46:07.578518+0000","last_clean":"2023-12-01T23:46:07.578518+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578518+0000","last_undegraded":"2023-12-01T23:46:07.578518+0000","last_fullsized":"2023-12-01T23:46:07.578518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:20:20.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.431852+0000","last_change":"2023-12-01T23:18:28.872624+0000","last_active":"2023-12-01T23:46:07.431852+0000","last_peered":"2023-12-01T23:46:07.431852+0000","last_clean":"2023-12-01T23:46:07.431852+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:07.431852+0000","last_undegraded":"2023-12-01T23:46:07.431852+0000","last_fullsized":"2023-12-01T23:46:07.431852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:57:34.670247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.497772+0000","last_change":"2023-12-01T23:18:28.875853+0000","last_active":"2023-12-01T23:46:07.497772+0000","last_peered":"2023-12-01T23:46:07.497772+0000","last_clean":"2023-12-01T23:46:07.497772+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:07.497772+0000","last_undegraded":"2023-12-01T23:46:07.497772+0000","last_fullsized":"2023-12-01T23:46:07.497772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:34:13.761509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504038+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:46:07.504038+0000","last_peered":"2023-12-01T23:46:07.504038+0000","last_clean":"2023-12-01T23:46:07.504038+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:07.504038+0000","last_undegraded":"2023-12-01T23:46:07.504038+0000","last_fullsized":"2023-12-01T23:46:07.504038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:31:44.683720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.424034+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:46:07.424034+0000","last_peered":"2023-12-01T23:46:07.424034+0000","last_clean":"2023-12-01T23:46:07.424034+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:07.424034+0000","last_undegraded":"2023-12-01T23:46:07.424034+0000","last_fullsized":"2023-12-01T23:46:07.424034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503766+0000","last_change":"2023-12-01T23:18:28.854777+0000","last_active":"2023-12-01T23:46:07.503766+0000","last_peered":"2023-12-01T23:46:07.503766+0000","last_clean":"2023-12-01T23:46:07.503766+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:07.503766+0000","last_undegraded":"2023-12-01T23:46:07.503766+0000","last_fullsized":"2023-12-01T23:46:07.503766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511618+0000","last_change":"2023-12-01T23:18:28.871271+0000","last_active":"2023-12-01T23:46:07.511618+0000","last_peered":"2023-12-01T23:46:07.511618+0000","last_clean":"2023-12-01T23:46:07.511618+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:07.511618+0000","last_undegraded":"2023-12-01T23:46:07.511618+0000","last_fullsized":"2023-12-01T23:46:07.511618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.447672+0000","last_change":"2023-12-01T23:18:28.880410+0000","last_active":"2023-12-01T23:46:07.447672+0000","last_peered":"2023-12-01T23:46:07.447672+0000","last_clean":"2023-12-01T23:46:07.447672+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:07.447672+0000","last_undegraded":"2023-12-01T23:46:07.447672+0000","last_fullsized":"2023-12-01T23:46:07.447672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:20:40.330145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.587639+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:46:07.587639+0000","last_peered":"2023-12-01T23:46:07.587639+0000","last_clean":"2023-12-01T23:46:07.587639+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:07.587639+0000","last_undegraded":"2023-12-01T23:46:07.587639+0000","last_fullsized":"2023-12-01T23:46:07.587639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:26:54.297524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591637+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:46:07.591637+0000","last_peered":"2023-12-01T23:46:07.591637+0000","last_clean":"2023-12-01T23:46:07.591637+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:07.591637+0000","last_undegraded":"2023-12-01T23:46:07.591637+0000","last_fullsized":"2023-12-01T23:46:07.591637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:34:25.869889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578993+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.578993+0000","last_peered":"2023-12-01T23:46:07.578993+0000","last_clean":"2023-12-01T23:46:07.578993+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.578993+0000","last_undegraded":"2023-12-01T23:46:07.578993+0000","last_fullsized":"2023-12-01T23:46:07.578993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:28:54.308791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511817+0000","last_change":"2023-12-01T23:18:28.876892+0000","last_active":"2023-12-01T23:46:07.511817+0000","last_peered":"2023-12-01T23:46:07.511817+0000","last_clean":"2023-12-01T23:46:07.511817+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:07.511817+0000","last_undegraded":"2023-12-01T23:46:07.511817+0000","last_fullsized":"2023-12-01T23:46:07.511817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:30:30.045819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.572644+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:46:07.572644+0000","last_peered":"2023-12-01T23:46:07.572644+0000","last_clean":"2023-12-01T23:46:07.572644+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:07.572644+0000","last_undegraded":"2023-12-01T23:46:07.572644+0000","last_fullsized":"2023-12-01T23:46:07.572644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:20.973165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504289+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:46:07.504289+0000","last_peered":"2023-12-01T23:46:07.504289+0000","last_clean":"2023-12-01T23:46:07.504289+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:46:07.504289+0000","last_undegraded":"2023-12-01T23:46:07.504289+0000","last_fullsized":"2023-12-01T23:46:07.504289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:56:40.229540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.571255+0000","last_change":"2023-12-01T23:18:28.865203+0000","last_active":"2023-12-01T23:46:07.571255+0000","last_peered":"2023-12-01T23:46:07.571255+0000","last_clean":"2023-12-01T23:46:07.571255+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:07.571255+0000","last_undegraded":"2023-12-01T23:46:07.571255+0000","last_fullsized":"2023-12-01T23:46:07.571255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:40:20.751381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507521+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.507521+0000","last_peered":"2023-12-01T23:46:07.507521+0000","last_clean":"2023-12-01T23:46:07.507521+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:07.507521+0000","last_undegraded":"2023-12-01T23:46:07.507521+0000","last_fullsized":"2023-12-01T23:46:07.507521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.503432+0000","last_change":"2023-12-01T23:18:28.865279+0000","last_active":"2023-12-01T23:46:07.503432+0000","last_peered":"2023-12-01T23:46:07.503432+0000","last_clean":"2023-12-01T23:46:07.503432+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:07.503432+0000","last_undegraded":"2023-12-01T23:46:07.503432+0000","last_fullsized":"2023-12-01T23:46:07.503432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.750831+0000","last_change":"2023-12-01T23:46:18.750868+0000","last_active":"2023-12-01T23:46:18.750831+0000","last_peered":"2023-12-01T23:46:18.750831+0000","last_clean":"2023-12-01T23:46:18.750831+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:18.750831+0000","last_undegraded":"2023-12-01T23:46:18.750831+0000","last_fullsized":"2023-12-01T23:46:18.750831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_clean_scrub_stamp":"2023-12-01T23:46:18.750724+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:36.492319+0000","scrub_duration":0.001499631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578463+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:46:07.578463+0000","last_peered":"2023-12-01T23:46:07.578463+0000","last_clean":"2023-12-01T23:46:07.578463+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:07.578463+0000","last_undegraded":"2023-12-01T23:46:07.578463+0000","last_fullsized":"2023-12-01T23:46:07.578463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:47.413627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8417,"ondisk_log_size":8417,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509781,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.56799999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509782,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.28100000000000003,"5min":0.22900000000000001,"15min":0.20999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.68700000000000006},"last":0.501},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.441,"15min":0.436},"min":{"1min":0.312,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.441,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.434},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51000000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.31900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.308,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.63800000000000001},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.439,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.71699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.436,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65700000000000003},"last":0.57999999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509781,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.29899999999999999},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.41099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.40300000000000002,"5min":0.48699999999999999,"15min":0.48899999999999999},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.29999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.23000000000000001,"15min":0.216},"max":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.56699999999999995},"last":0.40600000000000003}]},{"osd":2,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.42899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.315,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.45500000000000002,"5min":0.57199999999999995,"15min":0.58299999999999996},"last":0.439}]},{"osd":4,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.68600000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.628},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.66400000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"last":0.76000000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.625,"5min":0.71999999999999997,"15min":0.72599999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.55700000000000005,"5min":0.61599999999999999,"15min":0.70399999999999996},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59199999999999997,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.81699999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509782,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.29099999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.375},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.313}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.437},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.40100000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.45600000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542485,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.248,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.627,"5min":0.63,"15min":0.66500000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.45900000000000002,"15min":0.44700000000000001},"min":{"1min":0.38800000000000001,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68100000000000005},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.39900000000000002},"min":{"1min":0.316,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.71199999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.70299999999999996},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.33200000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.441,"15min":0.432},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35299999999999998},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.49299999999999999,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.374},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.621},"last":0.35499999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.379,"15min":0.38200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.74199999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.443,"15min":0.442},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69799999999999995},"last":0.441}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.29199999999999998,"5min":0.254,"15min":0.249},"max":{"1min":0.57499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.41299999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542485,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68700000000000006},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.57399999999999995,"5min":0.629,"15min":0.629},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.34200000000000003,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.441}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54600000000000004,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.59399999999999997,"5min":0.626,"15min":0.626},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"min":{"1min":0.37,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.437,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.216},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.61399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.245},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.624},{"interface":"front","average":{"1min":0.436,"5min":0.40300000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71799999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.65300000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542486,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.435},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575190,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.42199999999999999,"5min":0.623,"15min":0.623},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.316,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.47799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.23400000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.314,"15min":0.30199999999999999},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.193},"max":{"1min":0.46000000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.26000000000000001}]},{"osd":3,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.57399999999999995,"15min":0.623},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.32800000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.36099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.59699999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.56899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39100000000000001}]},{"osd":5,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.441,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.316},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.442},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58199999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.503}]},{"osd":6,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67100000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.69799999999999995,"15min":0.71099999999999997},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":0.64200000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.40300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:46:23.718 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.718 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.718 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.718 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.719 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.720 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.721 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.722 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-01T23:18:14.448978+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=14, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.723 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.724 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.725 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.726 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.727 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.728 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.729 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.730 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.731 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.732 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.732 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.732 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:23.732 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T23:46:42.245 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:46:42.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:46:43.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:46:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.834+0000 7f615335a640 1 Processor -- start 2023-12-01T23:46:43.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.834+0000 7f615335a640 1 -- start start 2023-12-01T23:46:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.835+0000 7f615335a640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 0x7f614c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.835+0000 7f615335a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c0cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.835+0000 7f615335a640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c15a700 con 0x7f614c153c70 2023-12-01T23:46:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.835+0000 7f615335a640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c0ca870 con 0x7f614c153890 2023-12-01T23:46:43.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.835+0000 7f615335a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c159af0 con 0x7f614c0ceef0 2023-12-01T23:46:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.836+0000 7f61510f6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 0x7f614c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.836+0000 7f61518f7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c0cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.836+0000 7f61510f6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 0x7f614c15d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42480/0 (socket says 172.21.15.96:42480) 2023-12-01T23:46:43.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.836+0000 7f61510f6640 1 -- 172.21.15.96:0/3740996466 learned_addr learned my addr 172.21.15.96:0/3740996466 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.839+0000 7f61518f7640 1 -- 172.21.15.96:0/3740996466 >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 msgr2=0x7f614c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:46:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.839+0000 7f61518f7640 1 --2- 172.21.15.96:0/3740996466 >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 0x7f614c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.839+0000 7f61518f7640 1 -- 172.21.15.96:0/3740996466 >> v1:172.21.15.96:6789/0 conn(0x7f614c153c70 legacy=0x7f614c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:43.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.839+0000 7f61518f7640 1 -- 172.21.15.96:0/3740996466 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c159dd0 con 0x7f614c0ceef0 2023-12-01T23:46:43.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.841+0000 7f61518f7640 1 --2- 172.21.15.96:0/3740996466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c0cf320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61440097a0 tx=0x7f614402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d624e96c4a216b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:43.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f6143fff640 1 -- 172.21.15.96:0/3740996466 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144030800 con 0x7f614c0ceef0 2023-12-01T23:46:43.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f6143fff640 1 -- 172.21.15.96:0/3740996466 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144030960 con 0x7f614c0ceef0 2023-12-01T23:46:43.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f6143fff640 1 -- 172.21.15.96:0/3740996466 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144030cf0 con 0x7f614c0ceef0 2023-12-01T23:46:43.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 -- 172.21.15.96:0/3740996466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 msgr2=0x7f614c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:43.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 --2- 172.21.15.96:0/3740996466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c0cf320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f61440097a0 tx=0x7f614402b940 comp rx=0 tx=0).stop 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 -- 172.21.15.96:0/3740996466 shutdown_connections 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 --2- 172.21.15.96:0/3740996466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c0cf320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 --2- 172.21.15.96:0/3740996466 >> v2:172.21.15.96:3300/0 conn(0x7f614c153890 0x7f614c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 -- 172.21.15.96:0/3740996466 >> 172.21.15.96:0/3740996466 conn(0x7f614c06ba00 msgr2=0x7f614c06be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 -- 172.21.15.96:0/3740996466 shutdown_connections 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.845+0000 7f615335a640 1 -- 172.21.15.96:0/3740996466 wait complete. 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 Processor -- start 2023-12-01T23:46:43.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 -- start start 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c153c70 0x7f614c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14fe50 con 0x7f614c153890 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14e130 con 0x7f614c153c70 2023-12-01T23:46:43.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.847+0000 7f615335a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14ef50 con 0x7f614c0ceef0 2023-12-01T23:46:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.848+0000 7f61508f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.848+0000 7f61510f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.848+0000 7f61518f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c153c70 0x7f614c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.848+0000 7f61508f5640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42494/0 (socket says 172.21.15.96:42494) 2023-12-01T23:46:43.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.848+0000 7f61508f5640 1 -- 172.21.15.96:0/1574477924 learned_addr learned my addr 172.21.15.96:0/1574477924 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61508f5640 1 -- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 msgr2=0x7f614c14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61508f5640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61508f5640 1 -- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c153c70 msgr2=0x7f614c151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61508f5640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c153c70 0x7f614c151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61508f5640 1 -- 172.21.15.96:0/1574477924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009400 con 0x7f614c153890 2023-12-01T23:46:43.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.852+0000 7f61510f6640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:46:43.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.854+0000 7f61508f5640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c400 tx=0x7f613c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.858+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0052d0 con 0x7f614c153890 2023-12-01T23:46:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.858+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c005430 con 0x7f614c153890 2023-12-01T23:46:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.858+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c14f230 con 0x7f614c153890 2023-12-01T23:46:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.858+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c003830 con 0x7f614c153890 2023-12-01T23:46:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.858+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c0b3490 con 0x7f614c153890 2023-12-01T23:46:43.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.859+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c067500 con 0x7f614c153890 2023-12-01T23:46:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.878+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f613c003990 con 0x7f614c153890 2023-12-01T23:46:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.878+0000 7f6141ffb640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 0x7f613006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:46:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.878+0000 7f61510f6640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 0x7f613006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:46:43.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.879+0000 7f61510f6640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 0x7f613006d380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61480092a0 tx=0x7f614800b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:46:43.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:43.881+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f613c057d70 con 0x7f614c153890 2023-12-01T23:46:44.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.113+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f613c0540b0 con 0x7f614c153890 2023-12-01T23:46:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.281+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f614c1597a0 con 0x7f613006aec0 2023-12-01T23:46:44.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.289+0000 7f6141ffb640 1 -- 172.21.15.96:0/1574477924 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369798 (secure 0 0 0) 0x7f614800f040 con 0x7f613006aec0 2023-12-01T23:46:44.294 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:46:44.296 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 msgr2=0x7f613006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 0x7f613006d380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61480092a0 tx=0x7f614800b040 comp rx=0 tx=0).stop 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 msgr2=0x7f614c149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f613c00c400 tx=0x7f613c00c8c0 comp rx=0 tx=0).stop 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 shutdown_connections 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f613006aec0 0x7f613006d380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c153c70 0x7f614c151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f614c153890 0x7f614c149810 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:44.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 --2- 172.21.15.96:0/1574477924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0ceef0 0x7f614c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:46:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 >> 172.21.15.96:0/1574477924 conn(0x7f614c06ba00 msgr2=0x7f614c0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:46:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 shutdown_connections 2023-12-01T23:46:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:46:44.293+0000 7f615335a640 1 -- 172.21.15.96:0/1574477924 wait complete. 2023-12-01T23:46:44.305 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":879,"stamp":"2023-12-01T23:46:44.184109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15689,"ondisk_log_size":15689,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002547"},"pg_stats":[{"pgid":"2.1f","version":"29'587","reported_seq":628,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.821622+0000","last_change":"2023-12-01T23:46:23.821644+0000","last_active":"2023-12-01T23:46:23.821622+0000","last_peered":"2023-12-01T23:46:23.821622+0000","last_clean":"2023-12-01T23:46:23.821622+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:23.821622+0000","last_undegraded":"2023-12-01T23:46:23.821622+0000","last_fullsized":"2023-12-01T23:46:23.821622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'587","last_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_deep_scrub":"29'587","last_deep_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_clean_scrub_stamp":"2023-12-01T23:46:23.821567+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:27:45.679880+0000","scrub_duration":0.014376867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.099073+0000","last_change":"2023-12-01T23:46:29.099073+0000","last_active":"2023-12-01T23:46:29.099073+0000","last_peered":"2023-12-01T23:46:29.099073+0000","last_clean":"2023-12-01T23:46:29.099073+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:29.099073+0000","last_undegraded":"2023-12-01T23:46:29.099073+0000","last_fullsized":"2023-12-01T23:46:29.099073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.098979+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.006340+0000","scrub_duration":0.001500726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.138215+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.138215+0000","last_peered":"2023-12-01T23:45:40.138215+0000","last_clean":"2023-12-01T23:45:40.138215+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.138215+0000","last_undegraded":"2023-12-01T23:45:40.138215+0000","last_fullsized":"2023-12-01T23:45:40.138215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'722","reported_seq":764,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.050166+0000","last_change":"2023-12-01T23:46:37.050187+0000","last_active":"2023-12-01T23:46:37.050166+0000","last_peered":"2023-12-01T23:46:37.050166+0000","last_clean":"2023-12-01T23:46:37.050166+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:46:37.050166+0000","last_undegraded":"2023-12-01T23:46:37.050166+0000","last_fullsized":"2023-12-01T23:46:37.050166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'722","last_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_deep_scrub":"29'722","last_deep_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.050112+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:47.620513+0000","scrub_duration":0.013774812000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.790990+0000","last_change":"2023-12-01T23:46:27.791032+0000","last_active":"2023-12-01T23:46:27.790990+0000","last_peered":"2023-12-01T23:46:27.790990+0000","last_clean":"2023-12-01T23:46:27.790990+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:27.790990+0000","last_undegraded":"2023-12-01T23:46:27.790990+0000","last_fullsized":"2023-12-01T23:46:27.790990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.790881+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:09.321687+0000","scrub_duration":0.0024783050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143638+0000","last_change":"2023-12-01T23:19:06.103620+0000","last_active":"2023-12-01T23:45:40.143638+0000","last_peered":"2023-12-01T23:45:40.143638+0000","last_clean":"2023-12-01T23:45:40.143638+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:45:40.143638+0000","last_undegraded":"2023-12-01T23:45:40.143638+0000","last_fullsized":"2023-12-01T23:45:40.143638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1377","reported_seq":1416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:38.059304+0000","last_change":"2023-12-01T23:46:38.059352+0000","last_active":"2023-12-01T23:46:38.059304+0000","last_peered":"2023-12-01T23:46:38.059304+0000","last_clean":"2023-12-01T23:46:38.059304+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:46:38.059304+0000","last_undegraded":"2023-12-01T23:46:38.059304+0000","last_fullsized":"2023-12-01T23:46:38.059304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1377","last_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_deep_scrub":"29'1377","last_deep_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_clean_scrub_stamp":"2023-12-01T23:46:38.059230+0000","objects_scrubbed":3,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:38.866050+0000","scrub_duration":0.025760086000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.504155+0000","last_change":"2023-12-01T23:18:28.873637+0000","last_active":"2023-12-01T23:46:07.504155+0000","last_peered":"2023-12-01T23:46:07.504155+0000","last_clean":"2023-12-01T23:46:07.504155+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:07.504155+0000","last_undegraded":"2023-12-01T23:46:07.504155+0000","last_fullsized":"2023-12-01T23:46:07.504155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":179,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.851942+0000","last_change":"2023-12-01T23:18:34.787704+0000","last_active":"2023-12-01T23:46:07.851942+0000","last_peered":"2023-12-01T23:46:07.851942+0000","last_clean":"2023-12-01T23:46:07.851942+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:46:07.851942+0000","last_undegraded":"2023-12-01T23:46:07.851942+0000","last_fullsized":"2023-12-01T23:46:07.851942+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.084780+0000","last_change":"2023-12-01T23:46:34.084820+0000","last_active":"2023-12-01T23:46:34.084780+0000","last_peered":"2023-12-01T23:46:34.084780+0000","last_clean":"2023-12-01T23:46:34.084780+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:46:34.084780+0000","last_undegraded":"2023-12-01T23:46:34.084780+0000","last_fullsized":"2023-12-01T23:46:34.084780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.084694+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:50:09.154389+0000","scrub_duration":0.0024307840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506732+0000","last_change":"2023-12-01T23:18:28.879562+0000","last_active":"2023-12-01T23:46:07.506732+0000","last_peered":"2023-12-01T23:46:07.506732+0000","last_clean":"2023-12-01T23:46:07.506732+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:07.506732+0000","last_undegraded":"2023-12-01T23:46:07.506732+0000","last_fullsized":"2023-12-01T23:46:07.506732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.851915+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:46:07.851915+0000","last_peered":"2023-12-01T23:46:07.851915+0000","last_clean":"2023-12-01T23:46:07.851915+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:46:07.851915+0000","last_undegraded":"2023-12-01T23:46:07.851915+0000","last_fullsized":"2023-12-01T23:46:07.851915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.658010+0000","last_change":"2023-12-01T23:46:37.658029+0000","last_active":"2023-12-01T23:46:37.658010+0000","last_peered":"2023-12-01T23:46:37.658010+0000","last_clean":"2023-12-01T23:46:37.658010+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:37.658010+0000","last_undegraded":"2023-12-01T23:46:37.658010+0000","last_fullsized":"2023-12-01T23:46:37.658010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.657927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:23:10.474950+0000","scrub_duration":0.001280696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'636","reported_seq":676,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.993687+0000","last_change":"2023-12-01T23:46:42.993713+0000","last_active":"2023-12-01T23:46:42.993687+0000","last_peered":"2023-12-01T23:46:42.993687+0000","last_clean":"2023-12-01T23:46:42.993687+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:46:42.993687+0000","last_undegraded":"2023-12-01T23:46:42.993687+0000","last_fullsized":"2023-12-01T23:46:42.993687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'636","last_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_deep_scrub":"29'636","last_deep_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.993627+0000","objects_scrubbed":2,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:24:26.661673+0000","scrub_duration":0.016535945999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137741+0000","last_change":"2023-12-01T23:18:34.837731+0000","last_active":"2023-12-01T23:45:40.137741+0000","last_peered":"2023-12-01T23:45:40.137741+0000","last_clean":"2023-12-01T23:45:40.137741+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:45:40.137741+0000","last_undegraded":"2023-12-01T23:45:40.137741+0000","last_fullsized":"2023-12-01T23:45:40.137741+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.040392+0000","last_change":"2023-12-01T23:46:25.040412+0000","last_active":"2023-12-01T23:46:25.040392+0000","last_peered":"2023-12-01T23:46:25.040392+0000","last_clean":"2023-12-01T23:46:25.040392+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:25.040392+0000","last_undegraded":"2023-12-01T23:46:25.040392+0000","last_fullsized":"2023-12-01T23:46:25.040392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.040325+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:10.530867+0000","scrub_duration":0.001183684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.625555+0000","last_change":"2023-12-01T23:46:29.625555+0000","last_active":"2023-12-01T23:46:29.625555+0000","last_peered":"2023-12-01T23:46:29.625555+0000","last_clean":"2023-12-01T23:46:29.625555+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:46:29.625555+0000","last_undegraded":"2023-12-01T23:46:29.625555+0000","last_fullsized":"2023-12-01T23:46:29.625555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.625443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:09.464351+0000","scrub_duration":0.0012089830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":210,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143854+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143854+0000","last_peered":"2023-12-01T23:45:40.143854+0000","last_clean":"2023-12-01T23:45:40.143854+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143854+0000","last_undegraded":"2023-12-01T23:45:40.143854+0000","last_fullsized":"2023-12-01T23:45:40.143854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.073957+0000","last_change":"2023-12-01T23:18:28.821714+0000","last_active":"2023-12-01T23:46:20.073957+0000","last_peered":"2023-12-01T23:46:20.073957+0000","last_clean":"2023-12-01T23:46:20.073957+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:20.073957+0000","last_undegraded":"2023-12-01T23:46:20.073957+0000","last_fullsized":"2023-12-01T23:46:20.073957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568470+0000","last_change":"2023-12-01T23:18:27.886223+0000","last_active":"2023-12-01T23:46:18.568470+0000","last_peered":"2023-12-01T23:46:18.568470+0000","last_clean":"2023-12-01T23:46:18.568470+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:46:18.568470+0000","last_undegraded":"2023-12-01T23:46:18.568470+0000","last_fullsized":"2023-12-01T23:46:18.568470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.154704+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:40.154704+0000","last_peered":"2023-12-01T23:45:40.154704+0000","last_clean":"2023-12-01T23:45:40.154704+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:40.154704+0000","last_undegraded":"2023-12-01T23:45:40.154704+0000","last_fullsized":"2023-12-01T23:45:40.154704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.572012+0000","last_change":"2023-12-01T23:46:29.572012+0000","last_active":"2023-12-01T23:46:29.572012+0000","last_peered":"2023-12-01T23:46:29.572012+0000","last_clean":"2023-12-01T23:46:29.572012+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:46:29.572012+0000","last_undegraded":"2023-12-01T23:46:29.572012+0000","last_fullsized":"2023-12-01T23:46:29.572012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.571898+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:51.682690+0000","scrub_duration":0.0014693180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.117119+0000","last_change":"2023-12-01T23:18:27.894260+0000","last_active":"2023-12-01T23:46:23.117119+0000","last_peered":"2023-12-01T23:46:23.117119+0000","last_clean":"2023-12-01T23:46:23.117119+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:46:23.117119+0000","last_undegraded":"2023-12-01T23:46:23.117119+0000","last_fullsized":"2023-12-01T23:46:23.117119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.239255+0000","last_change":"2023-12-01T23:18:34.788052+0000","last_active":"2023-12-01T23:45:39.239255+0000","last_peered":"2023-12-01T23:45:39.239255+0000","last_clean":"2023-12-01T23:45:39.239255+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:45:39.239255+0000","last_undegraded":"2023-12-01T23:45:39.239255+0000","last_fullsized":"2023-12-01T23:45:39.239255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.688025+0000","last_change":"2023-12-01T23:46:36.688025+0000","last_active":"2023-12-01T23:46:36.688025+0000","last_peered":"2023-12-01T23:46:36.688025+0000","last_clean":"2023-12-01T23:46:36.688025+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:36.688025+0000","last_undegraded":"2023-12-01T23:46:36.688025+0000","last_fullsized":"2023-12-01T23:46:36.688025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.687934+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:36.569781+0000","scrub_duration":0.001389251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.660776+0000","last_change":"2023-12-01T23:46:34.660776+0000","last_active":"2023-12-01T23:46:34.660776+0000","last_peered":"2023-12-01T23:46:34.660776+0000","last_clean":"2023-12-01T23:46:34.660776+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:46:34.660776+0000","last_undegraded":"2023-12-01T23:46:34.660776+0000","last_fullsized":"2023-12-01T23:46:34.660776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.660656+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:56.771448+0000","scrub_duration":0.0024248519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.598069+0000","last_change":"2023-12-01T23:46:36.598093+0000","last_active":"2023-12-01T23:46:36.598069+0000","last_peered":"2023-12-01T23:46:36.598069+0000","last_clean":"2023-12-01T23:46:36.598069+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:46:36.598069+0000","last_undegraded":"2023-12-01T23:46:36.598069+0000","last_fullsized":"2023-12-01T23:46:36.598069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.597987+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:08:56.617524+0000","scrub_duration":0.00256362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.073949+0000","last_change":"2023-12-01T23:18:28.779917+0000","last_active":"2023-12-01T23:46:20.073949+0000","last_peered":"2023-12-01T23:46:20.073949+0000","last_clean":"2023-12-01T23:46:20.073949+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:20.073949+0000","last_undegraded":"2023-12-01T23:46:20.073949+0000","last_fullsized":"2023-12-01T23:46:20.073949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'310","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.611009+0000","last_change":"2023-12-01T23:46:39.611046+0000","last_active":"2023-12-01T23:46:39.611009+0000","last_peered":"2023-12-01T23:46:39.611009+0000","last_clean":"2023-12-01T23:46:39.611009+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:39.611009+0000","last_undegraded":"2023-12-01T23:46:39.611009+0000","last_fullsized":"2023-12-01T23:46:39.611009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'310","last_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_deep_scrub":"29'310","last_deep_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.610919+0000","objects_scrubbed":1,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:38:41.341946+0000","scrub_duration":0.004221219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074186+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:46:20.074186+0000","last_peered":"2023-12-01T23:46:20.074186+0000","last_clean":"2023-12-01T23:46:20.074186+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:46:20.074186+0000","last_undegraded":"2023-12-01T23:46:20.074186+0000","last_fullsized":"2023-12-01T23:46:20.074186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429149+0000","last_change":"2023-12-01T23:18:28.865274+0000","last_active":"2023-12-01T23:46:07.429149+0000","last_peered":"2023-12-01T23:46:07.429149+0000","last_clean":"2023-12-01T23:46:07.429149+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:07.429149+0000","last_undegraded":"2023-12-01T23:46:07.429149+0000","last_fullsized":"2023-12-01T23:46:07.429149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.066892+0000","last_change":"2023-12-01T23:46:39.066910+0000","last_active":"2023-12-01T23:46:39.066892+0000","last_peered":"2023-12-01T23:46:39.066892+0000","last_clean":"2023-12-01T23:46:39.066892+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:46:39.066892+0000","last_undegraded":"2023-12-01T23:46:39.066892+0000","last_fullsized":"2023-12-01T23:46:39.066892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.066832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:46.974193+0000","scrub_duration":0.001216946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":161,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.135298+0000","last_change":"2023-12-01T23:18:34.834342+0000","last_active":"2023-12-01T23:45:40.135298+0000","last_peered":"2023-12-01T23:45:40.135298+0000","last_clean":"2023-12-01T23:45:40.135298+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:45:40.135298+0000","last_undegraded":"2023-12-01T23:45:40.135298+0000","last_fullsized":"2023-12-01T23:45:40.135298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507613+0000","last_change":"2023-12-01T23:18:28.874589+0000","last_active":"2023-12-01T23:46:07.507613+0000","last_peered":"2023-12-01T23:46:07.507613+0000","last_clean":"2023-12-01T23:46:07.507613+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:07.507613+0000","last_undegraded":"2023-12-01T23:46:07.507613+0000","last_fullsized":"2023-12-01T23:46:07.507613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:57.485837+0000","last_change":"2023-12-01T23:18:27.835060+0000","last_active":"2023-12-01T23:45:57.485837+0000","last_peered":"2023-12-01T23:45:57.485837+0000","last_clean":"2023-12-01T23:45:57.485837+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:45:57.485837+0000","last_undegraded":"2023-12-01T23:45:57.485837+0000","last_fullsized":"2023-12-01T23:45:57.485837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988848+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:41.988848+0000","last_peered":"2023-12-01T23:45:41.988848+0000","last_clean":"2023-12-01T23:45:41.988848+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:41.988848+0000","last_undegraded":"2023-12-01T23:45:41.988848+0000","last_fullsized":"2023-12-01T23:45:41.988848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.526300+0000","last_change":"2023-12-01T23:46:31.526319+0000","last_active":"2023-12-01T23:46:31.526300+0000","last_peered":"2023-12-01T23:46:31.526300+0000","last_clean":"2023-12-01T23:46:31.526300+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:31.526300+0000","last_undegraded":"2023-12-01T23:46:31.526300+0000","last_fullsized":"2023-12-01T23:46:31.526300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.526232+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:11.365141+0000","scrub_duration":0.0014675910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:58.565701+0000","last_change":"2023-12-01T23:18:27.889876+0000","last_active":"2023-12-01T23:45:58.565701+0000","last_peered":"2023-12-01T23:45:58.565701+0000","last_clean":"2023-12-01T23:45:58.565701+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:45:58.565701+0000","last_undegraded":"2023-12-01T23:45:58.565701+0000","last_fullsized":"2023-12-01T23:45:58.565701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:26.553753+0000","last_clean_scrub_stamp":"2023-12-01T23:18:26.553753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988880+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:41.988880+0000","last_peered":"2023-12-01T23:45:41.988880+0000","last_clean":"2023-12-01T23:45:41.988880+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:41.988880+0000","last_undegraded":"2023-12-01T23:45:41.988880+0000","last_fullsized":"2023-12-01T23:45:41.988880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568596+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:18.568596+0000","last_peered":"2023-12-01T23:46:18.568596+0000","last_clean":"2023-12-01T23:46:18.568596+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:18.568596+0000","last_undegraded":"2023-12-01T23:46:18.568596+0000","last_fullsized":"2023-12-01T23:46:18.568596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2103,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.643969+0000","last_change":"2023-12-01T23:46:24.643989+0000","last_active":"2023-12-01T23:46:24.643969+0000","last_peered":"2023-12-01T23:46:24.643969+0000","last_clean":"2023-12-01T23:46:24.643969+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:24.643969+0000","last_undegraded":"2023-12-01T23:46:24.643969+0000","last_fullsized":"2023-12-01T23:46:24.643969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1033","last_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_deep_scrub":"29'1033","last_deep_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.643892+0000","objects_scrubbed":1,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:26:33.573885+0000","scrub_duration":0.0020141569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.162571+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:45:39.162571+0000","last_peered":"2023-12-01T23:45:39.162571+0000","last_clean":"2023-12-01T23:45:39.162571+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:45:39.162571+0000","last_undegraded":"2023-12-01T23:45:39.162571+0000","last_fullsized":"2023-12-01T23:45:39.162571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.717873+0000","last_change":"2023-12-01T23:46:31.717892+0000","last_active":"2023-12-01T23:46:31.717873+0000","last_peered":"2023-12-01T23:46:31.717873+0000","last_clean":"2023-12-01T23:46:31.717873+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:31.717873+0000","last_undegraded":"2023-12-01T23:46:31.717873+0000","last_fullsized":"2023-12-01T23:46:31.717873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.717809+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:26.928183+0000","scrub_duration":0.001388479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'522","reported_seq":564,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.125261+0000","last_change":"2023-12-01T23:46:32.125261+0000","last_active":"2023-12-01T23:46:32.125261+0000","last_peered":"2023-12-01T23:46:32.125261+0000","last_clean":"2023-12-01T23:46:32.125261+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:46:32.125261+0000","last_undegraded":"2023-12-01T23:46:32.125261+0000","last_fullsized":"2023-12-01T23:46:32.125261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'522","last_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_deep_scrub":"29'522","last_deep_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.125130+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:58.630445+0000","scrub_duration":0.014960424999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.667378+0000","last_change":"2023-12-01T23:46:43.667378+0000","last_active":"2023-12-01T23:46:43.667378+0000","last_peered":"2023-12-01T23:46:43.667378+0000","last_clean":"2023-12-01T23:46:43.667378+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:46:43.667378+0000","last_undegraded":"2023-12-01T23:46:43.667378+0000","last_fullsized":"2023-12-01T23:46:43.667378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.667288+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:26.019724+0000","scrub_duration":0.0024242619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507018+0000","last_change":"2023-12-01T23:18:28.877608+0000","last_active":"2023-12-01T23:46:07.507018+0000","last_peered":"2023-12-01T23:46:07.507018+0000","last_clean":"2023-12-01T23:46:07.507018+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:07.507018+0000","last_undegraded":"2023-12-01T23:46:07.507018+0000","last_fullsized":"2023-12-01T23:46:07.507018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.294992+0000","last_change":"2023-12-01T23:46:41.295012+0000","last_active":"2023-12-01T23:46:41.294992+0000","last_peered":"2023-12-01T23:46:41.294992+0000","last_clean":"2023-12-01T23:46:41.294992+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:46:41.294992+0000","last_undegraded":"2023-12-01T23:46:41.294992+0000","last_fullsized":"2023-12-01T23:46:41.294992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.294917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:36.505291+0000","scrub_duration":0.0016126510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.061262+0000","last_change":"2023-12-01T23:46:29.061287+0000","last_active":"2023-12-01T23:46:29.061262+0000","last_peered":"2023-12-01T23:46:29.061262+0000","last_clean":"2023-12-01T23:46:29.061262+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:46:29.061262+0000","last_undegraded":"2023-12-01T23:46:29.061262+0000","last_fullsized":"2023-12-01T23:46:29.061262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.061209+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:06.598456+0000","scrub_duration":0.0040676059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":216,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:47.886587+0000","last_change":"2023-12-01T23:18:34.787530+0000","last_active":"2023-12-01T23:45:47.886587+0000","last_peered":"2023-12-01T23:45:47.886587+0000","last_clean":"2023-12-01T23:45:47.886587+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:45:47.886587+0000","last_undegraded":"2023-12-01T23:45:47.886587+0000","last_fullsized":"2023-12-01T23:45:47.886587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578961+0000","last_change":"2023-12-01T23:18:28.878161+0000","last_active":"2023-12-01T23:46:07.578961+0000","last_peered":"2023-12-01T23:46:07.578961+0000","last_clean":"2023-12-01T23:46:07.578961+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:46:07.578961+0000","last_undegraded":"2023-12-01T23:46:07.578961+0000","last_fullsized":"2023-12-01T23:46:07.578961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.655724+0000","last_change":"2023-12-01T23:46:25.655758+0000","last_active":"2023-12-01T23:46:25.655724+0000","last_peered":"2023-12-01T23:46:25.655724+0000","last_clean":"2023-12-01T23:46:25.655724+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:46:25.655724+0000","last_undegraded":"2023-12-01T23:46:25.655724+0000","last_fullsized":"2023-12-01T23:46:25.655724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.655632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:50:43.867354+0000","scrub_duration":0.001438878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.152415+0000","last_change":"2023-12-01T23:18:34.839856+0000","last_active":"2023-12-01T23:45:40.152415+0000","last_peered":"2023-12-01T23:45:40.152415+0000","last_clean":"2023-12-01T23:45:40.152415+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:45:40.152415+0000","last_undegraded":"2023-12-01T23:45:40.152415+0000","last_fullsized":"2023-12-01T23:45:40.152415+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.627943+0000","last_change":"2023-12-01T23:46:33.627977+0000","last_active":"2023-12-01T23:46:33.627943+0000","last_peered":"2023-12-01T23:46:33.627943+0000","last_clean":"2023-12-01T23:46:33.627943+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:33.627943+0000","last_undegraded":"2023-12-01T23:46:33.627943+0000","last_fullsized":"2023-12-01T23:46:33.627943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.627841+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:47.591432+0000","scrub_duration":0.001328142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.628643+0000","last_change":"2023-12-01T23:46:26.628664+0000","last_active":"2023-12-01T23:46:26.628643+0000","last_peered":"2023-12-01T23:46:26.628643+0000","last_clean":"2023-12-01T23:46:26.628643+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:26.628643+0000","last_undegraded":"2023-12-01T23:46:26.628643+0000","last_fullsized":"2023-12-01T23:46:26.628643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.628583+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:50.083961+0000","scrub_duration":0.002604281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":223,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.272040+0000","last_change":"2023-12-01T23:19:06.163021+0000","last_active":"2023-12-01T23:45:39.272040+0000","last_peered":"2023-12-01T23:45:39.272040+0000","last_clean":"2023-12-01T23:45:39.272040+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:45:39.272040+0000","last_undegraded":"2023-12-01T23:45:39.272040+0000","last_fullsized":"2023-12-01T23:45:39.272040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.581148+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.581148+0000","last_peered":"2023-12-01T23:46:07.581148+0000","last_clean":"2023-12-01T23:46:07.581148+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.581148+0000","last_undegraded":"2023-12-01T23:46:07.581148+0000","last_fullsized":"2023-12-01T23:46:07.581148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:19.564746+0000","last_change":"2023-12-01T23:46:19.564768+0000","last_active":"2023-12-01T23:46:19.564746+0000","last_peered":"2023-12-01T23:46:19.564746+0000","last_clean":"2023-12-01T23:46:19.564746+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:46:19.564746+0000","last_undegraded":"2023-12-01T23:46:19.564746+0000","last_fullsized":"2023-12-01T23:46:19.564746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:19.564681+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:07:18.833129+0000","scrub_duration":0.0023607229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.625656+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:46:21.625656+0000","last_peered":"2023-12-01T23:46:21.625656+0000","last_clean":"2023-12-01T23:46:21.625656+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:46:21.625656+0000","last_undegraded":"2023-12-01T23:46:21.625656+0000","last_fullsized":"2023-12-01T23:46:21.625656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.576099+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:07.576099+0000","last_peered":"2023-12-01T23:46:07.576099+0000","last_clean":"2023-12-01T23:46:07.576099+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:46:07.576099+0000","last_undegraded":"2023-12-01T23:46:07.576099+0000","last_fullsized":"2023-12-01T23:46:07.576099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.537130+0000","last_change":"2023-12-01T23:46:21.537165+0000","last_active":"2023-12-01T23:46:21.537130+0000","last_peered":"2023-12-01T23:46:21.537130+0000","last_clean":"2023-12-01T23:46:21.537130+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:46:21.537130+0000","last_undegraded":"2023-12-01T23:46:21.537130+0000","last_fullsized":"2023-12-01T23:46:21.537130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_clean_scrub_stamp":"2023-12-01T23:46:21.537038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:17.479391+0000","scrub_duration":0.0027855789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.135689+0000","last_change":"2023-12-01T23:18:34.788162+0000","last_active":"2023-12-01T23:45:39.135689+0000","last_peered":"2023-12-01T23:45:39.135689+0000","last_clean":"2023-12-01T23:45:39.135689+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:45:39.135689+0000","last_undegraded":"2023-12-01T23:45:39.135689+0000","last_fullsized":"2023-12-01T23:45:39.135689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.117199+0000","last_change":"2023-12-01T23:18:28.871438+0000","last_active":"2023-12-01T23:46:23.117199+0000","last_peered":"2023-12-01T23:46:23.117199+0000","last_clean":"2023-12-01T23:46:23.117199+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:23.117199+0000","last_undegraded":"2023-12-01T23:46:23.117199+0000","last_fullsized":"2023-12-01T23:46:23.117199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.631874+0000","last_change":"2023-12-01T23:46:22.631874+0000","last_active":"2023-12-01T23:46:22.631874+0000","last_peered":"2023-12-01T23:46:22.631874+0000","last_clean":"2023-12-01T23:46:22.631874+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:46:22.631874+0000","last_undegraded":"2023-12-01T23:46:22.631874+0000","last_fullsized":"2023-12-01T23:46:22.631874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.631783+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:27:42.297274+0000","scrub_duration":0.0059878589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":157,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.137856+0000","last_change":"2023-12-01T23:18:34.840926+0000","last_active":"2023-12-01T23:45:40.137856+0000","last_peered":"2023-12-01T23:45:40.137856+0000","last_clean":"2023-12-01T23:45:40.137856+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:45:40.137856+0000","last_undegraded":"2023-12-01T23:45:40.137856+0000","last_fullsized":"2023-12-01T23:45:40.137856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.650489+0000","last_change":"2023-12-01T23:46:41.650508+0000","last_active":"2023-12-01T23:46:41.650489+0000","last_peered":"2023-12-01T23:46:41.650489+0000","last_clean":"2023-12-01T23:46:41.650489+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:41.650489+0000","last_undegraded":"2023-12-01T23:46:41.650489+0000","last_fullsized":"2023-12-01T23:46:41.650489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.650424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:03.590799+0000","scrub_duration":0.0014981689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.719656+0000","last_change":"2023-12-01T23:46:31.719675+0000","last_active":"2023-12-01T23:46:31.719656+0000","last_peered":"2023-12-01T23:46:31.719656+0000","last_clean":"2023-12-01T23:46:31.719656+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:46:31.719656+0000","last_undegraded":"2023-12-01T23:46:31.719656+0000","last_fullsized":"2023-12-01T23:46:31.719656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.719600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:15.461606+0000","scrub_duration":0.00093897100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.088461+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:40.088461+0000","last_peered":"2023-12-01T23:45:40.088461+0000","last_clean":"2023-12-01T23:45:40.088461+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:40.088461+0000","last_undegraded":"2023-12-01T23:45:40.088461+0000","last_fullsized":"2023-12-01T23:45:40.088461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.679138+0000","last_change":"2023-12-01T23:46:29.679160+0000","last_active":"2023-12-01T23:46:29.679138+0000","last_peered":"2023-12-01T23:46:29.679138+0000","last_clean":"2023-12-01T23:46:29.679138+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:29.679138+0000","last_undegraded":"2023-12-01T23:46:29.679138+0000","last_fullsized":"2023-12-01T23:46:29.679138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.679065+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:25.621418+0000","scrub_duration":0.0015688550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.298846+0000","last_change":"2023-12-01T23:46:40.298865+0000","last_active":"2023-12-01T23:46:40.298846+0000","last_peered":"2023-12-01T23:46:40.298846+0000","last_clean":"2023-12-01T23:46:40.298846+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:46:40.298846+0000","last_undegraded":"2023-12-01T23:46:40.298846+0000","last_fullsized":"2023-12-01T23:46:40.298846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.298785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:00:12.873162+0000","scrub_duration":0.0013254339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074228+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:46:20.074228+0000","last_peered":"2023-12-01T23:46:20.074228+0000","last_clean":"2023-12-01T23:46:20.074228+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:46:20.074228+0000","last_undegraded":"2023-12-01T23:46:20.074228+0000","last_fullsized":"2023-12-01T23:46:20.074228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.707881+0000","last_change":"2023-12-01T23:46:32.707923+0000","last_active":"2023-12-01T23:46:32.707881+0000","last_peered":"2023-12-01T23:46:32.707881+0000","last_clean":"2023-12-01T23:46:32.707881+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:32.707881+0000","last_undegraded":"2023-12-01T23:46:32.707881+0000","last_fullsized":"2023-12-01T23:46:32.707881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.707812+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:51.859421+0000","scrub_duration":0.0017506170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'258","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.834421+0000","last_change":"2023-12-01T23:46:22.834421+0000","last_active":"2023-12-01T23:46:22.834421+0000","last_peered":"2023-12-01T23:46:22.834421+0000","last_clean":"2023-12-01T23:46:22.834421+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:22.834421+0000","last_undegraded":"2023-12-01T23:46:22.834421+0000","last_fullsized":"2023-12-01T23:46:22.834421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.834344+0000","objects_scrubbed":3,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:00.371590+0000","scrub_duration":0.010238596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.281868+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.281868+0000","last_peered":"2023-12-01T23:45:39.281868+0000","last_clean":"2023-12-01T23:45:39.281868+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.281868+0000","last_undegraded":"2023-12-01T23:45:39.281868+0000","last_fullsized":"2023-12-01T23:45:39.281868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578657+0000","last_change":"2023-12-01T23:18:28.780631+0000","last_active":"2023-12-01T23:46:07.578657+0000","last_peered":"2023-12-01T23:46:07.578657+0000","last_clean":"2023-12-01T23:46:07.578657+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:07.578657+0000","last_undegraded":"2023-12-01T23:46:07.578657+0000","last_fullsized":"2023-12-01T23:46:07.578657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'837","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.690721+0000","last_change":"2023-12-01T23:46:22.690721+0000","last_active":"2023-12-01T23:46:22.690721+0000","last_peered":"2023-12-01T23:46:22.690721+0000","last_clean":"2023-12-01T23:46:22.690721+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:46:22.690721+0000","last_undegraded":"2023-12-01T23:46:22.690721+0000","last_fullsized":"2023-12-01T23:46:22.690721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.690602+0000","objects_scrubbed":4,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:40:26.291990+0000","scrub_duration":0.015828854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568754+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:46:18.568754+0000","last_peered":"2023-12-01T23:46:18.568754+0000","last_clean":"2023-12-01T23:46:18.568754+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:46:18.568754+0000","last_undegraded":"2023-12-01T23:46:18.568754+0000","last_fullsized":"2023-12-01T23:46:18.568754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.557956+0000","last_change":"2023-12-01T23:46:24.557956+0000","last_active":"2023-12-01T23:46:24.557956+0000","last_peered":"2023-12-01T23:46:24.557956+0000","last_clean":"2023-12-01T23:46:24.557956+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:24.557956+0000","last_undegraded":"2023-12-01T23:46:24.557956+0000","last_fullsized":"2023-12-01T23:46:24.557956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.557856+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:42.299451+0000","scrub_duration":0.0012882550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'697","reported_seq":736,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.664433+0000","last_change":"2023-12-01T23:46:28.664462+0000","last_active":"2023-12-01T23:46:28.664433+0000","last_peered":"2023-12-01T23:46:28.664433+0000","last_clean":"2023-12-01T23:46:28.664433+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:28.664433+0000","last_undegraded":"2023-12-01T23:46:28.664433+0000","last_fullsized":"2023-12-01T23:46:28.664433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.664354+0000","objects_scrubbed":2,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:29:54.783596+0000","scrub_duration":0.0041761050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.872263+0000","last_change":"2023-12-01T23:18:34.790094+0000","last_active":"2023-12-01T23:46:20.872263+0000","last_peered":"2023-12-01T23:46:20.872263+0000","last_clean":"2023-12-01T23:46:20.872263+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:46:20.872263+0000","last_undegraded":"2023-12-01T23:46:20.872263+0000","last_fullsized":"2023-12-01T23:46:20.872263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.782476+0000","last_change":"2023-12-01T23:46:26.782497+0000","last_active":"2023-12-01T23:46:26.782476+0000","last_peered":"2023-12-01T23:46:26.782476+0000","last_clean":"2023-12-01T23:46:26.782476+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:26.782476+0000","last_undegraded":"2023-12-01T23:46:26.782476+0000","last_fullsized":"2023-12-01T23:46:26.782476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.782401+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:01:23.398097+0000","scrub_duration":0.0019853919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.366665+0000","last_change":"2023-12-01T23:46:36.366716+0000","last_active":"2023-12-01T23:46:36.366665+0000","last_peered":"2023-12-01T23:46:36.366665+0000","last_clean":"2023-12-01T23:46:36.366665+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:46:36.366665+0000","last_undegraded":"2023-12-01T23:46:36.366665+0000","last_fullsized":"2023-12-01T23:46:36.366665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.366584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:17.897390+0000","scrub_duration":0.0011632089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074211+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:46:20.074211+0000","last_peered":"2023-12-01T23:46:20.074211+0000","last_clean":"2023-12-01T23:46:20.074211+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:46:20.074211+0000","last_undegraded":"2023-12-01T23:46:20.074211+0000","last_fullsized":"2023-12-01T23:46:20.074211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.338881+0000","last_change":"2023-12-01T23:46:28.338925+0000","last_active":"2023-12-01T23:46:28.338881+0000","last_peered":"2023-12-01T23:46:28.338881+0000","last_clean":"2023-12-01T23:46:28.338881+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:28.338881+0000","last_undegraded":"2023-12-01T23:46:28.338881+0000","last_fullsized":"2023-12-01T23:46:28.338881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.338785+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:45:52.136028+0000","scrub_duration":0.0016464509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:35.654539+0000","last_change":"2023-12-01T23:46:35.654557+0000","last_active":"2023-12-01T23:46:35.654539+0000","last_peered":"2023-12-01T23:46:35.654539+0000","last_clean":"2023-12-01T23:46:35.654539+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:46:35.654539+0000","last_undegraded":"2023-12-01T23:46:35.654539+0000","last_fullsized":"2023-12-01T23:46:35.654539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_clean_scrub_stamp":"2023-12-01T23:46:35.654472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:04:47.022634+0000","scrub_duration":0.001093908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074206+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:46:20.074206+0000","last_peered":"2023-12-01T23:46:20.074206+0000","last_clean":"2023-12-01T23:46:20.074206+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:46:20.074206+0000","last_undegraded":"2023-12-01T23:46:20.074206+0000","last_fullsized":"2023-12-01T23:46:20.074206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.794383+0000","last_change":"2023-12-01T23:18:34.834222+0000","last_active":"2023-12-01T23:46:17.794383+0000","last_peered":"2023-12-01T23:46:17.794383+0000","last_clean":"2023-12-01T23:46:17.794383+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:46:17.794383+0000","last_undegraded":"2023-12-01T23:46:17.794383+0000","last_fullsized":"2023-12-01T23:46:17.794383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.429322+0000","last_change":"2023-12-01T23:19:06.057281+0000","last_active":"2023-12-01T23:46:07.429322+0000","last_peered":"2023-12-01T23:46:07.429322+0000","last_clean":"2023-12-01T23:46:07.429322+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:07.429322+0000","last_undegraded":"2023-12-01T23:46:07.429322+0000","last_fullsized":"2023-12-01T23:46:07.429322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.355761+0000","last_change":"2023-12-01T23:46:33.355780+0000","last_active":"2023-12-01T23:46:33.355761+0000","last_peered":"2023-12-01T23:46:33.355761+0000","last_clean":"2023-12-01T23:46:33.355761+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:33.355761+0000","last_undegraded":"2023-12-01T23:46:33.355761+0000","last_fullsized":"2023-12-01T23:46:33.355761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.355695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:18.846237+0000","scrub_duration":0.001158233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:42.886172+0000","last_change":"2023-12-01T23:18:34.831126+0000","last_active":"2023-12-01T23:45:42.886172+0000","last_peered":"2023-12-01T23:45:42.886172+0000","last_clean":"2023-12-01T23:45:42.886172+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:45:42.886172+0000","last_undegraded":"2023-12-01T23:45:42.886172+0000","last_fullsized":"2023-12-01T23:45:42.886172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.510540+0000","last_change":"2023-12-01T23:18:28.857207+0000","last_active":"2023-12-01T23:46:07.510540+0000","last_peered":"2023-12-01T23:46:07.510540+0000","last_clean":"2023-12-01T23:46:07.510540+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:07.510540+0000","last_undegraded":"2023-12-01T23:46:07.510540+0000","last_fullsized":"2023-12-01T23:46:07.510540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.023231+0000","last_change":"2023-12-01T23:46:40.023249+0000","last_active":"2023-12-01T23:46:40.023231+0000","last_peered":"2023-12-01T23:46:40.023231+0000","last_clean":"2023-12-01T23:46:40.023231+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:46:40.023231+0000","last_undegraded":"2023-12-01T23:46:40.023231+0000","last_fullsized":"2023-12-01T23:46:40.023231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.023168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:04:05.565732+0000","scrub_duration":0.0015748159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.712232+0000","last_change":"2023-12-01T23:46:26.712257+0000","last_active":"2023-12-01T23:46:26.712232+0000","last_peered":"2023-12-01T23:46:26.712232+0000","last_clean":"2023-12-01T23:46:26.712232+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:46:26.712232+0000","last_undegraded":"2023-12-01T23:46:26.712232+0000","last_fullsized":"2023-12-01T23:46:26.712232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'688","last_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_deep_scrub":"29'688","last_deep_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.712170+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:40.675762+0000","scrub_duration":0.015526883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.913858+0000","last_change":"2023-12-01T23:46:17.913876+0000","last_active":"2023-12-01T23:46:17.913858+0000","last_peered":"2023-12-01T23:46:17.913858+0000","last_clean":"2023-12-01T23:46:17.913858+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:17.913858+0000","last_undegraded":"2023-12-01T23:46:17.913858+0000","last_fullsized":"2023-12-01T23:46:17.913858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_clean_scrub_stamp":"2023-12-01T23:46:17.913795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:35.764452+0000","scrub_duration":0.0020485220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.618263+0000","last_change":"2023-12-01T23:46:27.618286+0000","last_active":"2023-12-01T23:46:27.618263+0000","last_peered":"2023-12-01T23:46:27.618263+0000","last_clean":"2023-12-01T23:46:27.618263+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:46:27.618263+0000","last_undegraded":"2023-12-01T23:46:27.618263+0000","last_fullsized":"2023-12-01T23:46:27.618263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'79","last_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_deep_scrub":"29'79","last_deep_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.618173+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:55:34.334662+0000","scrub_duration":0.002712112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'677","reported_seq":716,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.082022+0000","last_change":"2023-12-01T23:46:39.082058+0000","last_active":"2023-12-01T23:46:39.082022+0000","last_peered":"2023-12-01T23:46:39.082022+0000","last_clean":"2023-12-01T23:46:39.082022+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:46:39.082022+0000","last_undegraded":"2023-12-01T23:46:39.082022+0000","last_fullsized":"2023-12-01T23:46:39.082022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'677","last_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_deep_scrub":"29'677","last_deep_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.081954+0000","objects_scrubbed":1,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:38.963801+0000","scrub_duration":0.018891622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.563173+0000","last_change":"2023-12-01T23:46:22.563206+0000","last_active":"2023-12-01T23:46:22.563173+0000","last_peered":"2023-12-01T23:46:22.563173+0000","last_clean":"2023-12-01T23:46:22.563173+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:22.563173+0000","last_undegraded":"2023-12-01T23:46:22.563173+0000","last_fullsized":"2023-12-01T23:46:22.563173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.563080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:56.997610+0000","scrub_duration":0.001814476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:04.056615+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:46:04.056615+0000","last_peered":"2023-12-01T23:46:04.056615+0000","last_clean":"2023-12-01T23:46:04.056615+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:46:04.056615+0000","last_undegraded":"2023-12-01T23:46:04.056615+0000","last_fullsized":"2023-12-01T23:46:04.056615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.589740+0000","last_change":"2023-12-01T23:18:28.871105+0000","last_active":"2023-12-01T23:46:07.589740+0000","last_peered":"2023-12-01T23:46:07.589740+0000","last_clean":"2023-12-01T23:46:07.589740+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:07.589740+0000","last_undegraded":"2023-12-01T23:46:07.589740+0000","last_fullsized":"2023-12-01T23:46:07.589740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.641266+0000","last_change":"2023-12-01T23:46:34.641284+0000","last_active":"2023-12-01T23:46:34.641266+0000","last_peered":"2023-12-01T23:46:34.641266+0000","last_clean":"2023-12-01T23:46:34.641266+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:34.641266+0000","last_undegraded":"2023-12-01T23:46:34.641266+0000","last_fullsized":"2023-12-01T23:46:34.641266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.641201+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:52.382796+0000","scrub_duration":0.0012133529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507583+0000","last_change":"2023-12-01T23:18:28.875287+0000","last_active":"2023-12-01T23:46:07.507583+0000","last_peered":"2023-12-01T23:46:07.507583+0000","last_clean":"2023-12-01T23:46:07.507583+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:46:07.507583+0000","last_undegraded":"2023-12-01T23:46:07.507583+0000","last_fullsized":"2023-12-01T23:46:07.507583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.673858+0000","last_change":"2023-12-01T23:46:37.673877+0000","last_active":"2023-12-01T23:46:37.673858+0000","last_peered":"2023-12-01T23:46:37.673858+0000","last_clean":"2023-12-01T23:46:37.673858+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:37.673858+0000","last_undegraded":"2023-12-01T23:46:37.673858+0000","last_fullsized":"2023-12-01T23:46:37.673858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.673790+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:09.493981+0000","scrub_duration":0.0014334879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.107049+0000","last_change":"2023-12-01T23:46:34.107049+0000","last_active":"2023-12-01T23:46:34.107049+0000","last_peered":"2023-12-01T23:46:34.107049+0000","last_clean":"2023-12-01T23:46:34.107049+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:34.107049+0000","last_undegraded":"2023-12-01T23:46:34.107049+0000","last_fullsized":"2023-12-01T23:46:34.107049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.106923+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:29.317297+0000","scrub_duration":0.001525958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568620+0000","last_change":"2023-12-01T23:18:28.821892+0000","last_active":"2023-12-01T23:46:18.568620+0000","last_peered":"2023-12-01T23:46:18.568620+0000","last_clean":"2023-12-01T23:46:18.568620+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:18.568620+0000","last_undegraded":"2023-12-01T23:46:18.568620+0000","last_fullsized":"2023-12-01T23:46:18.568620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.689584+0000","last_change":"2023-12-01T23:46:42.689584+0000","last_active":"2023-12-01T23:46:42.689584+0000","last_peered":"2023-12-01T23:46:42.689584+0000","last_clean":"2023-12-01T23:46:42.689584+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:42.689584+0000","last_undegraded":"2023-12-01T23:46:42.689584+0000","last_fullsized":"2023-12-01T23:46:42.689584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.689499+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:18:16.705098+0000","scrub_duration":0.0011022670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.047350+0000","last_change":"2023-12-01T23:46:26.047350+0000","last_active":"2023-12-01T23:46:26.047350+0000","last_peered":"2023-12-01T23:46:26.047350+0000","last_clean":"2023-12-01T23:46:26.047350+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:26.047350+0000","last_undegraded":"2023-12-01T23:46:26.047350+0000","last_fullsized":"2023-12-01T23:46:26.047350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.047200+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:26.854020+0000","scrub_duration":0.0017362949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.625597+0000","last_change":"2023-12-01T23:18:28.874556+0000","last_active":"2023-12-01T23:46:21.625597+0000","last_peered":"2023-12-01T23:46:21.625597+0000","last_clean":"2023-12-01T23:46:21.625597+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:21.625597+0000","last_undegraded":"2023-12-01T23:46:21.625597+0000","last_fullsized":"2023-12-01T23:46:21.625597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.511735+0000","last_change":"2023-12-01T23:18:28.872384+0000","last_active":"2023-12-01T23:46:07.511735+0000","last_peered":"2023-12-01T23:46:07.511735+0000","last_clean":"2023-12-01T23:46:07.511735+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:07.511735+0000","last_undegraded":"2023-12-01T23:46:07.511735+0000","last_fullsized":"2023-12-01T23:46:07.511735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.506291+0000","last_change":"2023-12-01T23:18:28.876938+0000","last_active":"2023-12-01T23:46:07.506291+0000","last_peered":"2023-12-01T23:46:07.506291+0000","last_clean":"2023-12-01T23:46:07.506291+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:46:07.506291+0000","last_undegraded":"2023-12-01T23:46:07.506291+0000","last_fullsized":"2023-12-01T23:46:07.506291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.701165+0000","last_change":"2023-12-01T23:46:42.701183+0000","last_active":"2023-12-01T23:46:42.701165+0000","last_peered":"2023-12-01T23:46:42.701165+0000","last_clean":"2023-12-01T23:46:42.701165+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:42.701165+0000","last_undegraded":"2023-12-01T23:46:42.701165+0000","last_fullsized":"2023-12-01T23:46:42.701165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.701106+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:17:19.446451+0000","scrub_duration":0.001533106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.628034+0000","last_change":"2023-12-01T23:46:36.628054+0000","last_active":"2023-12-01T23:46:36.628034+0000","last_peered":"2023-12-01T23:46:36.628034+0000","last_clean":"2023-12-01T23:46:36.628034+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:36.628034+0000","last_undegraded":"2023-12-01T23:46:36.628034+0000","last_fullsized":"2023-12-01T23:46:36.628034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.627948+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:57:18.693485+0000","scrub_duration":0.001270539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578718+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578718+0000","last_peered":"2023-12-01T23:46:07.578718+0000","last_clean":"2023-12-01T23:46:07.578718+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578718+0000","last_undegraded":"2023-12-01T23:46:07.578718+0000","last_fullsized":"2023-12-01T23:46:07.578718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.608302+0000","last_change":"2023-12-01T23:46:26.608302+0000","last_active":"2023-12-01T23:46:26.608302+0000","last_peered":"2023-12-01T23:46:26.608302+0000","last_clean":"2023-12-01T23:46:26.608302+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:26.608302+0000","last_undegraded":"2023-12-01T23:46:26.608302+0000","last_fullsized":"2023-12-01T23:46:26.608302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.608209+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:59:04.832666+0000","scrub_duration":0.001815189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:30.299426+0000","last_change":"2023-12-01T23:46:30.299447+0000","last_active":"2023-12-01T23:46:30.299426+0000","last_peered":"2023-12-01T23:46:30.299426+0000","last_clean":"2023-12-01T23:46:30.299426+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:30.299426+0000","last_undegraded":"2023-12-01T23:46:30.299426+0000","last_fullsized":"2023-12-01T23:46:30.299426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_clean_scrub_stamp":"2023-12-01T23:46:30.299352+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:55.857362+0000","scrub_duration":0.0016640419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.625610+0000","last_change":"2023-12-01T23:18:28.875016+0000","last_active":"2023-12-01T23:46:21.625610+0000","last_peered":"2023-12-01T23:46:21.625610+0000","last_clean":"2023-12-01T23:46:21.625610+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:21.625610+0000","last_undegraded":"2023-12-01T23:46:21.625610+0000","last_fullsized":"2023-12-01T23:46:21.625610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568641+0000","last_change":"2023-12-01T23:18:28.871263+0000","last_active":"2023-12-01T23:46:18.568641+0000","last_peered":"2023-12-01T23:46:18.568641+0000","last_clean":"2023-12-01T23:46:18.568641+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:18.568641+0000","last_undegraded":"2023-12-01T23:46:18.568641+0000","last_fullsized":"2023-12-01T23:46:18.568641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.804111+0000","last_change":"2023-12-01T23:46:25.804111+0000","last_active":"2023-12-01T23:46:25.804111+0000","last_peered":"2023-12-01T23:46:25.804111+0000","last_clean":"2023-12-01T23:46:25.804111+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:25.804111+0000","last_undegraded":"2023-12-01T23:46:25.804111+0000","last_fullsized":"2023-12-01T23:46:25.804111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.804022+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:51.362032+0000","scrub_duration":0.0012177780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.914785+0000","last_change":"2023-12-01T23:46:20.914819+0000","last_active":"2023-12-01T23:46:20.914785+0000","last_peered":"2023-12-01T23:46:20.914785+0000","last_clean":"2023-12-01T23:46:20.914785+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:20.914785+0000","last_undegraded":"2023-12-01T23:46:20.914785+0000","last_fullsized":"2023-12-01T23:46:20.914785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_clean_scrub_stamp":"2023-12-01T23:46:20.914690+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:47.420005+0000","scrub_duration":0.00189442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.574944+0000","last_change":"2023-12-01T23:46:27.574967+0000","last_active":"2023-12-01T23:46:27.574944+0000","last_peered":"2023-12-01T23:46:27.574944+0000","last_clean":"2023-12-01T23:46:27.574944+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:27.574944+0000","last_undegraded":"2023-12-01T23:46:27.574944+0000","last_fullsized":"2023-12-01T23:46:27.574944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.574851+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:54.288208+0000","scrub_duration":0.0016018880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.587776+0000","last_change":"2023-12-01T23:18:28.877130+0000","last_active":"2023-12-01T23:46:07.587776+0000","last_peered":"2023-12-01T23:46:07.587776+0000","last_clean":"2023-12-01T23:46:07.587776+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:07.587776+0000","last_undegraded":"2023-12-01T23:46:07.587776+0000","last_fullsized":"2023-12-01T23:46:07.587776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.591817+0000","last_change":"2023-12-01T23:18:28.878947+0000","last_active":"2023-12-01T23:46:07.591817+0000","last_peered":"2023-12-01T23:46:07.591817+0000","last_clean":"2023-12-01T23:46:07.591817+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:07.591817+0000","last_undegraded":"2023-12-01T23:46:07.591817+0000","last_fullsized":"2023-12-01T23:46:07.591817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.581397+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.581397+0000","last_peered":"2023-12-01T23:46:07.581397+0000","last_clean":"2023-12-01T23:46:07.581397+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.581397+0000","last_undegraded":"2023-12-01T23:46:07.581397+0000","last_fullsized":"2023-12-01T23:46:07.581397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.992196+0000","last_change":"2023-12-01T23:46:41.992215+0000","last_active":"2023-12-01T23:46:41.992196+0000","last_peered":"2023-12-01T23:46:41.992196+0000","last_clean":"2023-12-01T23:46:41.992196+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:41.992196+0000","last_undegraded":"2023-12-01T23:46:41.992196+0000","last_fullsized":"2023-12-01T23:46:41.992196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.992130+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:06.493909+0000","scrub_duration":0.001678983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.572777+0000","last_change":"2023-12-01T23:18:28.857131+0000","last_active":"2023-12-01T23:46:07.572777+0000","last_peered":"2023-12-01T23:46:07.572777+0000","last_clean":"2023-12-01T23:46:07.572777+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:07.572777+0000","last_undegraded":"2023-12-01T23:46:07.572777+0000","last_fullsized":"2023-12-01T23:46:07.572777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.507162+0000","last_change":"2023-12-01T23:18:28.876203+0000","last_active":"2023-12-01T23:46:07.507162+0000","last_peered":"2023-12-01T23:46:07.507162+0000","last_clean":"2023-12-01T23:46:07.507162+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:46:07.507162+0000","last_undegraded":"2023-12-01T23:46:07.507162+0000","last_fullsized":"2023-12-01T23:46:07.507162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.021716+0000","last_change":"2023-12-01T23:46:28.021737+0000","last_active":"2023-12-01T23:46:28.021716+0000","last_peered":"2023-12-01T23:46:28.021716+0000","last_clean":"2023-12-01T23:46:28.021716+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:28.021716+0000","last_undegraded":"2023-12-01T23:46:28.021716+0000","last_fullsized":"2023-12-01T23:46:28.021716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.021656+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:08:59.781744+0000","scrub_duration":0.0016958609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.625622+0000","last_change":"2023-12-01T23:18:28.874571+0000","last_active":"2023-12-01T23:46:21.625622+0000","last_peered":"2023-12-01T23:46:21.625622+0000","last_clean":"2023-12-01T23:46:21.625622+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:21.625622+0000","last_undegraded":"2023-12-01T23:46:21.625622+0000","last_fullsized":"2023-12-01T23:46:21.625622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.768099+0000","last_change":"2023-12-01T23:46:29.768119+0000","last_active":"2023-12-01T23:46:29.768099+0000","last_peered":"2023-12-01T23:46:29.768099+0000","last_clean":"2023-12-01T23:46:29.768099+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:29.768099+0000","last_undegraded":"2023-12-01T23:46:29.768099+0000","last_fullsized":"2023-12-01T23:46:29.768099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.768031+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.675393+0000","scrub_duration":0.001232375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.750831+0000","last_change":"2023-12-01T23:46:18.750868+0000","last_active":"2023-12-01T23:46:18.750831+0000","last_peered":"2023-12-01T23:46:18.750831+0000","last_clean":"2023-12-01T23:46:18.750831+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:18.750831+0000","last_undegraded":"2023-12-01T23:46:18.750831+0000","last_fullsized":"2023-12-01T23:46:18.750831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_clean_scrub_stamp":"2023-12-01T23:46:18.750724+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:36.492319+0000","scrub_duration":0.001499631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578541+0000","last_change":"2023-12-01T23:18:28.875203+0000","last_active":"2023-12-01T23:46:07.578541+0000","last_peered":"2023-12-01T23:46:07.578541+0000","last_clean":"2023-12-01T23:46:07.578541+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:07.578541+0000","last_undegraded":"2023-12-01T23:46:07.578541+0000","last_fullsized":"2023-12-01T23:46:07.578541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8445,"ondisk_log_size":8445,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509786,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.377}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.439},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.35399999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.38700000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.34000000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.318}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.36799999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509787,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.434,"15min":0.41999999999999998},"min":{"1min":0.28100000000000003,"5min":0.22900000000000001,"15min":0.20999999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.68700000000000006},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42699999999999999,"15min":0.42299999999999999},"min":{"1min":0.33900000000000002,"5min":0.27200000000000002,"15min":0.247},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.55300000000000005}]},{"osd":1,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.441,"15min":0.436},"min":{"1min":0.312,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.41499999999999998,"15min":0.42299999999999999},"min":{"1min":0.29499999999999998,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.495},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57699999999999996}]},{"osd":3,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.44800000000000001,"15min":0.434},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44,"15min":0.44600000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29099999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.504}]},{"osd":4,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.26500000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.51000000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.40400000000000003,"15min":0.39400000000000002},"min":{"1min":0.31900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.52700000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.311}]},{"osd":6,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.308,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54200000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41799999999999998,"15min":0.41899999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.55000000000000004,"5min":0.59199999999999997,"15min":0.63800000000000001},"last":0.39800000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.439,"15min":0.436},"min":{"1min":0.245,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.63300000000000001,"5min":0.68999999999999995,"15min":0.71699999999999997},"last":0.377},{"interface":"front","average":{"1min":0.437,"5min":0.436,"15min":0.442},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64100000000000001,"15min":0.65700000000000003},"last":0.36599999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509786,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.29899999999999999},"min":{"1min":0.22,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.41099999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.218},{"interface":"front","average":{"1min":0.314,"5min":0.29799999999999999,"15min":0.29699999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.40300000000000002,"5min":0.48699999999999999,"15min":0.48899999999999999},"last":0.26400000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.308,"15min":0.29999999999999999},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.47099999999999997,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.245},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26300000000000001,"5min":0.23000000000000001,"15min":0.216},"max":{"1min":0.42499999999999999,"5min":0.50900000000000001,"15min":0.56699999999999995},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33600000000000002,"15min":0.33200000000000002},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.42899999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36799999999999999,"15min":0.36399999999999999},"min":{"1min":0.315,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.45500000000000002,"5min":0.57199999999999995,"15min":0.58299999999999996},"last":0.29999999999999999}]},{"osd":4,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41599999999999998},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.55400000000000005,"5min":0.58799999999999997,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.438,"15min":0.42799999999999999},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.628},"last":0.45900000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.34599999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.66400000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.46999999999999997,"15min":0.46500000000000002},"min":{"1min":0.35699999999999998,"5min":0.32600000000000001,"15min":0.30599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68999999999999995,"15min":0.70499999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47599999999999998,"15min":0.46899999999999997},"min":{"1min":0.38900000000000001,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.625,"5min":0.71999999999999997,"15min":0.72599999999999998},"last":0.432},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.45200000000000001},"min":{"1min":0.35899999999999999,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.55700000000000005,"5min":0.61599999999999999,"15min":0.70399999999999996},"last":0.38200000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.59199999999999997,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.47399999999999998,"15min":0.47299999999999998},"min":{"1min":0.41599999999999998,"5min":0.34100000000000003,"15min":0.30599999999999999},"max":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.438}]}]},{"osd":0,"up_from":15,"seq":64424509787,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.317}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.27800000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.45500000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.38700000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.48199999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542490,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.248,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.627,"5min":0.63,"15min":0.66500000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.45900000000000002,"15min":0.44700000000000001},"min":{"1min":0.38800000000000001,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68100000000000005},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.39900000000000002},"min":{"1min":0.316,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.71199999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.70299999999999996},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.33200000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.441,"15min":0.432},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35299999999999998},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.49299999999999999,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.621},"last":0.375}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.379,"15min":0.38200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.74199999999999999},"last":0.435},{"interface":"front","average":{"1min":0.441,"5min":0.443,"15min":0.442},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69799999999999995},"last":0.39300000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.29199999999999998,"5min":0.254,"15min":0.249},"max":{"1min":0.57499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.40400000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542490,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68700000000000006},"last":0.504}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.57399999999999995,"5min":0.629,"15min":0.629},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.34200000000000003,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.45200000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54600000000000004,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.59399999999999997,"5min":0.626,"15min":0.626},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"min":{"1min":0.37,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.437,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.216},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.61399999999999999},"last":0.373},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.33000000000000002}]},{"osd":6,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.245},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.40300000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.41899999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71799999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.434}]}]},{"osd":2,"up_from":14,"seq":60129542491,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.434},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.48299999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.498},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.748},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575194,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.29599999999999999,"5min":0.28499999999999998,"15min":0.28199999999999997},"min":{"1min":0.22900000000000001,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.42199999999999999,"5min":0.623,"15min":0.623},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.316,"15min":0.311},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.47799999999999998,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.314,"15min":0.30199999999999999},"min":{"1min":0.22500000000000001,"5min":0.20200000000000001,"15min":0.193},"max":{"1min":0.46000000000000002,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.32700000000000001},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.22500000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.378}]},{"osd":3,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.33600000000000002,"15min":0.33100000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50800000000000001,"5min":0.57399999999999995,"15min":0.623},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.27600000000000002,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.45400000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.36099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55800000000000005,"5min":0.58599999999999997,"15min":0.59699999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.56899999999999995,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.441,"15min":0.438},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.59999999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.624},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.442},"min":{"1min":0.34899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.58199999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45100000000000001,"15min":0.44800000000000001},"min":{"1min":0.33300000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.67100000000000004,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45000000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.61299999999999999,"5min":0.69799999999999995,"15min":0.71099999999999997},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:45:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.45700000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.745},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47499999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.35099999999999998},"max":{"1min":0.64200000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:46:44.312 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.312 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.313 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.314 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-01T23:18:26.553753+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=26, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.315 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.316 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.317 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.317 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.317 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.318 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.319 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.320 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.321 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.322 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:46:44.322 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T23:47:04.322 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:47:04.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.432+0000 7fa5cf6d7640 1 Processor -- start 2023-12-01T23:47:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.432+0000 7fa5cf6d7640 1 -- start start 2023-12-01T23:47:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.433+0000 7fa5cf6d7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa5c80c9fe0 0x7fa5c80ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.433+0000 7fa5cf6d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa5c8161580 0x7fa5c8161990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.433+0000 7fa5cf6d7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80ca970 con 0x7fa5c8157e30 2023-12-01T23:47:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.433+0000 7fa5cf6d7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80b2310 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.433+0000 7fa5cf6d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c815dc10 con 0x7fa5c8161580 2023-12-01T23:47:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.434+0000 7fa5ccc72640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa5c80c9fe0 0x7fa5c80ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.434+0000 7fa5cdc74640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa5c8161580 0x7fa5c8161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.434+0000 7fa5ccc72640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fa5c80c9fe0 0x7fa5c80ca430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44528/0 (socket says 172.21.15.96:44528) 2023-12-01T23:47:04.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.434+0000 7fa5ccc72640 1 -- 172.21.15.96:0/2133544042 learned_addr learned my addr 172.21.15.96:0/2133544042 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.436+0000 7fa5ccc72640 1 -- 172.21.15.96:0/2133544042 >> v2:172.21.15.102:3300/0 conn(0x7fa5c8161580 msgr2=0x7fa5c8161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.436+0000 7fa5ccc72640 1 --2- 172.21.15.96:0/2133544042 >> v2:172.21.15.102:3300/0 conn(0x7fa5c8161580 0x7fa5c8161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.436+0000 7fa5ccc72640 1 -- 172.21.15.96:0/2133544042 >> v1:172.21.15.102:6789/0 conn(0x7fa5c8157e30 legacy=0x7fa5c80ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.436+0000 7fa5ccc72640 1 -- 172.21.15.96:0/2133544042 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c815de00 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.438+0000 7fa5ccc72640 1 --2- 172.21.15.96:0/2133544042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c80c9fe0 0x7fa5c80ca430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806b2d0 tx=0x7fa5b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcacd08578ac6c68 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.442+0000 7fa5bffff640 1 -- 172.21.15.96:0/2133544042 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8031870 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.442+0000 7fa5bffff640 1 -- 172.21.15.96:0/2133544042 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80319d0 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.442+0000 7fa5bffff640 1 -- 172.21.15.96:0/2133544042 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8031d60 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/2133544042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c80c9fe0 msgr2=0x7fa5c80ca430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/2133544042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c80c9fe0 0x7fa5c80ca430 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa5c806b2d0 tx=0x7fa5b802b910 comp rx=0 tx=0).stop 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/2133544042 shutdown_connections 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/2133544042 >> v2:172.21.15.102:3300/0 conn(0x7fa5c8161580 0x7fa5c8161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/2133544042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c80c9fe0 0x7fa5c80ca430 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/2133544042 >> 172.21.15.96:0/2133544042 conn(0x7fa5c806ba00 msgr2=0x7fa5c806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/2133544042 shutdown_connections 2023-12-01T23:47:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.443+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/2133544042 wait complete. 2023-12-01T23:47:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.444+0000 7fa5cf6d7640 1 Processor -- start 2023-12-01T23:47:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.444+0000 7fa5cf6d7640 1 -- start start 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c80c9fe0 0x7fa5c815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c8157e30 0x7fa5c815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8157520 con 0x7fa5c8161580 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c81569b0 con 0x7fa5c8157e30 2023-12-01T23:47:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.445+0000 7fa5cf6d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8155e00 con 0x7fa5c80c9fe0 2023-12-01T23:47:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.446+0000 7fa5cdc74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.446+0000 7fa5cdc74640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44536/0 (socket says 172.21.15.96:44536) 2023-12-01T23:47:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.446+0000 7fa5cdc74640 1 -- 172.21.15.96:0/3339834063 learned_addr learned my addr 172.21.15.96:0/3339834063 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.446+0000 7fa5ccc72640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c8157e30 0x7fa5c815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.446+0000 7fa5cd473640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c80c9fe0 0x7fa5c815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.449+0000 7fa5cdc74640 1 -- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c80c9fe0 msgr2=0x7fa5c815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.449+0000 7fa5cdc74640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c80c9fe0 0x7fa5c815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.449+0000 7fa5cdc74640 1 -- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c8157e30 msgr2=0x7fa5c815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.449+0000 7fa5cdc74640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c8157e30 0x7fa5c815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.449+0000 7fa5cdc74640 1 -- 172.21.15.96:0/3339834063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80094d0 con 0x7fa5c8161580 2023-12-01T23:47:04.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.451+0000 7fa5cdc74640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e820 tx=0x7fa5c000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.455+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0009510 con 0x7fa5c8161580 2023-12-01T23:47:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.455+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000ee70 con 0x7fa5c8161580 2023-12-01T23:47:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.455+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000cb20 con 0x7fa5c8161580 2023-12-01T23:47:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.455+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c80b49c0 con 0x7fa5c8161580 2023-12-01T23:47:04.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.455+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c8156360 con 0x7fa5c8161580 2023-12-01T23:47:04.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.456+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c8156af0 con 0x7fa5c8161580 2023-12-01T23:47:04.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.477+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5c000cc80 con 0x7fa5c8161580 2023-12-01T23:47:04.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.477+0000 7fa5bdffb640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 0x7fa5ac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:04.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.477+0000 7fa5cd473640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 0x7fa5ac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:04.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.478+0000 7fa5cd473640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 0x7fa5ac06d350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005660 tx=0x7fa5c4003d90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:04.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.481+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5c0058a20 con 0x7fa5c8161580 2023-12-01T23:47:04.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.718+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5c0054d60 con 0x7fa5c8161580 2023-12-01T23:47:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.887+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5c815e660 con 0x7fa5ac06ae90 2023-12-01T23:47:04.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.896+0000 7fa5bdffb640 1 -- 172.21.15.96:0/3339834063 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372430 (secure 0 0 0) 0x7fa5c400fe00 con 0x7fa5ac06ae90 2023-12-01T23:47:04.901 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:04.903 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.900+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 msgr2=0x7fa5ac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.900+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 0x7fa5ac06d350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4005660 tx=0x7fa5c4003d90 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.900+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 msgr2=0x7fa5c81482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.900+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e820 tx=0x7fa5c000ec20 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 shutdown_connections 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fa5ac06ae90 0x7fa5ac06d350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa5c8161580 0x7fa5c81482f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5c8157e30 0x7fa5c815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 --2- 172.21.15.96:0/3339834063 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5c80c9fe0 0x7fa5c815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 >> 172.21.15.96:0/3339834063 conn(0x7fa5c806ba00 msgr2=0x7fa5c815ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 shutdown_connections 2023-12-01T23:47:04.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:04.901+0000 7fa5cf6d7640 1 -- 172.21.15.96:0/3339834063 wait complete. 2023-12-01T23:47:04.913 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":889,"stamp":"2023-12-01T23:47:04.189836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15689,"ondisk_log_size":15689,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":405032,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":347891,"kb_avail":754569688,"statfs":{"total":773094113280,"available":772679360512,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":356240959},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003477"},"pg_stats":[{"pgid":"2.1f","version":"29'587","reported_seq":628,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.821622+0000","last_change":"2023-12-01T23:46:23.821644+0000","last_active":"2023-12-01T23:46:23.821622+0000","last_peered":"2023-12-01T23:46:23.821622+0000","last_clean":"2023-12-01T23:46:23.821622+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:23.821622+0000","last_undegraded":"2023-12-01T23:46:23.821622+0000","last_fullsized":"2023-12-01T23:46:23.821622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'587","last_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_deep_scrub":"29'587","last_deep_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_clean_scrub_stamp":"2023-12-01T23:46:23.821567+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:27:45.679880+0000","scrub_duration":0.014376867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.099073+0000","last_change":"2023-12-01T23:46:29.099073+0000","last_active":"2023-12-01T23:46:29.099073+0000","last_peered":"2023-12-01T23:46:29.099073+0000","last_clean":"2023-12-01T23:46:29.099073+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:29.099073+0000","last_undegraded":"2023-12-01T23:46:29.099073+0000","last_fullsized":"2023-12-01T23:46:29.099073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.098979+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.006340+0000","scrub_duration":0.001500726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.138215+0000","last_change":"2023-12-01T23:18:34.837957+0000","last_active":"2023-12-01T23:45:40.138215+0000","last_peered":"2023-12-01T23:45:40.138215+0000","last_clean":"2023-12-01T23:45:40.138215+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:45:40.138215+0000","last_undegraded":"2023-12-01T23:45:40.138215+0000","last_fullsized":"2023-12-01T23:45:40.138215+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'722","reported_seq":764,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.050166+0000","last_change":"2023-12-01T23:46:37.050187+0000","last_active":"2023-12-01T23:46:37.050166+0000","last_peered":"2023-12-01T23:46:37.050166+0000","last_clean":"2023-12-01T23:46:37.050166+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:46:37.050166+0000","last_undegraded":"2023-12-01T23:46:37.050166+0000","last_fullsized":"2023-12-01T23:46:37.050166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'722","last_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_deep_scrub":"29'722","last_deep_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.050112+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:47.620513+0000","scrub_duration":0.013774812000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.790990+0000","last_change":"2023-12-01T23:46:27.791032+0000","last_active":"2023-12-01T23:46:27.790990+0000","last_peered":"2023-12-01T23:46:27.790990+0000","last_clean":"2023-12-01T23:46:27.790990+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:27.790990+0000","last_undegraded":"2023-12-01T23:46:27.790990+0000","last_fullsized":"2023-12-01T23:46:27.790990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.790881+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:09.321687+0000","scrub_duration":0.0024783050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.730126+0000","last_change":"2023-12-01T23:47:01.730148+0000","last_active":"2023-12-01T23:47:01.730126+0000","last_peered":"2023-12-01T23:47:01.730126+0000","last_clean":"2023-12-01T23:47:01.730126+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:47:01.730126+0000","last_undegraded":"2023-12-01T23:47:01.730126+0000","last_fullsized":"2023-12-01T23:47:01.730126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'146","last_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_deep_scrub":"29'146","last_deep_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.730038+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:03:31.371959+0000","scrub_duration":0.0029167759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1377","reported_seq":1416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:38.059304+0000","last_change":"2023-12-01T23:46:38.059352+0000","last_active":"2023-12-01T23:46:38.059304+0000","last_peered":"2023-12-01T23:46:38.059304+0000","last_clean":"2023-12-01T23:46:38.059304+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:46:38.059304+0000","last_undegraded":"2023-12-01T23:46:38.059304+0000","last_fullsized":"2023-12-01T23:46:38.059304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1377","last_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_deep_scrub":"29'1377","last_deep_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_clean_scrub_stamp":"2023-12-01T23:46:38.059230+0000","objects_scrubbed":3,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:38.866050+0000","scrub_duration":0.025760086000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.166021+0000","last_change":"2023-12-01T23:46:50.166042+0000","last_active":"2023-12-01T23:46:50.166021+0000","last_peered":"2023-12-01T23:46:50.166021+0000","last_clean":"2023-12-01T23:46:50.166021+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:50.166021+0000","last_undegraded":"2023-12-01T23:46:50.166021+0000","last_fullsized":"2023-12-01T23:46:50.166021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.165931+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:21.986122+0000","scrub_duration":0.0013328350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:44.638442+0000","last_change":"2023-12-01T23:46:44.638462+0000","last_active":"2023-12-01T23:46:44.638442+0000","last_peered":"2023-12-01T23:46:44.638442+0000","last_clean":"2023-12-01T23:46:44.638442+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:46:44.638442+0000","last_undegraded":"2023-12-01T23:46:44.638442+0000","last_fullsized":"2023-12-01T23:46:44.638442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'152","last_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_deep_scrub":"29'152","last_deep_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_clean_scrub_stamp":"2023-12-01T23:46:44.638369+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:06.578744+0000","scrub_duration":0.002261529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.084780+0000","last_change":"2023-12-01T23:46:34.084820+0000","last_active":"2023-12-01T23:46:34.084780+0000","last_peered":"2023-12-01T23:46:34.084780+0000","last_clean":"2023-12-01T23:46:34.084780+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:46:34.084780+0000","last_undegraded":"2023-12-01T23:46:34.084780+0000","last_fullsized":"2023-12-01T23:46:34.084780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.084694+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:50:09.154389+0000","scrub_duration":0.0024307840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:57.212463+0000","last_change":"2023-12-01T23:46:57.212484+0000","last_active":"2023-12-01T23:46:57.212463+0000","last_peered":"2023-12-01T23:46:57.212463+0000","last_clean":"2023-12-01T23:46:57.212463+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:57.212463+0000","last_undegraded":"2023-12-01T23:46:57.212463+0000","last_fullsized":"2023-12-01T23:46:57.212463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_clean_scrub_stamp":"2023-12-01T23:46:57.212392+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:42.947264+0000","scrub_duration":0.0012129280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.851915+0000","last_change":"2023-12-01T23:18:34.840956+0000","last_active":"2023-12-01T23:46:07.851915+0000","last_peered":"2023-12-01T23:46:07.851915+0000","last_clean":"2023-12-01T23:46:07.851915+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:46:07.851915+0000","last_undegraded":"2023-12-01T23:46:07.851915+0000","last_fullsized":"2023-12-01T23:46:07.851915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.658029+0000","last_change":"2023-12-01T23:46:37.658029+0000","last_active":"2023-12-01T23:46:37.658029+0000","last_peered":"2023-12-01T23:46:37.658029+0000","last_clean":"2023-12-01T23:46:37.658029+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:37.658029+0000","last_undegraded":"2023-12-01T23:46:37.658029+0000","last_fullsized":"2023-12-01T23:46:37.658029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.657927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:23:10.474950+0000","scrub_duration":0.001280696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'636","reported_seq":676,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.993687+0000","last_change":"2023-12-01T23:46:42.993713+0000","last_active":"2023-12-01T23:46:42.993687+0000","last_peered":"2023-12-01T23:46:42.993687+0000","last_clean":"2023-12-01T23:46:42.993687+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:46:42.993687+0000","last_undegraded":"2023-12-01T23:46:42.993687+0000","last_fullsized":"2023-12-01T23:46:42.993687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'636","last_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_deep_scrub":"29'636","last_deep_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.993627+0000","objects_scrubbed":2,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:24:26.661673+0000","scrub_duration":0.016535945999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.710564+0000","last_change":"2023-12-01T23:47:02.710602+0000","last_active":"2023-12-01T23:47:02.710564+0000","last_peered":"2023-12-01T23:47:02.710564+0000","last_clean":"2023-12-01T23:47:02.710564+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:47:02.710564+0000","last_undegraded":"2023-12-01T23:47:02.710564+0000","last_fullsized":"2023-12-01T23:47:02.710564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'117","last_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_deep_scrub":"29'117","last_deep_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.710464+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:59.065723+0000","scrub_duration":0.003020946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.040392+0000","last_change":"2023-12-01T23:46:25.040412+0000","last_active":"2023-12-01T23:46:25.040392+0000","last_peered":"2023-12-01T23:46:25.040392+0000","last_clean":"2023-12-01T23:46:25.040392+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:25.040392+0000","last_undegraded":"2023-12-01T23:46:25.040392+0000","last_fullsized":"2023-12-01T23:46:25.040392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.040325+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:10.530867+0000","scrub_duration":0.001183684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.625555+0000","last_change":"2023-12-01T23:46:29.625555+0000","last_active":"2023-12-01T23:46:29.625555+0000","last_peered":"2023-12-01T23:46:29.625555+0000","last_clean":"2023-12-01T23:46:29.625555+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:46:29.625555+0000","last_undegraded":"2023-12-01T23:46:29.625555+0000","last_fullsized":"2023-12-01T23:46:29.625555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.625443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:09.464351+0000","scrub_duration":0.0012089830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":210,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.143854+0000","last_change":"2023-12-01T23:18:34.788935+0000","last_active":"2023-12-01T23:45:40.143854+0000","last_peered":"2023-12-01T23:45:40.143854+0000","last_clean":"2023-12-01T23:45:40.143854+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:45:40.143854+0000","last_undegraded":"2023-12-01T23:45:40.143854+0000","last_fullsized":"2023-12-01T23:45:40.143854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.007741+0000","last_change":"2023-12-01T23:46:52.007768+0000","last_active":"2023-12-01T23:46:52.007741+0000","last_peered":"2023-12-01T23:46:52.007741+0000","last_clean":"2023-12-01T23:46:52.007741+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:52.007741+0000","last_undegraded":"2023-12-01T23:46:52.007741+0000","last_fullsized":"2023-12-01T23:46:52.007741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.007658+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:49.391014+0000","scrub_duration":0.001597935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.520645+0000","last_change":"2023-12-01T23:46:45.520663+0000","last_active":"2023-12-01T23:46:45.520645+0000","last_peered":"2023-12-01T23:46:45.520645+0000","last_clean":"2023-12-01T23:46:45.520645+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:46:45.520645+0000","last_undegraded":"2023-12-01T23:46:45.520645+0000","last_fullsized":"2023-12-01T23:46:45.520645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.520583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:48:03.049323+0000","scrub_duration":0.0015689409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":156,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.154704+0000","last_change":"2023-12-01T23:18:34.784842+0000","last_active":"2023-12-01T23:45:40.154704+0000","last_peered":"2023-12-01T23:45:40.154704+0000","last_clean":"2023-12-01T23:45:40.154704+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:45:40.154704+0000","last_undegraded":"2023-12-01T23:45:40.154704+0000","last_fullsized":"2023-12-01T23:45:40.154704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.572012+0000","last_change":"2023-12-01T23:46:29.572012+0000","last_active":"2023-12-01T23:46:29.572012+0000","last_peered":"2023-12-01T23:46:29.572012+0000","last_clean":"2023-12-01T23:46:29.572012+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:46:29.572012+0000","last_undegraded":"2023-12-01T23:46:29.572012+0000","last_fullsized":"2023-12-01T23:46:29.572012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.571898+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:51.682690+0000","scrub_duration":0.0014693180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.896027+0000","last_change":"2023-12-01T23:46:45.896048+0000","last_active":"2023-12-01T23:46:45.896027+0000","last_peered":"2023-12-01T23:46:45.896027+0000","last_clean":"2023-12-01T23:46:45.896027+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:46:45.896027+0000","last_undegraded":"2023-12-01T23:46:45.896027+0000","last_fullsized":"2023-12-01T23:46:45.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.895953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:34:05.047561+0000","scrub_duration":0.001328262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:49.687551+0000","last_change":"2023-12-01T23:46:49.687574+0000","last_active":"2023-12-01T23:46:49.687551+0000","last_peered":"2023-12-01T23:46:49.687551+0000","last_clean":"2023-12-01T23:46:49.687551+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:46:49.687551+0000","last_undegraded":"2023-12-01T23:46:49.687551+0000","last_fullsized":"2023-12-01T23:46:49.687551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'126","last_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_deep_scrub":"29'126","last_deep_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_clean_scrub_stamp":"2023-12-01T23:46:49.687463+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:53.378669+0000","scrub_duration":0.0035888880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.688025+0000","last_change":"2023-12-01T23:46:36.688025+0000","last_active":"2023-12-01T23:46:36.688025+0000","last_peered":"2023-12-01T23:46:36.688025+0000","last_clean":"2023-12-01T23:46:36.688025+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:36.688025+0000","last_undegraded":"2023-12-01T23:46:36.688025+0000","last_fullsized":"2023-12-01T23:46:36.688025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.687934+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:36.569781+0000","scrub_duration":0.001389251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.660776+0000","last_change":"2023-12-01T23:46:34.660776+0000","last_active":"2023-12-01T23:46:34.660776+0000","last_peered":"2023-12-01T23:46:34.660776+0000","last_clean":"2023-12-01T23:46:34.660776+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:46:34.660776+0000","last_undegraded":"2023-12-01T23:46:34.660776+0000","last_fullsized":"2023-12-01T23:46:34.660776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.660656+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:56.771448+0000","scrub_duration":0.0024248519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.598069+0000","last_change":"2023-12-01T23:46:36.598093+0000","last_active":"2023-12-01T23:46:36.598069+0000","last_peered":"2023-12-01T23:46:36.598069+0000","last_clean":"2023-12-01T23:46:36.598069+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:46:36.598069+0000","last_undegraded":"2023-12-01T23:46:36.598069+0000","last_fullsized":"2023-12-01T23:46:36.598069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.597987+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:08:56.617524+0000","scrub_duration":0.00256362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.915992+0000","last_change":"2023-12-01T23:46:58.916030+0000","last_active":"2023-12-01T23:46:58.915992+0000","last_peered":"2023-12-01T23:46:58.915992+0000","last_clean":"2023-12-01T23:46:58.915992+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:58.915992+0000","last_undegraded":"2023-12-01T23:46:58.915992+0000","last_fullsized":"2023-12-01T23:46:58.915992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.915919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:05.013437+0000","scrub_duration":0.0018718389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'310","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.611009+0000","last_change":"2023-12-01T23:46:39.611046+0000","last_active":"2023-12-01T23:46:39.611009+0000","last_peered":"2023-12-01T23:46:39.611009+0000","last_clean":"2023-12-01T23:46:39.611009+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:39.611009+0000","last_undegraded":"2023-12-01T23:46:39.611009+0000","last_fullsized":"2023-12-01T23:46:39.611009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'310","last_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_deep_scrub":"29'310","last_deep_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.610919+0000","objects_scrubbed":1,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:38:41.341946+0000","scrub_duration":0.004221219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074186+0000","last_change":"2023-12-01T23:18:34.831517+0000","last_active":"2023-12-01T23:46:20.074186+0000","last_peered":"2023-12-01T23:46:20.074186+0000","last_clean":"2023-12-01T23:46:20.074186+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:46:20.074186+0000","last_undegraded":"2023-12-01T23:46:20.074186+0000","last_fullsized":"2023-12-01T23:46:20.074186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.574002+0000","last_change":"2023-12-01T23:46:54.574038+0000","last_active":"2023-12-01T23:46:54.574002+0000","last_peered":"2023-12-01T23:46:54.574002+0000","last_clean":"2023-12-01T23:46:54.574002+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:54.574002+0000","last_undegraded":"2023-12-01T23:46:54.574002+0000","last_fullsized":"2023-12-01T23:46:54.574002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.573897+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:57.397531+0000","scrub_duration":0.0014970319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.066892+0000","last_change":"2023-12-01T23:46:39.066910+0000","last_active":"2023-12-01T23:46:39.066892+0000","last_peered":"2023-12-01T23:46:39.066892+0000","last_clean":"2023-12-01T23:46:39.066892+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:46:39.066892+0000","last_undegraded":"2023-12-01T23:46:39.066892+0000","last_fullsized":"2023-12-01T23:46:39.066892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.066832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:46.974193+0000","scrub_duration":0.001216946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":169,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.582801+0000","last_change":"2023-12-01T23:46:48.582841+0000","last_active":"2023-12-01T23:46:48.582801+0000","last_peered":"2023-12-01T23:46:48.582801+0000","last_clean":"2023-12-01T23:46:48.582801+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:46:48.582801+0000","last_undegraded":"2023-12-01T23:46:48.582801+0000","last_fullsized":"2023-12-01T23:46:48.582801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.582715+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:39.547933+0000","scrub_duration":0.0027570889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.178914+0000","last_change":"2023-12-01T23:46:56.178935+0000","last_active":"2023-12-01T23:46:56.178914+0000","last_peered":"2023-12-01T23:46:56.178914+0000","last_clean":"2023-12-01T23:46:56.178914+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:56.178914+0000","last_undegraded":"2023-12-01T23:46:56.178914+0000","last_fullsized":"2023-12-01T23:46:56.178914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.178803+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:21.586011+0000","scrub_duration":0.0019174109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.541598+0000","last_change":"2023-12-01T23:46:48.541631+0000","last_active":"2023-12-01T23:46:48.541598+0000","last_peered":"2023-12-01T23:46:48.541598+0000","last_clean":"2023-12-01T23:46:48.541598+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:46:48.541598+0000","last_undegraded":"2023-12-01T23:46:48.541598+0000","last_fullsized":"2023-12-01T23:46:48.541598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.541502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:48.706314+0000","scrub_duration":0.001231413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988848+0000","last_change":"2023-12-01T23:18:34.832561+0000","last_active":"2023-12-01T23:45:41.988848+0000","last_peered":"2023-12-01T23:45:41.988848+0000","last_clean":"2023-12-01T23:45:41.988848+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:45:41.988848+0000","last_undegraded":"2023-12-01T23:45:41.988848+0000","last_fullsized":"2023-12-01T23:45:41.988848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.526300+0000","last_change":"2023-12-01T23:46:31.526319+0000","last_active":"2023-12-01T23:46:31.526300+0000","last_peered":"2023-12-01T23:46:31.526300+0000","last_clean":"2023-12-01T23:46:31.526300+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:31.526300+0000","last_undegraded":"2023-12-01T23:46:31.526300+0000","last_fullsized":"2023-12-01T23:46:31.526300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.526232+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:11.365141+0000","scrub_duration":0.0014675910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.191480+0000","last_change":"2023-12-01T23:46:45.191499+0000","last_active":"2023-12-01T23:46:45.191480+0000","last_peered":"2023-12-01T23:46:45.191480+0000","last_clean":"2023-12-01T23:46:45.191480+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:46:45.191480+0000","last_undegraded":"2023-12-01T23:46:45.191480+0000","last_fullsized":"2023-12-01T23:46:45.191480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.191418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:55.761819+0000","scrub_duration":0.00187754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988880+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:41.988880+0000","last_peered":"2023-12-01T23:45:41.988880+0000","last_clean":"2023-12-01T23:45:41.988880+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:41.988880+0000","last_undegraded":"2023-12-01T23:45:41.988880+0000","last_fullsized":"2023-12-01T23:45:41.988880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568596+0000","last_change":"2023-12-01T23:18:28.865328+0000","last_active":"2023-12-01T23:46:18.568596+0000","last_peered":"2023-12-01T23:46:18.568596+0000","last_clean":"2023-12-01T23:46:18.568596+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:46:18.568596+0000","last_undegraded":"2023-12-01T23:46:18.568596+0000","last_fullsized":"2023-12-01T23:46:18.568596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2103,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.643969+0000","last_change":"2023-12-01T23:46:24.643989+0000","last_active":"2023-12-01T23:46:24.643969+0000","last_peered":"2023-12-01T23:46:24.643969+0000","last_clean":"2023-12-01T23:46:24.643969+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:24.643969+0000","last_undegraded":"2023-12-01T23:46:24.643969+0000","last_fullsized":"2023-12-01T23:46:24.643969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1033","last_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_deep_scrub":"29'1033","last_deep_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.643892+0000","objects_scrubbed":1,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:26:33.573885+0000","scrub_duration":0.0020141569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568739+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:46:18.568739+0000","last_peered":"2023-12-01T23:46:18.568739+0000","last_clean":"2023-12-01T23:46:18.568739+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:46:18.568739+0000","last_undegraded":"2023-12-01T23:46:18.568739+0000","last_fullsized":"2023-12-01T23:46:18.568739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.717873+0000","last_change":"2023-12-01T23:46:31.717892+0000","last_active":"2023-12-01T23:46:31.717873+0000","last_peered":"2023-12-01T23:46:31.717873+0000","last_clean":"2023-12-01T23:46:31.717873+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:31.717873+0000","last_undegraded":"2023-12-01T23:46:31.717873+0000","last_fullsized":"2023-12-01T23:46:31.717873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.717809+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:26.928183+0000","scrub_duration":0.001388479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'522","reported_seq":564,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.125261+0000","last_change":"2023-12-01T23:46:32.125261+0000","last_active":"2023-12-01T23:46:32.125261+0000","last_peered":"2023-12-01T23:46:32.125261+0000","last_clean":"2023-12-01T23:46:32.125261+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:46:32.125261+0000","last_undegraded":"2023-12-01T23:46:32.125261+0000","last_fullsized":"2023-12-01T23:46:32.125261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'522","last_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_deep_scrub":"29'522","last_deep_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.125130+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:58.630445+0000","scrub_duration":0.014960424999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.667378+0000","last_change":"2023-12-01T23:46:43.667378+0000","last_active":"2023-12-01T23:46:43.667378+0000","last_peered":"2023-12-01T23:46:43.667378+0000","last_clean":"2023-12-01T23:46:43.667378+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:46:43.667378+0000","last_undegraded":"2023-12-01T23:46:43.667378+0000","last_fullsized":"2023-12-01T23:46:43.667378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.667288+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:26.019724+0000","scrub_duration":0.0024242619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.062424+0000","last_change":"2023-12-01T23:46:48.062444+0000","last_active":"2023-12-01T23:46:48.062424+0000","last_peered":"2023-12-01T23:46:48.062424+0000","last_clean":"2023-12-01T23:46:48.062424+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:48.062424+0000","last_undegraded":"2023-12-01T23:46:48.062424+0000","last_fullsized":"2023-12-01T23:46:48.062424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.062339+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:13:29.754649+0000","scrub_duration":0.0018067599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.294992+0000","last_change":"2023-12-01T23:46:41.295012+0000","last_active":"2023-12-01T23:46:41.294992+0000","last_peered":"2023-12-01T23:46:41.294992+0000","last_clean":"2023-12-01T23:46:41.294992+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:46:41.294992+0000","last_undegraded":"2023-12-01T23:46:41.294992+0000","last_fullsized":"2023-12-01T23:46:41.294992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.294917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:36.505291+0000","scrub_duration":0.0016126510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.061262+0000","last_change":"2023-12-01T23:46:29.061287+0000","last_active":"2023-12-01T23:46:29.061262+0000","last_peered":"2023-12-01T23:46:29.061262+0000","last_clean":"2023-12-01T23:46:29.061262+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:46:29.061262+0000","last_undegraded":"2023-12-01T23:46:29.061262+0000","last_fullsized":"2023-12-01T23:46:29.061262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.061209+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:06.598456+0000","scrub_duration":0.0040676059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.697944+0000","last_change":"2023-12-01T23:46:59.697967+0000","last_active":"2023-12-01T23:46:59.697944+0000","last_peered":"2023-12-01T23:46:59.697944+0000","last_clean":"2023-12-01T23:46:59.697944+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:46:59.697944+0000","last_undegraded":"2023-12-01T23:46:59.697944+0000","last_fullsized":"2023-12-01T23:46:59.697944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.697850+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:18.163921+0000","scrub_duration":0.003308929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.830125+0000","last_change":"2023-12-01T23:47:02.830146+0000","last_active":"2023-12-01T23:47:02.830125+0000","last_peered":"2023-12-01T23:47:02.830125+0000","last_clean":"2023-12-01T23:47:02.830125+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:47:02.830125+0000","last_undegraded":"2023-12-01T23:47:02.830125+0000","last_fullsized":"2023-12-01T23:47:02.830125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.830060+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:14:34.055454+0000","scrub_duration":0.001200696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.655724+0000","last_change":"2023-12-01T23:46:25.655758+0000","last_active":"2023-12-01T23:46:25.655724+0000","last_peered":"2023-12-01T23:46:25.655724+0000","last_clean":"2023-12-01T23:46:25.655724+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:46:25.655724+0000","last_undegraded":"2023-12-01T23:46:25.655724+0000","last_fullsized":"2023-12-01T23:46:25.655724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.655632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:50:43.867354+0000","scrub_duration":0.001438878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.735859+0000","last_change":"2023-12-01T23:46:55.735897+0000","last_active":"2023-12-01T23:46:55.735859+0000","last_peered":"2023-12-01T23:46:55.735859+0000","last_clean":"2023-12-01T23:46:55.735859+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:46:55.735859+0000","last_undegraded":"2023-12-01T23:46:55.735859+0000","last_fullsized":"2023-12-01T23:46:55.735859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.735760+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:52.091018+0000","scrub_duration":0.0025007599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.627943+0000","last_change":"2023-12-01T23:46:33.627977+0000","last_active":"2023-12-01T23:46:33.627943+0000","last_peered":"2023-12-01T23:46:33.627943+0000","last_clean":"2023-12-01T23:46:33.627943+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:33.627943+0000","last_undegraded":"2023-12-01T23:46:33.627943+0000","last_fullsized":"2023-12-01T23:46:33.627943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.627841+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:47.591432+0000","scrub_duration":0.001328142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.628643+0000","last_change":"2023-12-01T23:46:26.628664+0000","last_active":"2023-12-01T23:46:26.628643+0000","last_peered":"2023-12-01T23:46:26.628643+0000","last_clean":"2023-12-01T23:46:26.628643+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:26.628643+0000","last_undegraded":"2023-12-01T23:46:26.628643+0000","last_fullsized":"2023-12-01T23:46:26.628643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.628583+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:50.083961+0000","scrub_duration":0.002604281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.606653+0000","last_change":"2023-12-01T23:46:55.606690+0000","last_active":"2023-12-01T23:46:55.606653+0000","last_peered":"2023-12-01T23:46:55.606653+0000","last_clean":"2023-12-01T23:46:55.606653+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:46:55.606653+0000","last_undegraded":"2023-12-01T23:46:55.606653+0000","last_fullsized":"2023-12-01T23:46:55.606653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'186","last_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_deep_scrub":"29'186","last_deep_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.606555+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:01.704072+0000","scrub_duration":0.0027214320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.581148+0000","last_change":"2023-12-01T23:18:28.871843+0000","last_active":"2023-12-01T23:46:07.581148+0000","last_peered":"2023-12-01T23:46:07.581148+0000","last_clean":"2023-12-01T23:46:07.581148+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:46:07.581148+0000","last_undegraded":"2023-12-01T23:46:07.581148+0000","last_fullsized":"2023-12-01T23:46:07.581148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:19.564746+0000","last_change":"2023-12-01T23:46:19.564768+0000","last_active":"2023-12-01T23:46:19.564746+0000","last_peered":"2023-12-01T23:46:19.564746+0000","last_clean":"2023-12-01T23:46:19.564746+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:46:19.564746+0000","last_undegraded":"2023-12-01T23:46:19.564746+0000","last_fullsized":"2023-12-01T23:46:19.564746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:19.564681+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:07:18.833129+0000","scrub_duration":0.0023607229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.625656+0000","last_change":"2023-12-01T23:18:34.790464+0000","last_active":"2023-12-01T23:46:21.625656+0000","last_peered":"2023-12-01T23:46:21.625656+0000","last_clean":"2023-12-01T23:46:21.625656+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:46:21.625656+0000","last_undegraded":"2023-12-01T23:46:21.625656+0000","last_fullsized":"2023-12-01T23:46:21.625656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.819369+0000","last_change":"2023-12-01T23:47:00.819389+0000","last_active":"2023-12-01T23:47:00.819369+0000","last_peered":"2023-12-01T23:47:00.819369+0000","last_clean":"2023-12-01T23:47:00.819369+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:47:00.819369+0000","last_undegraded":"2023-12-01T23:47:00.819369+0000","last_fullsized":"2023-12-01T23:47:00.819369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.819291+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:46.554163+0000","scrub_duration":0.001268436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.537130+0000","last_change":"2023-12-01T23:46:21.537165+0000","last_active":"2023-12-01T23:46:21.537130+0000","last_peered":"2023-12-01T23:46:21.537130+0000","last_clean":"2023-12-01T23:46:21.537130+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:46:21.537130+0000","last_undegraded":"2023-12-01T23:46:21.537130+0000","last_fullsized":"2023-12-01T23:46:21.537130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_clean_scrub_stamp":"2023-12-01T23:46:21.537038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:17.479391+0000","scrub_duration":0.0027855789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.762785+0000","last_change":"2023-12-01T23:46:59.762823+0000","last_active":"2023-12-01T23:46:59.762785+0000","last_peered":"2023-12-01T23:46:59.762785+0000","last_clean":"2023-12-01T23:46:59.762785+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:46:59.762785+0000","last_undegraded":"2023-12-01T23:46:59.762785+0000","last_fullsized":"2023-12-01T23:46:59.762785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'171","last_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_deep_scrub":"29'171","last_deep_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.762681+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:37.020845+0000","scrub_duration":0.0029108900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.935278+0000","last_change":"2023-12-01T23:46:55.935325+0000","last_active":"2023-12-01T23:46:55.935278+0000","last_peered":"2023-12-01T23:46:55.935278+0000","last_clean":"2023-12-01T23:46:55.935278+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:55.935278+0000","last_undegraded":"2023-12-01T23:46:55.935278+0000","last_fullsized":"2023-12-01T23:46:55.935278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.935190+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:38.287626+0000","scrub_duration":0.0013732950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.631874+0000","last_change":"2023-12-01T23:46:22.631874+0000","last_active":"2023-12-01T23:46:22.631874+0000","last_peered":"2023-12-01T23:46:22.631874+0000","last_clean":"2023-12-01T23:46:22.631874+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:46:22.631874+0000","last_undegraded":"2023-12-01T23:46:22.631874+0000","last_fullsized":"2023-12-01T23:46:22.631874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.631783+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:27:42.297274+0000","scrub_duration":0.0059878589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":165,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.654338+0000","last_change":"2023-12-01T23:46:46.654375+0000","last_active":"2023-12-01T23:46:46.654338+0000","last_peered":"2023-12-01T23:46:46.654338+0000","last_clean":"2023-12-01T23:46:46.654338+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:46:46.654338+0000","last_undegraded":"2023-12-01T23:46:46.654338+0000","last_fullsized":"2023-12-01T23:46:46.654338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'130","last_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_deep_scrub":"29'130","last_deep_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.654234+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:09:47.109603+0000","scrub_duration":0.0026405740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.650489+0000","last_change":"2023-12-01T23:46:41.650508+0000","last_active":"2023-12-01T23:46:41.650489+0000","last_peered":"2023-12-01T23:46:41.650489+0000","last_clean":"2023-12-01T23:46:41.650489+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:41.650489+0000","last_undegraded":"2023-12-01T23:46:41.650489+0000","last_fullsized":"2023-12-01T23:46:41.650489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.650424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:03.590799+0000","scrub_duration":0.0014981689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.719656+0000","last_change":"2023-12-01T23:46:31.719675+0000","last_active":"2023-12-01T23:46:31.719656+0000","last_peered":"2023-12-01T23:46:31.719656+0000","last_clean":"2023-12-01T23:46:31.719656+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:46:31.719656+0000","last_undegraded":"2023-12-01T23:46:31.719656+0000","last_fullsized":"2023-12-01T23:46:31.719656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.719600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:15.461606+0000","scrub_duration":0.00093897100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.088461+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:40.088461+0000","last_peered":"2023-12-01T23:45:40.088461+0000","last_clean":"2023-12-01T23:45:40.088461+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:40.088461+0000","last_undegraded":"2023-12-01T23:45:40.088461+0000","last_fullsized":"2023-12-01T23:45:40.088461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.679138+0000","last_change":"2023-12-01T23:46:29.679160+0000","last_active":"2023-12-01T23:46:29.679138+0000","last_peered":"2023-12-01T23:46:29.679138+0000","last_clean":"2023-12-01T23:46:29.679138+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:29.679138+0000","last_undegraded":"2023-12-01T23:46:29.679138+0000","last_fullsized":"2023-12-01T23:46:29.679138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.679065+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:25.621418+0000","scrub_duration":0.0015688550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.298846+0000","last_change":"2023-12-01T23:46:40.298865+0000","last_active":"2023-12-01T23:46:40.298846+0000","last_peered":"2023-12-01T23:46:40.298846+0000","last_clean":"2023-12-01T23:46:40.298846+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:46:40.298846+0000","last_undegraded":"2023-12-01T23:46:40.298846+0000","last_fullsized":"2023-12-01T23:46:40.298846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.298785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:00:12.873162+0000","scrub_duration":0.0013254339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":146,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074228+0000","last_change":"2023-12-01T23:18:34.840480+0000","last_active":"2023-12-01T23:46:20.074228+0000","last_peered":"2023-12-01T23:46:20.074228+0000","last_clean":"2023-12-01T23:46:20.074228+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:46:20.074228+0000","last_undegraded":"2023-12-01T23:46:20.074228+0000","last_fullsized":"2023-12-01T23:46:20.074228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.707881+0000","last_change":"2023-12-01T23:46:32.707923+0000","last_active":"2023-12-01T23:46:32.707881+0000","last_peered":"2023-12-01T23:46:32.707881+0000","last_clean":"2023-12-01T23:46:32.707881+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:32.707881+0000","last_undegraded":"2023-12-01T23:46:32.707881+0000","last_fullsized":"2023-12-01T23:46:32.707881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.707812+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:51.859421+0000","scrub_duration":0.0017506170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'258","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.834421+0000","last_change":"2023-12-01T23:46:22.834421+0000","last_active":"2023-12-01T23:46:22.834421+0000","last_peered":"2023-12-01T23:46:22.834421+0000","last_clean":"2023-12-01T23:46:22.834421+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:22.834421+0000","last_undegraded":"2023-12-01T23:46:22.834421+0000","last_fullsized":"2023-12-01T23:46:22.834421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.834344+0000","objects_scrubbed":3,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:00.371590+0000","scrub_duration":0.010238596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:39.281868+0000","last_change":"2023-12-01T23:18:34.837977+0000","last_active":"2023-12-01T23:45:39.281868+0000","last_peered":"2023-12-01T23:45:39.281868+0000","last_clean":"2023-12-01T23:45:39.281868+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:45:39.281868+0000","last_undegraded":"2023-12-01T23:45:39.281868+0000","last_fullsized":"2023-12-01T23:45:39.281868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.897130+0000","last_change":"2023-12-01T23:46:54.897151+0000","last_active":"2023-12-01T23:46:54.897130+0000","last_peered":"2023-12-01T23:46:54.897130+0000","last_clean":"2023-12-01T23:46:54.897130+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:54.897130+0000","last_undegraded":"2023-12-01T23:46:54.897130+0000","last_fullsized":"2023-12-01T23:46:54.897130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.897063+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:19.398843+0000","scrub_duration":0.0017864280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'837","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.690721+0000","last_change":"2023-12-01T23:46:22.690721+0000","last_active":"2023-12-01T23:46:22.690721+0000","last_peered":"2023-12-01T23:46:22.690721+0000","last_clean":"2023-12-01T23:46:22.690721+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:46:22.690721+0000","last_undegraded":"2023-12-01T23:46:22.690721+0000","last_fullsized":"2023-12-01T23:46:22.690721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.690602+0000","objects_scrubbed":4,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:40:26.291990+0000","scrub_duration":0.015828854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568754+0000","last_change":"2023-12-01T23:18:34.841512+0000","last_active":"2023-12-01T23:46:18.568754+0000","last_peered":"2023-12-01T23:46:18.568754+0000","last_clean":"2023-12-01T23:46:18.568754+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:46:18.568754+0000","last_undegraded":"2023-12-01T23:46:18.568754+0000","last_fullsized":"2023-12-01T23:46:18.568754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.557956+0000","last_change":"2023-12-01T23:46:24.557956+0000","last_active":"2023-12-01T23:46:24.557956+0000","last_peered":"2023-12-01T23:46:24.557956+0000","last_clean":"2023-12-01T23:46:24.557956+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:24.557956+0000","last_undegraded":"2023-12-01T23:46:24.557956+0000","last_fullsized":"2023-12-01T23:46:24.557956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.557856+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:42.299451+0000","scrub_duration":0.0012882550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'697","reported_seq":736,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.664433+0000","last_change":"2023-12-01T23:46:28.664462+0000","last_active":"2023-12-01T23:46:28.664433+0000","last_peered":"2023-12-01T23:46:28.664433+0000","last_clean":"2023-12-01T23:46:28.664433+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:28.664433+0000","last_undegraded":"2023-12-01T23:46:28.664433+0000","last_fullsized":"2023-12-01T23:46:28.664433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.664354+0000","objects_scrubbed":2,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:29:54.783596+0000","scrub_duration":0.0041761050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.689438+0000","last_change":"2023-12-01T23:46:55.689459+0000","last_active":"2023-12-01T23:46:55.689438+0000","last_peered":"2023-12-01T23:46:55.689438+0000","last_clean":"2023-12-01T23:46:55.689438+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:46:55.689438+0000","last_undegraded":"2023-12-01T23:46:55.689438+0000","last_fullsized":"2023-12-01T23:46:55.689438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'157","last_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_deep_scrub":"29'157","last_deep_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.689362+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:58.512996+0000","scrub_duration":0.002487628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.782476+0000","last_change":"2023-12-01T23:46:26.782497+0000","last_active":"2023-12-01T23:46:26.782476+0000","last_peered":"2023-12-01T23:46:26.782476+0000","last_clean":"2023-12-01T23:46:26.782476+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:26.782476+0000","last_undegraded":"2023-12-01T23:46:26.782476+0000","last_fullsized":"2023-12-01T23:46:26.782476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.782401+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:01:23.398097+0000","scrub_duration":0.0019853919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.366665+0000","last_change":"2023-12-01T23:46:36.366716+0000","last_active":"2023-12-01T23:46:36.366665+0000","last_peered":"2023-12-01T23:46:36.366665+0000","last_clean":"2023-12-01T23:46:36.366665+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:46:36.366665+0000","last_undegraded":"2023-12-01T23:46:36.366665+0000","last_fullsized":"2023-12-01T23:46:36.366665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.366584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:17.897390+0000","scrub_duration":0.0011632089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074211+0000","last_change":"2023-12-01T23:18:34.790234+0000","last_active":"2023-12-01T23:46:20.074211+0000","last_peered":"2023-12-01T23:46:20.074211+0000","last_clean":"2023-12-01T23:46:20.074211+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:46:20.074211+0000","last_undegraded":"2023-12-01T23:46:20.074211+0000","last_fullsized":"2023-12-01T23:46:20.074211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.338881+0000","last_change":"2023-12-01T23:46:28.338925+0000","last_active":"2023-12-01T23:46:28.338881+0000","last_peered":"2023-12-01T23:46:28.338881+0000","last_clean":"2023-12-01T23:46:28.338881+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:28.338881+0000","last_undegraded":"2023-12-01T23:46:28.338881+0000","last_fullsized":"2023-12-01T23:46:28.338881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.338785+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:45:52.136028+0000","scrub_duration":0.0016464509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:35.654539+0000","last_change":"2023-12-01T23:46:35.654557+0000","last_active":"2023-12-01T23:46:35.654539+0000","last_peered":"2023-12-01T23:46:35.654539+0000","last_clean":"2023-12-01T23:46:35.654539+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:46:35.654539+0000","last_undegraded":"2023-12-01T23:46:35.654539+0000","last_fullsized":"2023-12-01T23:46:35.654539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_clean_scrub_stamp":"2023-12-01T23:46:35.654472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:04:47.022634+0000","scrub_duration":0.001093908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.074206+0000","last_change":"2023-12-01T23:18:34.791338+0000","last_active":"2023-12-01T23:46:20.074206+0000","last_peered":"2023-12-01T23:46:20.074206+0000","last_clean":"2023-12-01T23:46:20.074206+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:46:20.074206+0000","last_undegraded":"2023-12-01T23:46:20.074206+0000","last_fullsized":"2023-12-01T23:46:20.074206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.578493+0000","last_change":"2023-12-01T23:46:52.578528+0000","last_active":"2023-12-01T23:46:52.578493+0000","last_peered":"2023-12-01T23:46:52.578493+0000","last_clean":"2023-12-01T23:46:52.578493+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:46:52.578493+0000","last_undegraded":"2023-12-01T23:46:52.578493+0000","last_fullsized":"2023-12-01T23:46:52.578493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.578401+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:50.768577+0000","scrub_duration":0.0025899289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:53.575402+0000","last_change":"2023-12-01T23:46:53.575421+0000","last_active":"2023-12-01T23:46:53.575402+0000","last_peered":"2023-12-01T23:46:53.575402+0000","last_clean":"2023-12-01T23:46:53.575402+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:53.575402+0000","last_undegraded":"2023-12-01T23:46:53.575402+0000","last_fullsized":"2023-12-01T23:46:53.575402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_clean_scrub_stamp":"2023-12-01T23:46:53.575336+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:30:00.456637+0000","scrub_duration":0.001325278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.355761+0000","last_change":"2023-12-01T23:46:33.355780+0000","last_active":"2023-12-01T23:46:33.355761+0000","last_peered":"2023-12-01T23:46:33.355761+0000","last_clean":"2023-12-01T23:46:33.355761+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:33.355761+0000","last_undegraded":"2023-12-01T23:46:33.355761+0000","last_fullsized":"2023-12-01T23:46:33.355761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.355695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:18.846237+0000","scrub_duration":0.001158233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.677171+0000","last_change":"2023-12-01T23:47:00.677212+0000","last_active":"2023-12-01T23:47:00.677171+0000","last_peered":"2023-12-01T23:47:00.677171+0000","last_clean":"2023-12-01T23:47:00.677171+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:47:00.677171+0000","last_undegraded":"2023-12-01T23:47:00.677171+0000","last_fullsized":"2023-12-01T23:47:00.677171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'139","last_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_deep_scrub":"29'139","last_deep_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.677068+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:15:58.982047+0000","scrub_duration":0.0026136110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.044121+0000","last_change":"2023-12-01T23:46:50.044143+0000","last_active":"2023-12-01T23:46:50.044121+0000","last_peered":"2023-12-01T23:46:50.044121+0000","last_clean":"2023-12-01T23:46:50.044121+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:50.044121+0000","last_undegraded":"2023-12-01T23:46:50.044121+0000","last_fullsized":"2023-12-01T23:46:50.044121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.044041+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:15.451249+0000","scrub_duration":0.0013565980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.023231+0000","last_change":"2023-12-01T23:46:40.023249+0000","last_active":"2023-12-01T23:46:40.023231+0000","last_peered":"2023-12-01T23:46:40.023231+0000","last_clean":"2023-12-01T23:46:40.023231+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:46:40.023231+0000","last_undegraded":"2023-12-01T23:46:40.023231+0000","last_fullsized":"2023-12-01T23:46:40.023231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.023168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:04:05.565732+0000","scrub_duration":0.0015748159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.712232+0000","last_change":"2023-12-01T23:46:26.712257+0000","last_active":"2023-12-01T23:46:26.712232+0000","last_peered":"2023-12-01T23:46:26.712232+0000","last_clean":"2023-12-01T23:46:26.712232+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:46:26.712232+0000","last_undegraded":"2023-12-01T23:46:26.712232+0000","last_fullsized":"2023-12-01T23:46:26.712232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'688","last_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_deep_scrub":"29'688","last_deep_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.712170+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:40.675762+0000","scrub_duration":0.015526883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.913858+0000","last_change":"2023-12-01T23:46:17.913876+0000","last_active":"2023-12-01T23:46:17.913858+0000","last_peered":"2023-12-01T23:46:17.913858+0000","last_clean":"2023-12-01T23:46:17.913858+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:17.913858+0000","last_undegraded":"2023-12-01T23:46:17.913858+0000","last_fullsized":"2023-12-01T23:46:17.913858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_clean_scrub_stamp":"2023-12-01T23:46:17.913795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:35.764452+0000","scrub_duration":0.0020485220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.618263+0000","last_change":"2023-12-01T23:46:27.618286+0000","last_active":"2023-12-01T23:46:27.618263+0000","last_peered":"2023-12-01T23:46:27.618263+0000","last_clean":"2023-12-01T23:46:27.618263+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:46:27.618263+0000","last_undegraded":"2023-12-01T23:46:27.618263+0000","last_fullsized":"2023-12-01T23:46:27.618263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'79","last_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_deep_scrub":"29'79","last_deep_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.618173+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:55:34.334662+0000","scrub_duration":0.002712112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'677","reported_seq":716,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.082022+0000","last_change":"2023-12-01T23:46:39.082058+0000","last_active":"2023-12-01T23:46:39.082022+0000","last_peered":"2023-12-01T23:46:39.082022+0000","last_clean":"2023-12-01T23:46:39.082022+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:46:39.082022+0000","last_undegraded":"2023-12-01T23:46:39.082022+0000","last_fullsized":"2023-12-01T23:46:39.082022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'677","last_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_deep_scrub":"29'677","last_deep_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.081954+0000","objects_scrubbed":1,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:38.963801+0000","scrub_duration":0.018891622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.563173+0000","last_change":"2023-12-01T23:46:22.563206+0000","last_active":"2023-12-01T23:46:22.563173+0000","last_peered":"2023-12-01T23:46:22.563173+0000","last_clean":"2023-12-01T23:46:22.563173+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:22.563173+0000","last_undegraded":"2023-12-01T23:46:22.563173+0000","last_fullsized":"2023-12-01T23:46:22.563173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.563080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:56.997610+0000","scrub_duration":0.001814476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:04.056615+0000","last_change":"2023-12-01T23:18:34.838296+0000","last_active":"2023-12-01T23:46:04.056615+0000","last_peered":"2023-12-01T23:46:04.056615+0000","last_clean":"2023-12-01T23:46:04.056615+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:46:04.056615+0000","last_undegraded":"2023-12-01T23:46:04.056615+0000","last_fullsized":"2023-12-01T23:46:04.056615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.826074+0000","last_change":"2023-12-01T23:46:46.826094+0000","last_active":"2023-12-01T23:46:46.826074+0000","last_peered":"2023-12-01T23:46:46.826074+0000","last_clean":"2023-12-01T23:46:46.826074+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:46.826074+0000","last_undegraded":"2023-12-01T23:46:46.826074+0000","last_fullsized":"2023-12-01T23:46:46.826074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.826007+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:54:22.515338+0000","scrub_duration":0.001437015,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.641266+0000","last_change":"2023-12-01T23:46:34.641284+0000","last_active":"2023-12-01T23:46:34.641266+0000","last_peered":"2023-12-01T23:46:34.641266+0000","last_clean":"2023-12-01T23:46:34.641266+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:34.641266+0000","last_undegraded":"2023-12-01T23:46:34.641266+0000","last_fullsized":"2023-12-01T23:46:34.641266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.641201+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:52.382796+0000","scrub_duration":0.0012133529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.259763+0000","last_change":"2023-12-01T23:47:00.259785+0000","last_active":"2023-12-01T23:47:00.259763+0000","last_peered":"2023-12-01T23:47:00.259763+0000","last_clean":"2023-12-01T23:47:00.259763+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:47:00.259763+0000","last_undegraded":"2023-12-01T23:47:00.259763+0000","last_fullsized":"2023-12-01T23:47:00.259763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.259685+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:58.449861+0000","scrub_duration":0.0017484359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.673858+0000","last_change":"2023-12-01T23:46:37.673877+0000","last_active":"2023-12-01T23:46:37.673858+0000","last_peered":"2023-12-01T23:46:37.673858+0000","last_clean":"2023-12-01T23:46:37.673858+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:37.673858+0000","last_undegraded":"2023-12-01T23:46:37.673858+0000","last_fullsized":"2023-12-01T23:46:37.673858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.673790+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:09.493981+0000","scrub_duration":0.0014334879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.107049+0000","last_change":"2023-12-01T23:46:34.107049+0000","last_active":"2023-12-01T23:46:34.107049+0000","last_peered":"2023-12-01T23:46:34.107049+0000","last_clean":"2023-12-01T23:46:34.107049+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:34.107049+0000","last_undegraded":"2023-12-01T23:46:34.107049+0000","last_fullsized":"2023-12-01T23:46:34.107049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.106923+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:29.317297+0000","scrub_duration":0.001525958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.536617+0000","last_change":"2023-12-01T23:46:56.536637+0000","last_active":"2023-12-01T23:46:56.536617+0000","last_peered":"2023-12-01T23:46:56.536617+0000","last_clean":"2023-12-01T23:46:56.536617+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:56.536617+0000","last_undegraded":"2023-12-01T23:46:56.536617+0000","last_fullsized":"2023-12-01T23:46:56.536617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.536539+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:15:59.378966+0000","scrub_duration":0.001488685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.689584+0000","last_change":"2023-12-01T23:46:42.689584+0000","last_active":"2023-12-01T23:46:42.689584+0000","last_peered":"2023-12-01T23:46:42.689584+0000","last_clean":"2023-12-01T23:46:42.689584+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:42.689584+0000","last_undegraded":"2023-12-01T23:46:42.689584+0000","last_fullsized":"2023-12-01T23:46:42.689584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.689499+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:18:16.705098+0000","scrub_duration":0.0011022670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.047350+0000","last_change":"2023-12-01T23:46:26.047350+0000","last_active":"2023-12-01T23:46:26.047350+0000","last_peered":"2023-12-01T23:46:26.047350+0000","last_clean":"2023-12-01T23:46:26.047350+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:26.047350+0000","last_undegraded":"2023-12-01T23:46:26.047350+0000","last_fullsized":"2023-12-01T23:46:26.047350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.047200+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:26.854020+0000","scrub_duration":0.0017362949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.198415+0000","last_change":"2023-12-01T23:46:51.198438+0000","last_active":"2023-12-01T23:46:51.198415+0000","last_peered":"2023-12-01T23:46:51.198415+0000","last_clean":"2023-12-01T23:46:51.198415+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:51.198415+0000","last_undegraded":"2023-12-01T23:46:51.198415+0000","last_fullsized":"2023-12-01T23:46:51.198415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.198334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:15.700114+0000","scrub_duration":0.001943721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.044001+0000","last_change":"2023-12-01T23:46:51.044035+0000","last_active":"2023-12-01T23:46:51.044001+0000","last_peered":"2023-12-01T23:46:51.044001+0000","last_clean":"2023-12-01T23:46:51.044001+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:51.044001+0000","last_undegraded":"2023-12-01T23:46:51.044001+0000","last_fullsized":"2023-12-01T23:46:51.044001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.043920+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:36.778792+0000","scrub_duration":0.001802297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.289908+0000","last_change":"2023-12-01T23:47:01.289932+0000","last_active":"2023-12-01T23:47:01.289908+0000","last_peered":"2023-12-01T23:47:01.289908+0000","last_clean":"2023-12-01T23:47:01.289908+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:47:01.289908+0000","last_undegraded":"2023-12-01T23:47:01.289908+0000","last_fullsized":"2023-12-01T23:47:01.289908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.289823+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:15:15.160034+0000","scrub_duration":0.001556446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.701165+0000","last_change":"2023-12-01T23:46:42.701183+0000","last_active":"2023-12-01T23:46:42.701165+0000","last_peered":"2023-12-01T23:46:42.701165+0000","last_clean":"2023-12-01T23:46:42.701165+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:42.701165+0000","last_undegraded":"2023-12-01T23:46:42.701165+0000","last_fullsized":"2023-12-01T23:46:42.701165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.701106+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:17:19.446451+0000","scrub_duration":0.001533106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.628034+0000","last_change":"2023-12-01T23:46:36.628054+0000","last_active":"2023-12-01T23:46:36.628034+0000","last_peered":"2023-12-01T23:46:36.628034+0000","last_clean":"2023-12-01T23:46:36.628034+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:36.628034+0000","last_undegraded":"2023-12-01T23:46:36.628034+0000","last_fullsized":"2023-12-01T23:46:36.628034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.627948+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:57:18.693485+0000","scrub_duration":0.001270539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.578718+0000","last_change":"2023-12-01T23:18:28.865301+0000","last_active":"2023-12-01T23:46:07.578718+0000","last_peered":"2023-12-01T23:46:07.578718+0000","last_clean":"2023-12-01T23:46:07.578718+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:46:07.578718+0000","last_undegraded":"2023-12-01T23:46:07.578718+0000","last_fullsized":"2023-12-01T23:46:07.578718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.608302+0000","last_change":"2023-12-01T23:46:26.608302+0000","last_active":"2023-12-01T23:46:26.608302+0000","last_peered":"2023-12-01T23:46:26.608302+0000","last_clean":"2023-12-01T23:46:26.608302+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:26.608302+0000","last_undegraded":"2023-12-01T23:46:26.608302+0000","last_fullsized":"2023-12-01T23:46:26.608302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.608209+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:59:04.832666+0000","scrub_duration":0.001815189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:30.299426+0000","last_change":"2023-12-01T23:46:30.299447+0000","last_active":"2023-12-01T23:46:30.299426+0000","last_peered":"2023-12-01T23:46:30.299426+0000","last_clean":"2023-12-01T23:46:30.299426+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:30.299426+0000","last_undegraded":"2023-12-01T23:46:30.299426+0000","last_fullsized":"2023-12-01T23:46:30.299426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_clean_scrub_stamp":"2023-12-01T23:46:30.299352+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:55.857362+0000","scrub_duration":0.0016640419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.248304+0000","last_change":"2023-12-01T23:46:58.248328+0000","last_active":"2023-12-01T23:46:58.248304+0000","last_peered":"2023-12-01T23:46:58.248304+0000","last_clean":"2023-12-01T23:46:58.248304+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:58.248304+0000","last_undegraded":"2023-12-01T23:46:58.248304+0000","last_fullsized":"2023-12-01T23:46:58.248304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.248217+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:55.631573+0000","scrub_duration":0.001664198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.573753+0000","last_change":"2023-12-01T23:46:55.573772+0000","last_active":"2023-12-01T23:46:55.573753+0000","last_peered":"2023-12-01T23:46:55.573753+0000","last_clean":"2023-12-01T23:46:55.573753+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:55.573753+0000","last_undegraded":"2023-12-01T23:46:55.573753+0000","last_fullsized":"2023-12-01T23:46:55.573753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.573678+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:00.619061+0000","scrub_duration":0.0017204410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.804111+0000","last_change":"2023-12-01T23:46:25.804111+0000","last_active":"2023-12-01T23:46:25.804111+0000","last_peered":"2023-12-01T23:46:25.804111+0000","last_clean":"2023-12-01T23:46:25.804111+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:25.804111+0000","last_undegraded":"2023-12-01T23:46:25.804111+0000","last_fullsized":"2023-12-01T23:46:25.804111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.804022+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:51.362032+0000","scrub_duration":0.0012177780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.914785+0000","last_change":"2023-12-01T23:46:20.914819+0000","last_active":"2023-12-01T23:46:20.914785+0000","last_peered":"2023-12-01T23:46:20.914785+0000","last_clean":"2023-12-01T23:46:20.914785+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:20.914785+0000","last_undegraded":"2023-12-01T23:46:20.914785+0000","last_fullsized":"2023-12-01T23:46:20.914785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_clean_scrub_stamp":"2023-12-01T23:46:20.914690+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:47.420005+0000","scrub_duration":0.00189442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.574944+0000","last_change":"2023-12-01T23:46:27.574967+0000","last_active":"2023-12-01T23:46:27.574944+0000","last_peered":"2023-12-01T23:46:27.574944+0000","last_clean":"2023-12-01T23:46:27.574944+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:27.574944+0000","last_undegraded":"2023-12-01T23:46:27.574944+0000","last_fullsized":"2023-12-01T23:46:27.574944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.574851+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:54.288208+0000","scrub_duration":0.0016018880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.714945+0000","last_change":"2023-12-01T23:46:43.714964+0000","last_active":"2023-12-01T23:46:43.714945+0000","last_peered":"2023-12-01T23:46:43.714945+0000","last_clean":"2023-12-01T23:46:43.714945+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:43.714945+0000","last_undegraded":"2023-12-01T23:46:43.714945+0000","last_fullsized":"2023-12-01T23:46:43.714945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.714833+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:20:47.722456+0000","scrub_duration":0.0012353959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:47.793393+0000","last_change":"2023-12-01T23:46:47.793414+0000","last_active":"2023-12-01T23:46:47.793393+0000","last_peered":"2023-12-01T23:46:47.793393+0000","last_clean":"2023-12-01T23:46:47.793393+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:47.793393+0000","last_undegraded":"2023-12-01T23:46:47.793393+0000","last_fullsized":"2023-12-01T23:46:47.793393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_clean_scrub_stamp":"2023-12-01T23:46:47.793300+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:09:52.838684+0000","scrub_duration":0.0014654469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:07.581397+0000","last_change":"2023-12-01T23:18:28.878286+0000","last_active":"2023-12-01T23:46:07.581397+0000","last_peered":"2023-12-01T23:46:07.581397+0000","last_clean":"2023-12-01T23:46:07.581397+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:46:07.581397+0000","last_undegraded":"2023-12-01T23:46:07.581397+0000","last_fullsized":"2023-12-01T23:46:07.581397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:27.673577+0000","last_clean_scrub_stamp":"2023-12-01T23:18:27.673577+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.992196+0000","last_change":"2023-12-01T23:46:41.992215+0000","last_active":"2023-12-01T23:46:41.992196+0000","last_peered":"2023-12-01T23:46:41.992196+0000","last_clean":"2023-12-01T23:46:41.992196+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:41.992196+0000","last_undegraded":"2023-12-01T23:46:41.992196+0000","last_fullsized":"2023-12-01T23:46:41.992196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.992130+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:06.493909+0000","scrub_duration":0.001678983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.919845+0000","last_change":"2023-12-01T23:46:51.919900+0000","last_active":"2023-12-01T23:46:51.919845+0000","last_peered":"2023-12-01T23:46:51.919845+0000","last_clean":"2023-12-01T23:46:51.919845+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:51.919845+0000","last_undegraded":"2023-12-01T23:46:51.919845+0000","last_fullsized":"2023-12-01T23:46:51.919845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.919767+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:23.739958+0000","scrub_duration":0.001832024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.280960+0000","last_change":"2023-12-01T23:47:02.280989+0000","last_active":"2023-12-01T23:47:02.280960+0000","last_peered":"2023-12-01T23:47:02.280960+0000","last_clean":"2023-12-01T23:47:02.280960+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:47:02.280960+0000","last_undegraded":"2023-12-01T23:47:02.280960+0000","last_fullsized":"2023-12-01T23:47:02.280960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.280885+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:52:59.819161+0000","scrub_duration":0.001839079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.021716+0000","last_change":"2023-12-01T23:46:28.021737+0000","last_active":"2023-12-01T23:46:28.021716+0000","last_peered":"2023-12-01T23:46:28.021716+0000","last_clean":"2023-12-01T23:46:28.021716+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:28.021716+0000","last_undegraded":"2023-12-01T23:46:28.021716+0000","last_fullsized":"2023-12-01T23:46:28.021716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.021656+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:08:59.781744+0000","scrub_duration":0.0016958609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.188263+0000","last_change":"2023-12-01T23:46:55.188286+0000","last_active":"2023-12-01T23:46:55.188263+0000","last_peered":"2023-12-01T23:46:55.188263+0000","last_clean":"2023-12-01T23:46:55.188263+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:55.188263+0000","last_undegraded":"2023-12-01T23:46:55.188263+0000","last_fullsized":"2023-12-01T23:46:55.188263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.188182+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:56.798147+0000","scrub_duration":0.0018947809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.768099+0000","last_change":"2023-12-01T23:46:29.768119+0000","last_active":"2023-12-01T23:46:29.768099+0000","last_peered":"2023-12-01T23:46:29.768099+0000","last_clean":"2023-12-01T23:46:29.768099+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:29.768099+0000","last_undegraded":"2023-12-01T23:46:29.768099+0000","last_fullsized":"2023-12-01T23:46:29.768099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.768031+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.675393+0000","scrub_duration":0.001232375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.750831+0000","last_change":"2023-12-01T23:46:18.750868+0000","last_active":"2023-12-01T23:46:18.750831+0000","last_peered":"2023-12-01T23:46:18.750831+0000","last_clean":"2023-12-01T23:46:18.750831+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:18.750831+0000","last_undegraded":"2023-12-01T23:46:18.750831+0000","last_fullsized":"2023-12-01T23:46:18.750831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_clean_scrub_stamp":"2023-12-01T23:46:18.750724+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:36.492319+0000","scrub_duration":0.001499631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.812087+0000","last_change":"2023-12-01T23:46:59.812108+0000","last_active":"2023-12-01T23:46:59.812087+0000","last_peered":"2023-12-01T23:46:59.812087+0000","last_clean":"2023-12-01T23:46:59.812087+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:59.812087+0000","last_undegraded":"2023-12-01T23:46:59.812087+0000","last_fullsized":"2023-12-01T23:46:59.812087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.812008+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:25.219215+0000","scrub_duration":0.0022375279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8445,"ondisk_log_size":8445,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509790,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.63700000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.312,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.58399999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.501}]},{"osd":1,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.41299999999999998},"min":{"1min":0.29199999999999998,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66800000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.54400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.40200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.621},"last":0.38},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59099999999999997,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.42799999999999999,"15min":0.41699999999999998},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.64600000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.69299999999999995},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.35699999999999998,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.23400000000000001,"15min":0.23200000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59299999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.372,"15min":0.36799999999999999},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51100000000000001,"5min":0.52100000000000002,"15min":0.57799999999999996},"last":0.312}]},{"osd":5,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.379,"15min":0.373},"min":{"1min":0.27400000000000002,"5min":0.27200000000000002,"15min":0.23000000000000001},"max":{"1min":0.58099999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.41099999999999998,"15min":0.41199999999999998},"min":{"1min":0.35199999999999998,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.52300000000000002,"5min":0.54300000000000004,"15min":0.61799999999999999},"last":0.53700000000000003}]},{"osd":6,"last update":"Fri Dec 1 23:46:08 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42599999999999999,"15min":0.43099999999999999},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.57399999999999995,"15min":0.64100000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.33400000000000002,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.60499999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.34699999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509791,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.20999999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.68700000000000006},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.43099999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.38200000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.44800000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.621},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59299999999999997}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.253,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.40100000000000002},"min":{"1min":0.27200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.32500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.73199999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.314,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.57199999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509790,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.312,"15min":0.30099999999999999},"min":{"1min":0.23499999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.216},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.57199999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.46400000000000002,"15min":0.437},"min":{"1min":0.36399999999999999,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.49299999999999999,"15min":0.46999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.498,"15min":0.47599999999999998},"min":{"1min":0.432,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.46500000000000002},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.30599999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79300000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509791,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.29099999999999998,"5min":0.28699999999999998,"15min":0.29199999999999998},"min":{"1min":0.19,"5min":0.19,"15min":0.182},"max":{"1min":0.495,"5min":0.495,"15min":0.71299999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30499999999999999},"min":{"1min":0.22,"5min":0.216,"15min":0.16600000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.313}]},{"osd":2,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.32400000000000001,"15min":0.33100000000000002},"min":{"1min":0.25,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.441,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.313,"15min":0.32400000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.185},"max":{"1min":0.46200000000000002,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.27200000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20599999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.621},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35799999999999998,"15min":0.36099999999999999},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.61499999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.39900000000000002,"15min":0.40999999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.65800000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.42999999999999999,"15min":0.439},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.311},"max":{"1min":0.58299999999999996,"5min":0.59499999999999997,"15min":0.754},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.747},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.41799999999999998,"15min":0.42799999999999999},"min":{"1min":0.34699999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.68899999999999995},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.46300000000000002},"min":{"1min":0.38100000000000001,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.72399999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.44,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.36199999999999999,"5min":0.34599999999999997,"15min":0.32300000000000001},"max":{"1min":0.621,"5min":0.66300000000000003,"15min":0.77900000000000003},"last":0.502}]},{"osd":7,"last update":"Fri Dec 1 23:46:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.65100000000000002,"5min":0.68400000000000005,"15min":0.70499999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.442,"15min":0.45400000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.76300000000000001},"last":0.47099999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542494,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.248,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.627,"5min":0.63,"15min":0.66500000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.45900000000000002,"15min":0.44700000000000001},"min":{"1min":0.38800000000000001,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68100000000000005},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.39900000000000002},"min":{"1min":0.316,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.71199999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.42099999999999999},"min":{"1min":0.315,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.70299999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.33200000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.60999999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.32700000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.441,"15min":0.432},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48299999999999998,"15min":0.47499999999999998},"min":{"1min":0.40500000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.35299999999999998},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.49299999999999999,"5min":0.51300000000000001,"15min":0.67500000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.375,"15min":0.37},"min":{"1min":0.26200000000000001,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":0.52300000000000002,"5min":0.54700000000000004,"15min":0.621},"last":0.40300000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.379,"15min":0.38200000000000001},"min":{"1min":0.30299999999999999,"5min":0.26200000000000001,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.74199999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.441,"5min":0.443,"15min":0.442},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.69799999999999995},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42099999999999999,"15min":0.41799999999999998},"min":{"1min":0.29199999999999998,"5min":0.254,"15min":0.249},"max":{"1min":0.57499999999999996,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.42299999999999999,"15min":0.42399999999999999},"min":{"1min":0.30099999999999999,"5min":0.28799999999999998,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":0.66100000000000003,"15min":0.77100000000000002},"last":0.48699999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542494,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61016,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94310824,"statfs":{"total":96636764160,"available":96574283776,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.40500000000000003},"min":{"1min":0.30199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.59699999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.23300000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.68700000000000006},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.41999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.57399999999999995,"5min":0.629,"15min":0.629},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.34200000000000003,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54600000000000004,"5min":0.64000000000000001,"15min":0.65400000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.59399999999999997,"5min":0.626,"15min":0.626},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.436,"15min":0.436},"min":{"1min":0.37,"5min":0.25800000000000001,"15min":0.24299999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.437,"15min":0.443},"min":{"1min":0.35299999999999998,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.65300000000000002},"last":0.84999999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.35699999999999998},"min":{"1min":0.26600000000000001,"5min":0.224,"15min":0.216},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.61399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.28199999999999997,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39000000000000001},"min":{"1min":0.32500000000000001,"5min":0.248,"15min":0.245},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.40300000000000002,"15min":0.41399999999999998},"min":{"1min":0.29899999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:46:16 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.42099999999999999,"15min":0.435},"min":{"1min":0.314,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.71799999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.40300000000000002},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.57399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542495,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.29299999999999998,"5min":0.30299999999999999,"15min":0.29599999999999999},"min":{"1min":0.23699999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.38600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.315,"15min":0.311},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.47899999999999998,"5min":0.48499999999999999,"15min":0.66400000000000003},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.33500000000000002},"min":{"1min":0.25900000000000001,"5min":0.216,"15min":0.21199999999999999},"max":{"1min":0.433,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30299999999999999},"min":{"1min":0.20999999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.442,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.307}]},{"osd":3,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42999999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.214},"max":{"1min":0.52200000000000002,"5min":0.56499999999999995,"15min":0.624},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.65200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44400000000000001,"15min":0.434},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.59399999999999997,"5min":0.65600000000000003,"15min":0.70899999999999996},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42499999999999999,"15min":0.432},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63900000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.432,"5min":0.437,"15min":0.44500000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.51300000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.437,"15min":0.443},"min":{"1min":0.317,"5min":0.317,"15min":0.307},"max":{"1min":0.56200000000000006,"5min":0.61399999999999999,"15min":0.65900000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45200000000000001,"15min":0.46000000000000002},"min":{"1min":0.38,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.58599999999999997,"5min":0.67400000000000004,"15min":0.68600000000000005},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47099999999999997,"15min":0.46400000000000002},"min":{"1min":0.373,"5min":0.34000000000000002,"15min":0.317},"max":{"1min":0.628,"5min":0.69299999999999995,"15min":0.73099999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.32800000000000001},"max":{"1min":0.60299999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575198,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28299999999999997},"min":{"1min":0.217,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.41399999999999998,"5min":0.47299999999999998,"15min":0.623},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.311},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.64800000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.316,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.19600000000000001},"max":{"1min":0.48199999999999998,"5min":0.496,"15min":0.63400000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.254,"5min":0.23699999999999999,"15min":0.22500000000000001},"max":{"1min":0.41499999999999998,"5min":0.56100000000000005,"15min":0.61099999999999999},"last":0.34699999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.46100000000000002,"5min":0.56499999999999995,"15min":0.59499999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.438}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.36299999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.626},{"interface":"front","average":{"1min":0.505,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.316,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.44900000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.502}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.46500000000000002,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.745},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:47:04.919 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.919 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.920 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.921 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.921 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.921 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.921 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.921 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.922 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.922 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.922 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.922 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.922 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.923 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-01T23:18:27.673577+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=27, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:04.923 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T23:47:12.375 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:47:12.378 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:47:24.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:47:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.027+0000 7f701b5ea640 1 Processor -- start 2023-12-01T23:47:25.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.027+0000 7f701b5ea640 1 -- start start 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f701414fd70 0x7f7014070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7014071c40 0x7f70140c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70140c7eb0 0x7f7014159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014155b20 con 0x7f701414fd70 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7014071420 con 0x7f7014071c40 2023-12-01T23:47:25.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.028+0000 7f701b5ea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70141592d0 con 0x7f70140c7eb0 2023-12-01T23:47:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.029+0000 7f7019386640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f701414fd70 0x7f7014070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.029+0000 7f7019b87640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70140c7eb0 0x7f7014159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.029+0000 7f7018b85640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7014071c40 0x7f70140c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.029+0000 7f7019386640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f701414fd70 0x7f7014070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48114/0 (socket says 172.21.15.96:48114) 2023-12-01T23:47:25.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.029+0000 7f7019386640 1 -- 172.21.15.96:0/2066800935 learned_addr learned my addr 172.21.15.96:0/2066800935 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:25.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.031+0000 7f7019386640 1 -- 172.21.15.96:0/2066800935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70140c7eb0 msgr2=0x7f7014159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:25.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.031+0000 7f7019386640 1 --2- 172.21.15.96:0/2066800935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70140c7eb0 0x7f7014159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.031+0000 7f7019386640 1 -- 172.21.15.96:0/2066800935 >> v2:172.21.15.102:3300/0 conn(0x7f7014071c40 msgr2=0x7f70140c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:25.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.031+0000 7f7019386640 1 --2- 172.21.15.96:0/2066800935 >> v2:172.21.15.102:3300/0 conn(0x7f7014071c40 0x7f70140c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.031+0000 7f7019386640 1 -- 172.21.15.96:0/2066800935 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140c65f0 con 0x7f701414fd70 2023-12-01T23:47:25.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.033+0000 7f7019386640 1 --2- 172.21.15.96:0/2066800935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f7014070ee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70140b0640 tx=0x7f701002dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78fa7ec72784f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:25.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.037+0000 7f700bfff640 1 -- 172.21.15.96:0/2066800935 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701002eb30 con 0x7f701414fd70 2023-12-01T23:47:25.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.037+0000 7f700bfff640 1 -- 172.21.15.96:0/2066800935 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010032070 con 0x7f701414fd70 2023-12-01T23:47:25.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.037+0000 7f700bfff640 1 -- 172.21.15.96:0/2066800935 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010038400 con 0x7f701414fd70 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 -- 172.21.15.96:0/2066800935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 msgr2=0x7f7014070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 --2- 172.21.15.96:0/2066800935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f7014070ee0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70140b0640 tx=0x7f701002dd80 comp rx=0 tx=0).stop 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 -- 172.21.15.96:0/2066800935 shutdown_connections 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 --2- 172.21.15.96:0/2066800935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70140c7eb0 0x7f7014159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 --2- 172.21.15.96:0/2066800935 >> v2:172.21.15.102:3300/0 conn(0x7f7014071c40 0x7f70140c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 --2- 172.21.15.96:0/2066800935 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f7014070ee0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 -- 172.21.15.96:0/2066800935 >> 172.21.15.96:0/2066800935 conn(0x7f701406cd60 msgr2=0x7f701406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 -- 172.21.15.96:0/2066800935 shutdown_connections 2023-12-01T23:47:25.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.038+0000 7f701b5ea640 1 -- 172.21.15.96:0/2066800935 wait complete. 2023-12-01T23:47:25.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.039+0000 7f701b5ea640 1 Processor -- start 2023-12-01T23:47:25.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.039+0000 7f701b5ea640 1 -- start start 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7014071c40 0x7f70141dfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70140c7eb0 0x7f7014155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70141df030 con 0x7f701414fd70 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70141e0960 con 0x7f70140c7eb0 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f701b5ea640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c20c0 con 0x7f7014071c40 2023-12-01T23:47:25.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.040+0000 7f7019b87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.041+0000 7f7019b87640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48118/0 (socket says 172.21.15.96:48118) 2023-12-01T23:47:25.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.041+0000 7f7019b87640 1 -- 172.21.15.96:0/763009214 learned_addr learned my addr 172.21.15.96:0/763009214 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:25.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.041+0000 7f7019386640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7014071c40 0x7f70141dfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.041+0000 7f7018b85640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70140c7eb0 0x7f7014155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.044+0000 7f7019b87640 1 -- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7014071c40 msgr2=0x7f70141dfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:25.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.044+0000 7f7019b87640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7014071c40 0x7f70141dfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.044+0000 7f7019b87640 1 -- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70140c7eb0 msgr2=0x7f7014155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:25.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.044+0000 7f7019b87640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70140c7eb0 0x7f7014155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.044+0000 7f7019b87640 1 -- 172.21.15.96:0/763009214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701000b760 con 0x7f701414fd70 2023-12-01T23:47:25.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.046+0000 7f7019b87640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f700c00efc0 tx=0x7f700c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:25.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.050+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c014480 con 0x7f701414fd70 2023-12-01T23:47:25.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.050+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00f040 con 0x7f701414fd70 2023-12-01T23:47:25.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.050+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70141e03f0 con 0x7f701414fd70 2023-12-01T23:47:25.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.050+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c014820 con 0x7f701414fd70 2023-12-01T23:47:25.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.050+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701414be20 con 0x7f701414fd70 2023-12-01T23:47:25.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.051+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7014067500 con 0x7f701414fd70 2023-12-01T23:47:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.291+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f700c014980 con 0x7f701414fd70 2023-12-01T23:47:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.291+0000 7f7009ffb640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 0x7f6ff806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:25.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.292+0000 7f7019386640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 0x7f6ff806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:25.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.292+0000 7f7019386640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 0x7f6ff806d380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7010039000 tx=0x7f7010034000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.305+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f700c0596e0 con 0x7f701414fd70 2023-12-01T23:47:25.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.305+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f700c055a20 con 0x7f701414fd70 2023-12-01T23:47:25.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.469+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70141501c0 con 0x7f6ff806aec0 2023-12-01T23:47:25.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.478+0000 7f7009ffb640 1 -- 172.21.15.96:0/763009214 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373620 (secure 0 0 0) 0x7f70141501c0 con 0x7f6ff806aec0 2023-12-01T23:47:25.483 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:25.485 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 msgr2=0x7f6ff806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 0x7f6ff806d380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7010039000 tx=0x7f7010034000 comp rx=0 tx=0).stop 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 msgr2=0x7f70141447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f700c00efc0 tx=0x7f700c00c490 comp rx=0 tx=0).stop 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 shutdown_connections 2023-12-01T23:47:25.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f6ff806aec0 0x7f6ff806d380 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f701414fd70 0x7f70141447b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70140c7eb0 0x7f7014155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 --2- 172.21.15.96:0/763009214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7014071c40 0x7f70141dfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 >> 172.21.15.96:0/763009214 conn(0x7f701406cd60 msgr2=0x7f70140c0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 shutdown_connections 2023-12-01T23:47:25.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:25.483+0000 7f701b5ea640 1 -- 172.21.15.96:0/763009214 wait complete. 2023-12-01T23:47:25.495 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":899,"stamp":"2023-12-01T23:47:24.195677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15689,"ondisk_log_size":15689,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409192,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754565528,"statfs":{"total":773094113280,"available":772675100672,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":360500799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003653"},"pg_stats":[{"pgid":"2.1f","version":"29'587","reported_seq":628,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.821622+0000","last_change":"2023-12-01T23:46:23.821644+0000","last_active":"2023-12-01T23:46:23.821622+0000","last_peered":"2023-12-01T23:46:23.821622+0000","last_clean":"2023-12-01T23:46:23.821622+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:23.821622+0000","last_undegraded":"2023-12-01T23:46:23.821622+0000","last_fullsized":"2023-12-01T23:46:23.821622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'587","last_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_deep_scrub":"29'587","last_deep_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_clean_scrub_stamp":"2023-12-01T23:46:23.821567+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:27:45.679880+0000","scrub_duration":0.014376867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.099073+0000","last_change":"2023-12-01T23:46:29.099073+0000","last_active":"2023-12-01T23:46:29.099073+0000","last_peered":"2023-12-01T23:46:29.099073+0000","last_clean":"2023-12-01T23:46:29.099073+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:29.099073+0000","last_undegraded":"2023-12-01T23:46:29.099073+0000","last_fullsized":"2023-12-01T23:46:29.099073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.098979+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.006340+0000","scrub_duration":0.001500726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.041928+0000","last_change":"2023-12-01T23:47:09.041956+0000","last_active":"2023-12-01T23:47:09.041928+0000","last_peered":"2023-12-01T23:47:09.041928+0000","last_clean":"2023-12-01T23:47:09.041928+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:47:09.041928+0000","last_undegraded":"2023-12-01T23:47:09.041928+0000","last_fullsized":"2023-12-01T23:47:09.041928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'166","last_scrub_stamp":"2023-12-01T23:47:09.041819+0000","last_deep_scrub":"29'166","last_deep_scrub_stamp":"2023-12-01T23:47:09.041819+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.041819+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:15:40.390182+0000","scrub_duration":0.00316044,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'722","reported_seq":764,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.050166+0000","last_change":"2023-12-01T23:46:37.050187+0000","last_active":"2023-12-01T23:46:37.050166+0000","last_peered":"2023-12-01T23:46:37.050166+0000","last_clean":"2023-12-01T23:46:37.050166+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:46:37.050166+0000","last_undegraded":"2023-12-01T23:46:37.050166+0000","last_fullsized":"2023-12-01T23:46:37.050166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'722","last_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_deep_scrub":"29'722","last_deep_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.050112+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:47.620513+0000","scrub_duration":0.013774812000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.790990+0000","last_change":"2023-12-01T23:46:27.791032+0000","last_active":"2023-12-01T23:46:27.790990+0000","last_peered":"2023-12-01T23:46:27.790990+0000","last_clean":"2023-12-01T23:46:27.790990+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:27.790990+0000","last_undegraded":"2023-12-01T23:46:27.790990+0000","last_fullsized":"2023-12-01T23:46:27.790990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.790881+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:09.321687+0000","scrub_duration":0.0024783050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.730126+0000","last_change":"2023-12-01T23:47:01.730148+0000","last_active":"2023-12-01T23:47:01.730126+0000","last_peered":"2023-12-01T23:47:01.730126+0000","last_clean":"2023-12-01T23:47:01.730126+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:47:01.730126+0000","last_undegraded":"2023-12-01T23:47:01.730126+0000","last_fullsized":"2023-12-01T23:47:01.730126+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'146","last_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_deep_scrub":"29'146","last_deep_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.730038+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:03:31.371959+0000","scrub_duration":0.0029167759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1377","reported_seq":1416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:38.059304+0000","last_change":"2023-12-01T23:46:38.059352+0000","last_active":"2023-12-01T23:46:38.059304+0000","last_peered":"2023-12-01T23:46:38.059304+0000","last_clean":"2023-12-01T23:46:38.059304+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:46:38.059304+0000","last_undegraded":"2023-12-01T23:46:38.059304+0000","last_fullsized":"2023-12-01T23:46:38.059304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1377","last_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_deep_scrub":"29'1377","last_deep_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_clean_scrub_stamp":"2023-12-01T23:46:38.059230+0000","objects_scrubbed":3,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:38.866050+0000","scrub_duration":0.025760086000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.166021+0000","last_change":"2023-12-01T23:46:50.166042+0000","last_active":"2023-12-01T23:46:50.166021+0000","last_peered":"2023-12-01T23:46:50.166021+0000","last_clean":"2023-12-01T23:46:50.166021+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:50.166021+0000","last_undegraded":"2023-12-01T23:46:50.166021+0000","last_fullsized":"2023-12-01T23:46:50.166021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.165931+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:21.986122+0000","scrub_duration":0.0013328350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:44.638442+0000","last_change":"2023-12-01T23:46:44.638462+0000","last_active":"2023-12-01T23:46:44.638442+0000","last_peered":"2023-12-01T23:46:44.638442+0000","last_clean":"2023-12-01T23:46:44.638442+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:46:44.638442+0000","last_undegraded":"2023-12-01T23:46:44.638442+0000","last_fullsized":"2023-12-01T23:46:44.638442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'152","last_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_deep_scrub":"29'152","last_deep_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_clean_scrub_stamp":"2023-12-01T23:46:44.638369+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:06.578744+0000","scrub_duration":0.002261529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.084780+0000","last_change":"2023-12-01T23:46:34.084820+0000","last_active":"2023-12-01T23:46:34.084780+0000","last_peered":"2023-12-01T23:46:34.084780+0000","last_clean":"2023-12-01T23:46:34.084780+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:46:34.084780+0000","last_undegraded":"2023-12-01T23:46:34.084780+0000","last_fullsized":"2023-12-01T23:46:34.084780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.084694+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:50:09.154389+0000","scrub_duration":0.0024307840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:57.212463+0000","last_change":"2023-12-01T23:46:57.212484+0000","last_active":"2023-12-01T23:46:57.212463+0000","last_peered":"2023-12-01T23:46:57.212463+0000","last_clean":"2023-12-01T23:46:57.212463+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:57.212463+0000","last_undegraded":"2023-12-01T23:46:57.212463+0000","last_fullsized":"2023-12-01T23:46:57.212463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_clean_scrub_stamp":"2023-12-01T23:46:57.212392+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:42.947264+0000","scrub_duration":0.0012129280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.646302+0000","last_change":"2023-12-01T23:47:05.646323+0000","last_active":"2023-12-01T23:47:05.646302+0000","last_peered":"2023-12-01T23:47:05.646302+0000","last_clean":"2023-12-01T23:47:05.646302+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:47:05.646302+0000","last_undegraded":"2023-12-01T23:47:05.646302+0000","last_fullsized":"2023-12-01T23:47:05.646302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2023-12-01T23:47:05.646225+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2023-12-01T23:47:05.646225+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.646225+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:24.112296+0000","scrub_duration":0.0027797070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.658029+0000","last_change":"2023-12-01T23:46:37.658029+0000","last_active":"2023-12-01T23:46:37.658029+0000","last_peered":"2023-12-01T23:46:37.658029+0000","last_clean":"2023-12-01T23:46:37.658029+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:37.658029+0000","last_undegraded":"2023-12-01T23:46:37.658029+0000","last_fullsized":"2023-12-01T23:46:37.658029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.657927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:23:10.474950+0000","scrub_duration":0.001280696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'636","reported_seq":676,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.993687+0000","last_change":"2023-12-01T23:46:42.993713+0000","last_active":"2023-12-01T23:46:42.993687+0000","last_peered":"2023-12-01T23:46:42.993687+0000","last_clean":"2023-12-01T23:46:42.993687+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:46:42.993687+0000","last_undegraded":"2023-12-01T23:46:42.993687+0000","last_fullsized":"2023-12-01T23:46:42.993687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'636","last_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_deep_scrub":"29'636","last_deep_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.993627+0000","objects_scrubbed":2,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:24:26.661673+0000","scrub_duration":0.016535945999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.710564+0000","last_change":"2023-12-01T23:47:02.710602+0000","last_active":"2023-12-01T23:47:02.710564+0000","last_peered":"2023-12-01T23:47:02.710564+0000","last_clean":"2023-12-01T23:47:02.710564+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:47:02.710564+0000","last_undegraded":"2023-12-01T23:47:02.710564+0000","last_fullsized":"2023-12-01T23:47:02.710564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'117","last_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_deep_scrub":"29'117","last_deep_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.710464+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:59.065723+0000","scrub_duration":0.003020946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.040392+0000","last_change":"2023-12-01T23:46:25.040412+0000","last_active":"2023-12-01T23:46:25.040392+0000","last_peered":"2023-12-01T23:46:25.040392+0000","last_clean":"2023-12-01T23:46:25.040392+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:25.040392+0000","last_undegraded":"2023-12-01T23:46:25.040392+0000","last_fullsized":"2023-12-01T23:46:25.040392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.040325+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:10.530867+0000","scrub_duration":0.001183684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.625555+0000","last_change":"2023-12-01T23:46:29.625555+0000","last_active":"2023-12-01T23:46:29.625555+0000","last_peered":"2023-12-01T23:46:29.625555+0000","last_clean":"2023-12-01T23:46:29.625555+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:46:29.625555+0000","last_undegraded":"2023-12-01T23:46:29.625555+0000","last_fullsized":"2023-12-01T23:46:29.625555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.625443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:09.464351+0000","scrub_duration":0.0012089830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.721205+0000","last_change":"2023-12-01T23:47:09.721229+0000","last_active":"2023-12-01T23:47:09.721205+0000","last_peered":"2023-12-01T23:47:09.721205+0000","last_clean":"2023-12-01T23:47:09.721205+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:47:09.721205+0000","last_undegraded":"2023-12-01T23:47:09.721205+0000","last_fullsized":"2023-12-01T23:47:09.721205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2023-12-01T23:47:09.721108+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2023-12-01T23:47:09.721108+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.721108+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:16:08.026087+0000","scrub_duration":0.0030110990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.007741+0000","last_change":"2023-12-01T23:46:52.007768+0000","last_active":"2023-12-01T23:46:52.007741+0000","last_peered":"2023-12-01T23:46:52.007741+0000","last_clean":"2023-12-01T23:46:52.007741+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:52.007741+0000","last_undegraded":"2023-12-01T23:46:52.007741+0000","last_fullsized":"2023-12-01T23:46:52.007741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.007658+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:49.391014+0000","scrub_duration":0.001597935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.520645+0000","last_change":"2023-12-01T23:46:45.520663+0000","last_active":"2023-12-01T23:46:45.520645+0000","last_peered":"2023-12-01T23:46:45.520645+0000","last_clean":"2023-12-01T23:46:45.520645+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:46:45.520645+0000","last_undegraded":"2023-12-01T23:46:45.520645+0000","last_fullsized":"2023-12-01T23:46:45.520645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.520583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:48:03.049323+0000","scrub_duration":0.0015689409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:21.758233+0000","last_change":"2023-12-01T23:47:21.758254+0000","last_active":"2023-12-01T23:47:21.758233+0000","last_peered":"2023-12-01T23:47:21.758233+0000","last_clean":"2023-12-01T23:47:21.758233+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:47:21.758233+0000","last_undegraded":"2023-12-01T23:47:21.758233+0000","last_fullsized":"2023-12-01T23:47:21.758233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'128","last_scrub_stamp":"2023-12-01T23:47:21.758156+0000","last_deep_scrub":"29'128","last_deep_scrub_stamp":"2023-12-01T23:47:21.758156+0000","last_clean_scrub_stamp":"2023-12-01T23:47:21.758156+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:44:34.794552+0000","scrub_duration":0.0027194039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.572012+0000","last_change":"2023-12-01T23:46:29.572012+0000","last_active":"2023-12-01T23:46:29.572012+0000","last_peered":"2023-12-01T23:46:29.572012+0000","last_clean":"2023-12-01T23:46:29.572012+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:46:29.572012+0000","last_undegraded":"2023-12-01T23:46:29.572012+0000","last_fullsized":"2023-12-01T23:46:29.572012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.571898+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:51.682690+0000","scrub_duration":0.0014693180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.896027+0000","last_change":"2023-12-01T23:46:45.896048+0000","last_active":"2023-12-01T23:46:45.896027+0000","last_peered":"2023-12-01T23:46:45.896027+0000","last_clean":"2023-12-01T23:46:45.896027+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:46:45.896027+0000","last_undegraded":"2023-12-01T23:46:45.896027+0000","last_fullsized":"2023-12-01T23:46:45.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.895953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:34:05.047561+0000","scrub_duration":0.001328262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:49.687551+0000","last_change":"2023-12-01T23:46:49.687574+0000","last_active":"2023-12-01T23:46:49.687551+0000","last_peered":"2023-12-01T23:46:49.687551+0000","last_clean":"2023-12-01T23:46:49.687551+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:46:49.687551+0000","last_undegraded":"2023-12-01T23:46:49.687551+0000","last_fullsized":"2023-12-01T23:46:49.687551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'126","last_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_deep_scrub":"29'126","last_deep_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_clean_scrub_stamp":"2023-12-01T23:46:49.687463+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:53.378669+0000","scrub_duration":0.0035888880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.688025+0000","last_change":"2023-12-01T23:46:36.688025+0000","last_active":"2023-12-01T23:46:36.688025+0000","last_peered":"2023-12-01T23:46:36.688025+0000","last_clean":"2023-12-01T23:46:36.688025+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:36.688025+0000","last_undegraded":"2023-12-01T23:46:36.688025+0000","last_fullsized":"2023-12-01T23:46:36.688025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.687934+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:36.569781+0000","scrub_duration":0.001389251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.660776+0000","last_change":"2023-12-01T23:46:34.660776+0000","last_active":"2023-12-01T23:46:34.660776+0000","last_peered":"2023-12-01T23:46:34.660776+0000","last_clean":"2023-12-01T23:46:34.660776+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:46:34.660776+0000","last_undegraded":"2023-12-01T23:46:34.660776+0000","last_fullsized":"2023-12-01T23:46:34.660776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.660656+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:56.771448+0000","scrub_duration":0.0024248519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.598069+0000","last_change":"2023-12-01T23:46:36.598093+0000","last_active":"2023-12-01T23:46:36.598069+0000","last_peered":"2023-12-01T23:46:36.598069+0000","last_clean":"2023-12-01T23:46:36.598069+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:46:36.598069+0000","last_undegraded":"2023-12-01T23:46:36.598069+0000","last_fullsized":"2023-12-01T23:46:36.598069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.597987+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:08:56.617524+0000","scrub_duration":0.00256362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.915992+0000","last_change":"2023-12-01T23:46:58.916030+0000","last_active":"2023-12-01T23:46:58.915992+0000","last_peered":"2023-12-01T23:46:58.915992+0000","last_clean":"2023-12-01T23:46:58.915992+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:58.915992+0000","last_undegraded":"2023-12-01T23:46:58.915992+0000","last_fullsized":"2023-12-01T23:46:58.915992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.915919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:05.013437+0000","scrub_duration":0.0018718389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'310","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.611009+0000","last_change":"2023-12-01T23:46:39.611046+0000","last_active":"2023-12-01T23:46:39.611009+0000","last_peered":"2023-12-01T23:46:39.611009+0000","last_clean":"2023-12-01T23:46:39.611009+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:39.611009+0000","last_undegraded":"2023-12-01T23:46:39.611009+0000","last_fullsized":"2023-12-01T23:46:39.611009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'310","last_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_deep_scrub":"29'310","last_deep_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.610919+0000","objects_scrubbed":1,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:38:41.341946+0000","scrub_duration":0.004221219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:08.042656+0000","last_change":"2023-12-01T23:47:08.042679+0000","last_active":"2023-12-01T23:47:08.042656+0000","last_peered":"2023-12-01T23:47:08.042656+0000","last_clean":"2023-12-01T23:47:08.042656+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:47:08.042656+0000","last_undegraded":"2023-12-01T23:47:08.042656+0000","last_fullsized":"2023-12-01T23:47:08.042656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'159","last_scrub_stamp":"2023-12-01T23:47:08.042579+0000","last_deep_scrub":"29'159","last_deep_scrub_stamp":"2023-12-01T23:47:08.042579+0000","last_clean_scrub_stamp":"2023-12-01T23:47:08.042579+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:24.732443+0000","scrub_duration":0.003188363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.574002+0000","last_change":"2023-12-01T23:46:54.574038+0000","last_active":"2023-12-01T23:46:54.574002+0000","last_peered":"2023-12-01T23:46:54.574002+0000","last_clean":"2023-12-01T23:46:54.574002+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:54.574002+0000","last_undegraded":"2023-12-01T23:46:54.574002+0000","last_fullsized":"2023-12-01T23:46:54.574002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.573897+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:57.397531+0000","scrub_duration":0.0014970319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.066892+0000","last_change":"2023-12-01T23:46:39.066910+0000","last_active":"2023-12-01T23:46:39.066892+0000","last_peered":"2023-12-01T23:46:39.066892+0000","last_clean":"2023-12-01T23:46:39.066892+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:46:39.066892+0000","last_undegraded":"2023-12-01T23:46:39.066892+0000","last_fullsized":"2023-12-01T23:46:39.066892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.066832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:46.974193+0000","scrub_duration":0.001216946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":169,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.582801+0000","last_change":"2023-12-01T23:46:48.582841+0000","last_active":"2023-12-01T23:46:48.582801+0000","last_peered":"2023-12-01T23:46:48.582801+0000","last_clean":"2023-12-01T23:46:48.582801+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:46:48.582801+0000","last_undegraded":"2023-12-01T23:46:48.582801+0000","last_fullsized":"2023-12-01T23:46:48.582801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.582715+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:39.547933+0000","scrub_duration":0.0027570889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.178914+0000","last_change":"2023-12-01T23:46:56.178935+0000","last_active":"2023-12-01T23:46:56.178914+0000","last_peered":"2023-12-01T23:46:56.178914+0000","last_clean":"2023-12-01T23:46:56.178914+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:56.178914+0000","last_undegraded":"2023-12-01T23:46:56.178914+0000","last_fullsized":"2023-12-01T23:46:56.178914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.178803+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:21.586011+0000","scrub_duration":0.0019174109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.541598+0000","last_change":"2023-12-01T23:46:48.541631+0000","last_active":"2023-12-01T23:46:48.541598+0000","last_peered":"2023-12-01T23:46:48.541598+0000","last_clean":"2023-12-01T23:46:48.541598+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:46:48.541598+0000","last_undegraded":"2023-12-01T23:46:48.541598+0000","last_fullsized":"2023-12-01T23:46:48.541598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.541502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:48.706314+0000","scrub_duration":0.001231413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:18.666943+0000","last_change":"2023-12-01T23:47:18.666964+0000","last_active":"2023-12-01T23:47:18.666943+0000","last_peered":"2023-12-01T23:47:18.666943+0000","last_clean":"2023-12-01T23:47:18.666943+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:47:18.666943+0000","last_undegraded":"2023-12-01T23:47:18.666943+0000","last_fullsized":"2023-12-01T23:47:18.666943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'191","last_scrub_stamp":"2023-12-01T23:47:18.666866+0000","last_deep_scrub":"29'191","last_deep_scrub_stamp":"2023-12-01T23:47:18.666866+0000","last_clean_scrub_stamp":"2023-12-01T23:47:18.666866+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:29.972235+0000","scrub_duration":0.002986313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.526300+0000","last_change":"2023-12-01T23:46:31.526319+0000","last_active":"2023-12-01T23:46:31.526300+0000","last_peered":"2023-12-01T23:46:31.526300+0000","last_clean":"2023-12-01T23:46:31.526300+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:31.526300+0000","last_undegraded":"2023-12-01T23:46:31.526300+0000","last_fullsized":"2023-12-01T23:46:31.526300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.526232+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:11.365141+0000","scrub_duration":0.0014675910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.191480+0000","last_change":"2023-12-01T23:46:45.191499+0000","last_active":"2023-12-01T23:46:45.191480+0000","last_peered":"2023-12-01T23:46:45.191480+0000","last_clean":"2023-12-01T23:46:45.191480+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:46:45.191480+0000","last_undegraded":"2023-12-01T23:46:45.191480+0000","last_fullsized":"2023-12-01T23:46:45.191480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.191418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:55.761819+0000","scrub_duration":0.00187754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":137,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:41.988880+0000","last_change":"2023-12-01T23:18:34.838323+0000","last_active":"2023-12-01T23:45:41.988880+0000","last_peered":"2023-12-01T23:45:41.988880+0000","last_clean":"2023-12-01T23:45:41.988880+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:45:41.988880+0000","last_undegraded":"2023-12-01T23:45:41.988880+0000","last_fullsized":"2023-12-01T23:45:41.988880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.584022+0000","last_change":"2023-12-01T23:47:05.584069+0000","last_active":"2023-12-01T23:47:05.584022+0000","last_peered":"2023-12-01T23:47:05.584022+0000","last_clean":"2023-12-01T23:47:05.584022+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:47:05.584022+0000","last_undegraded":"2023-12-01T23:47:05.584022+0000","last_fullsized":"2023-12-01T23:47:05.584022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:47:05.583951+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:47:05.583951+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.583951+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:56:44.325716+0000","scrub_duration":0.001198055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2103,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.643969+0000","last_change":"2023-12-01T23:46:24.643989+0000","last_active":"2023-12-01T23:46:24.643969+0000","last_peered":"2023-12-01T23:46:24.643969+0000","last_clean":"2023-12-01T23:46:24.643969+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:24.643969+0000","last_undegraded":"2023-12-01T23:46:24.643969+0000","last_fullsized":"2023-12-01T23:46:24.643969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1033","last_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_deep_scrub":"29'1033","last_deep_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.643892+0000","objects_scrubbed":1,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:26:33.573885+0000","scrub_duration":0.0020141569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.568739+0000","last_change":"2023-12-01T23:18:34.831779+0000","last_active":"2023-12-01T23:46:18.568739+0000","last_peered":"2023-12-01T23:46:18.568739+0000","last_clean":"2023-12-01T23:46:18.568739+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:46:18.568739+0000","last_undegraded":"2023-12-01T23:46:18.568739+0000","last_fullsized":"2023-12-01T23:46:18.568739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.717873+0000","last_change":"2023-12-01T23:46:31.717892+0000","last_active":"2023-12-01T23:46:31.717873+0000","last_peered":"2023-12-01T23:46:31.717873+0000","last_clean":"2023-12-01T23:46:31.717873+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:31.717873+0000","last_undegraded":"2023-12-01T23:46:31.717873+0000","last_fullsized":"2023-12-01T23:46:31.717873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.717809+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:26.928183+0000","scrub_duration":0.001388479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'522","reported_seq":564,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.125261+0000","last_change":"2023-12-01T23:46:32.125261+0000","last_active":"2023-12-01T23:46:32.125261+0000","last_peered":"2023-12-01T23:46:32.125261+0000","last_clean":"2023-12-01T23:46:32.125261+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:46:32.125261+0000","last_undegraded":"2023-12-01T23:46:32.125261+0000","last_fullsized":"2023-12-01T23:46:32.125261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'522","last_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_deep_scrub":"29'522","last_deep_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.125130+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:58.630445+0000","scrub_duration":0.014960424999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.667378+0000","last_change":"2023-12-01T23:46:43.667378+0000","last_active":"2023-12-01T23:46:43.667378+0000","last_peered":"2023-12-01T23:46:43.667378+0000","last_clean":"2023-12-01T23:46:43.667378+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:46:43.667378+0000","last_undegraded":"2023-12-01T23:46:43.667378+0000","last_fullsized":"2023-12-01T23:46:43.667378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.667288+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:26.019724+0000","scrub_duration":0.0024242619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.062424+0000","last_change":"2023-12-01T23:46:48.062444+0000","last_active":"2023-12-01T23:46:48.062424+0000","last_peered":"2023-12-01T23:46:48.062424+0000","last_clean":"2023-12-01T23:46:48.062424+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:48.062424+0000","last_undegraded":"2023-12-01T23:46:48.062424+0000","last_fullsized":"2023-12-01T23:46:48.062424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.062339+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:13:29.754649+0000","scrub_duration":0.0018067599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.294992+0000","last_change":"2023-12-01T23:46:41.295012+0000","last_active":"2023-12-01T23:46:41.294992+0000","last_peered":"2023-12-01T23:46:41.294992+0000","last_clean":"2023-12-01T23:46:41.294992+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:46:41.294992+0000","last_undegraded":"2023-12-01T23:46:41.294992+0000","last_fullsized":"2023-12-01T23:46:41.294992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.294917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:36.505291+0000","scrub_duration":0.0016126510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.061262+0000","last_change":"2023-12-01T23:46:29.061287+0000","last_active":"2023-12-01T23:46:29.061262+0000","last_peered":"2023-12-01T23:46:29.061262+0000","last_clean":"2023-12-01T23:46:29.061262+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:46:29.061262+0000","last_undegraded":"2023-12-01T23:46:29.061262+0000","last_fullsized":"2023-12-01T23:46:29.061262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.061209+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:06.598456+0000","scrub_duration":0.0040676059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.697944+0000","last_change":"2023-12-01T23:46:59.697967+0000","last_active":"2023-12-01T23:46:59.697944+0000","last_peered":"2023-12-01T23:46:59.697944+0000","last_clean":"2023-12-01T23:46:59.697944+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:46:59.697944+0000","last_undegraded":"2023-12-01T23:46:59.697944+0000","last_fullsized":"2023-12-01T23:46:59.697944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.697850+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:18.163921+0000","scrub_duration":0.003308929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.830125+0000","last_change":"2023-12-01T23:47:02.830146+0000","last_active":"2023-12-01T23:47:02.830125+0000","last_peered":"2023-12-01T23:47:02.830125+0000","last_clean":"2023-12-01T23:47:02.830125+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:47:02.830125+0000","last_undegraded":"2023-12-01T23:47:02.830125+0000","last_fullsized":"2023-12-01T23:47:02.830125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.830060+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:14:34.055454+0000","scrub_duration":0.001200696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.655724+0000","last_change":"2023-12-01T23:46:25.655758+0000","last_active":"2023-12-01T23:46:25.655724+0000","last_peered":"2023-12-01T23:46:25.655724+0000","last_clean":"2023-12-01T23:46:25.655724+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:46:25.655724+0000","last_undegraded":"2023-12-01T23:46:25.655724+0000","last_fullsized":"2023-12-01T23:46:25.655724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.655632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:50:43.867354+0000","scrub_duration":0.001438878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.735859+0000","last_change":"2023-12-01T23:46:55.735897+0000","last_active":"2023-12-01T23:46:55.735859+0000","last_peered":"2023-12-01T23:46:55.735859+0000","last_clean":"2023-12-01T23:46:55.735859+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:46:55.735859+0000","last_undegraded":"2023-12-01T23:46:55.735859+0000","last_fullsized":"2023-12-01T23:46:55.735859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.735760+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:52.091018+0000","scrub_duration":0.0025007599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.627943+0000","last_change":"2023-12-01T23:46:33.627977+0000","last_active":"2023-12-01T23:46:33.627943+0000","last_peered":"2023-12-01T23:46:33.627943+0000","last_clean":"2023-12-01T23:46:33.627943+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:33.627943+0000","last_undegraded":"2023-12-01T23:46:33.627943+0000","last_fullsized":"2023-12-01T23:46:33.627943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.627841+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:47.591432+0000","scrub_duration":0.001328142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.628643+0000","last_change":"2023-12-01T23:46:26.628664+0000","last_active":"2023-12-01T23:46:26.628643+0000","last_peered":"2023-12-01T23:46:26.628643+0000","last_clean":"2023-12-01T23:46:26.628643+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:26.628643+0000","last_undegraded":"2023-12-01T23:46:26.628643+0000","last_fullsized":"2023-12-01T23:46:26.628643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.628583+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:50.083961+0000","scrub_duration":0.002604281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.606653+0000","last_change":"2023-12-01T23:46:55.606690+0000","last_active":"2023-12-01T23:46:55.606653+0000","last_peered":"2023-12-01T23:46:55.606653+0000","last_clean":"2023-12-01T23:46:55.606653+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:46:55.606653+0000","last_undegraded":"2023-12-01T23:46:55.606653+0000","last_fullsized":"2023-12-01T23:46:55.606653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'186","last_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_deep_scrub":"29'186","last_deep_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.606555+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:01.704072+0000","scrub_duration":0.0027214320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:07.837222+0000","last_change":"2023-12-01T23:47:07.837274+0000","last_active":"2023-12-01T23:47:07.837222+0000","last_peered":"2023-12-01T23:47:07.837222+0000","last_clean":"2023-12-01T23:47:07.837222+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:47:07.837222+0000","last_undegraded":"2023-12-01T23:47:07.837222+0000","last_fullsized":"2023-12-01T23:47:07.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:47:07.837136+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:47:07.837136+0000","last_clean_scrub_stamp":"2023-12-01T23:47:07.837136+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:47:53.167712+0000","scrub_duration":0.0018515199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:19.564746+0000","last_change":"2023-12-01T23:46:19.564768+0000","last_active":"2023-12-01T23:46:19.564746+0000","last_peered":"2023-12-01T23:46:19.564746+0000","last_clean":"2023-12-01T23:46:19.564746+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:46:19.564746+0000","last_undegraded":"2023-12-01T23:46:19.564746+0000","last_fullsized":"2023-12-01T23:46:19.564746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:19.564681+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:07:18.833129+0000","scrub_duration":0.0023607229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.353370+0000","last_change":"2023-12-01T23:47:09.353393+0000","last_active":"2023-12-01T23:47:09.353370+0000","last_peered":"2023-12-01T23:47:09.353370+0000","last_clean":"2023-12-01T23:47:09.353370+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:47:09.353370+0000","last_undegraded":"2023-12-01T23:47:09.353370+0000","last_fullsized":"2023-12-01T23:47:09.353370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2023-12-01T23:47:09.353291+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2023-12-01T23:47:09.353291+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.353291+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:15:40.701654+0000","scrub_duration":0.002774903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.819369+0000","last_change":"2023-12-01T23:47:00.819389+0000","last_active":"2023-12-01T23:47:00.819369+0000","last_peered":"2023-12-01T23:47:00.819369+0000","last_clean":"2023-12-01T23:47:00.819369+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:47:00.819369+0000","last_undegraded":"2023-12-01T23:47:00.819369+0000","last_fullsized":"2023-12-01T23:47:00.819369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.819291+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:46.554163+0000","scrub_duration":0.001268436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.537130+0000","last_change":"2023-12-01T23:46:21.537165+0000","last_active":"2023-12-01T23:46:21.537130+0000","last_peered":"2023-12-01T23:46:21.537130+0000","last_clean":"2023-12-01T23:46:21.537130+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:46:21.537130+0000","last_undegraded":"2023-12-01T23:46:21.537130+0000","last_fullsized":"2023-12-01T23:46:21.537130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_clean_scrub_stamp":"2023-12-01T23:46:21.537038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:17.479391+0000","scrub_duration":0.0027855789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.762785+0000","last_change":"2023-12-01T23:46:59.762823+0000","last_active":"2023-12-01T23:46:59.762785+0000","last_peered":"2023-12-01T23:46:59.762785+0000","last_clean":"2023-12-01T23:46:59.762785+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:46:59.762785+0000","last_undegraded":"2023-12-01T23:46:59.762785+0000","last_fullsized":"2023-12-01T23:46:59.762785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'171","last_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_deep_scrub":"29'171","last_deep_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.762681+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:37.020845+0000","scrub_duration":0.0029108900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.935278+0000","last_change":"2023-12-01T23:46:55.935325+0000","last_active":"2023-12-01T23:46:55.935278+0000","last_peered":"2023-12-01T23:46:55.935278+0000","last_clean":"2023-12-01T23:46:55.935278+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:55.935278+0000","last_undegraded":"2023-12-01T23:46:55.935278+0000","last_fullsized":"2023-12-01T23:46:55.935278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.935190+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:38.287626+0000","scrub_duration":0.0013732950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.631874+0000","last_change":"2023-12-01T23:46:22.631874+0000","last_active":"2023-12-01T23:46:22.631874+0000","last_peered":"2023-12-01T23:46:22.631874+0000","last_clean":"2023-12-01T23:46:22.631874+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:46:22.631874+0000","last_undegraded":"2023-12-01T23:46:22.631874+0000","last_fullsized":"2023-12-01T23:46:22.631874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.631783+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:27:42.297274+0000","scrub_duration":0.0059878589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":165,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.654338+0000","last_change":"2023-12-01T23:46:46.654375+0000","last_active":"2023-12-01T23:46:46.654338+0000","last_peered":"2023-12-01T23:46:46.654338+0000","last_clean":"2023-12-01T23:46:46.654338+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:46:46.654338+0000","last_undegraded":"2023-12-01T23:46:46.654338+0000","last_fullsized":"2023-12-01T23:46:46.654338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'130","last_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_deep_scrub":"29'130","last_deep_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.654234+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:09:47.109603+0000","scrub_duration":0.0026405740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.650489+0000","last_change":"2023-12-01T23:46:41.650508+0000","last_active":"2023-12-01T23:46:41.650489+0000","last_peered":"2023-12-01T23:46:41.650489+0000","last_clean":"2023-12-01T23:46:41.650489+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:41.650489+0000","last_undegraded":"2023-12-01T23:46:41.650489+0000","last_fullsized":"2023-12-01T23:46:41.650489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.650424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:03.590799+0000","scrub_duration":0.0014981689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.719656+0000","last_change":"2023-12-01T23:46:31.719675+0000","last_active":"2023-12-01T23:46:31.719656+0000","last_peered":"2023-12-01T23:46:31.719656+0000","last_clean":"2023-12-01T23:46:31.719656+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:46:31.719656+0000","last_undegraded":"2023-12-01T23:46:31.719656+0000","last_fullsized":"2023-12-01T23:46:31.719656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.719600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:15.461606+0000","scrub_duration":0.00093897100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:45:40.088461+0000","last_change":"2023-12-01T23:18:34.790243+0000","last_active":"2023-12-01T23:45:40.088461+0000","last_peered":"2023-12-01T23:45:40.088461+0000","last_clean":"2023-12-01T23:45:40.088461+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:45:40.088461+0000","last_undegraded":"2023-12-01T23:45:40.088461+0000","last_fullsized":"2023-12-01T23:45:40.088461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T23:18:33.577644+0000","last_clean_scrub_stamp":"2023-12-01T23:18:33.577644+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.679160+0000","last_change":"2023-12-01T23:46:29.679160+0000","last_active":"2023-12-01T23:46:29.679160+0000","last_peered":"2023-12-01T23:46:29.679160+0000","last_clean":"2023-12-01T23:46:29.679160+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:29.679160+0000","last_undegraded":"2023-12-01T23:46:29.679160+0000","last_fullsized":"2023-12-01T23:46:29.679160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.679065+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:25.621418+0000","scrub_duration":0.0015688550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.298846+0000","last_change":"2023-12-01T23:46:40.298865+0000","last_active":"2023-12-01T23:46:40.298846+0000","last_peered":"2023-12-01T23:46:40.298846+0000","last_clean":"2023-12-01T23:46:40.298846+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:46:40.298846+0000","last_undegraded":"2023-12-01T23:46:40.298846+0000","last_fullsized":"2023-12-01T23:46:40.298846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.298785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:00:12.873162+0000","scrub_duration":0.0013254339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:22.144422+0000","last_change":"2023-12-01T23:47:22.144445+0000","last_active":"2023-12-01T23:47:22.144422+0000","last_peered":"2023-12-01T23:47:22.144422+0000","last_clean":"2023-12-01T23:47:22.144422+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:47:22.144422+0000","last_undegraded":"2023-12-01T23:47:22.144422+0000","last_fullsized":"2023-12-01T23:47:22.144422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'118","last_scrub_stamp":"2023-12-01T23:47:22.144340+0000","last_deep_scrub":"29'118","last_deep_scrub_stamp":"2023-12-01T23:47:22.144340+0000","last_clean_scrub_stamp":"2023-12-01T23:47:22.144340+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:33:26.344832+0000","scrub_duration":0.0028948759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.707881+0000","last_change":"2023-12-01T23:46:32.707923+0000","last_active":"2023-12-01T23:46:32.707881+0000","last_peered":"2023-12-01T23:46:32.707881+0000","last_clean":"2023-12-01T23:46:32.707881+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:32.707881+0000","last_undegraded":"2023-12-01T23:46:32.707881+0000","last_fullsized":"2023-12-01T23:46:32.707881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.707812+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:51.859421+0000","scrub_duration":0.0017506170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'258","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.834421+0000","last_change":"2023-12-01T23:46:22.834421+0000","last_active":"2023-12-01T23:46:22.834421+0000","last_peered":"2023-12-01T23:46:22.834421+0000","last_clean":"2023-12-01T23:46:22.834421+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:22.834421+0000","last_undegraded":"2023-12-01T23:46:22.834421+0000","last_fullsized":"2023-12-01T23:46:22.834421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.834344+0000","objects_scrubbed":3,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:00.371590+0000","scrub_duration":0.010238596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:10.393877+0000","last_change":"2023-12-01T23:47:10.393899+0000","last_active":"2023-12-01T23:47:10.393877+0000","last_peered":"2023-12-01T23:47:10.393877+0000","last_clean":"2023-12-01T23:47:10.393877+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:47:10.393877+0000","last_undegraded":"2023-12-01T23:47:10.393877+0000","last_fullsized":"2023-12-01T23:47:10.393877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'141","last_scrub_stamp":"2023-12-01T23:47:10.393805+0000","last_deep_scrub":"29'141","last_deep_scrub_stamp":"2023-12-01T23:47:10.393805+0000","last_clean_scrub_stamp":"2023-12-01T23:47:10.393805+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:33:07.284712+0000","scrub_duration":0.0029833390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.897130+0000","last_change":"2023-12-01T23:46:54.897151+0000","last_active":"2023-12-01T23:46:54.897130+0000","last_peered":"2023-12-01T23:46:54.897130+0000","last_clean":"2023-12-01T23:46:54.897130+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:54.897130+0000","last_undegraded":"2023-12-01T23:46:54.897130+0000","last_fullsized":"2023-12-01T23:46:54.897130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.897063+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:19.398843+0000","scrub_duration":0.0017864280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'837","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.690721+0000","last_change":"2023-12-01T23:46:22.690721+0000","last_active":"2023-12-01T23:46:22.690721+0000","last_peered":"2023-12-01T23:46:22.690721+0000","last_clean":"2023-12-01T23:46:22.690721+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:46:22.690721+0000","last_undegraded":"2023-12-01T23:46:22.690721+0000","last_fullsized":"2023-12-01T23:46:22.690721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.690602+0000","objects_scrubbed":4,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:40:26.291990+0000","scrub_duration":0.015828854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:16.671461+0000","last_change":"2023-12-01T23:47:16.671482+0000","last_active":"2023-12-01T23:47:16.671461+0000","last_peered":"2023-12-01T23:47:16.671461+0000","last_clean":"2023-12-01T23:47:16.671461+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:47:16.671461+0000","last_undegraded":"2023-12-01T23:47:16.671461+0000","last_fullsized":"2023-12-01T23:47:16.671461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'156","last_scrub_stamp":"2023-12-01T23:47:16.671389+0000","last_deep_scrub":"29'156","last_deep_scrub_stamp":"2023-12-01T23:47:16.671389+0000","last_clean_scrub_stamp":"2023-12-01T23:47:16.671389+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:16:14.976368+0000","scrub_duration":0.0024249760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.557956+0000","last_change":"2023-12-01T23:46:24.557956+0000","last_active":"2023-12-01T23:46:24.557956+0000","last_peered":"2023-12-01T23:46:24.557956+0000","last_clean":"2023-12-01T23:46:24.557956+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:24.557956+0000","last_undegraded":"2023-12-01T23:46:24.557956+0000","last_fullsized":"2023-12-01T23:46:24.557956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.557856+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:42.299451+0000","scrub_duration":0.0012882550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'697","reported_seq":736,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.664433+0000","last_change":"2023-12-01T23:46:28.664462+0000","last_active":"2023-12-01T23:46:28.664433+0000","last_peered":"2023-12-01T23:46:28.664433+0000","last_clean":"2023-12-01T23:46:28.664433+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:28.664433+0000","last_undegraded":"2023-12-01T23:46:28.664433+0000","last_fullsized":"2023-12-01T23:46:28.664433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.664354+0000","objects_scrubbed":2,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:29:54.783596+0000","scrub_duration":0.0041761050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.689438+0000","last_change":"2023-12-01T23:46:55.689459+0000","last_active":"2023-12-01T23:46:55.689438+0000","last_peered":"2023-12-01T23:46:55.689438+0000","last_clean":"2023-12-01T23:46:55.689438+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:46:55.689438+0000","last_undegraded":"2023-12-01T23:46:55.689438+0000","last_fullsized":"2023-12-01T23:46:55.689438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'157","last_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_deep_scrub":"29'157","last_deep_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.689362+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:58.512996+0000","scrub_duration":0.002487628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.782476+0000","last_change":"2023-12-01T23:46:26.782497+0000","last_active":"2023-12-01T23:46:26.782476+0000","last_peered":"2023-12-01T23:46:26.782476+0000","last_clean":"2023-12-01T23:46:26.782476+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:26.782476+0000","last_undegraded":"2023-12-01T23:46:26.782476+0000","last_fullsized":"2023-12-01T23:46:26.782476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.782401+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:01:23.398097+0000","scrub_duration":0.0019853919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.366665+0000","last_change":"2023-12-01T23:46:36.366716+0000","last_active":"2023-12-01T23:46:36.366665+0000","last_peered":"2023-12-01T23:46:36.366665+0000","last_clean":"2023-12-01T23:46:36.366665+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:46:36.366665+0000","last_undegraded":"2023-12-01T23:46:36.366665+0000","last_fullsized":"2023-12-01T23:46:36.366665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.366584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:17.897390+0000","scrub_duration":0.0011632089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:20.178438+0000","last_change":"2023-12-01T23:47:20.178461+0000","last_active":"2023-12-01T23:47:20.178438+0000","last_peered":"2023-12-01T23:47:20.178438+0000","last_clean":"2023-12-01T23:47:20.178438+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:47:20.178438+0000","last_undegraded":"2023-12-01T23:47:20.178438+0000","last_fullsized":"2023-12-01T23:47:20.178438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2023-12-01T23:47:20.178346+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2023-12-01T23:47:20.178346+0000","last_clean_scrub_stamp":"2023-12-01T23:47:20.178346+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:08:27.007884+0000","scrub_duration":0.0033497589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.338881+0000","last_change":"2023-12-01T23:46:28.338925+0000","last_active":"2023-12-01T23:46:28.338881+0000","last_peered":"2023-12-01T23:46:28.338881+0000","last_clean":"2023-12-01T23:46:28.338881+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:28.338881+0000","last_undegraded":"2023-12-01T23:46:28.338881+0000","last_fullsized":"2023-12-01T23:46:28.338881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.338785+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:45:52.136028+0000","scrub_duration":0.0016464509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:35.654539+0000","last_change":"2023-12-01T23:46:35.654557+0000","last_active":"2023-12-01T23:46:35.654539+0000","last_peered":"2023-12-01T23:46:35.654539+0000","last_clean":"2023-12-01T23:46:35.654539+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:46:35.654539+0000","last_undegraded":"2023-12-01T23:46:35.654539+0000","last_fullsized":"2023-12-01T23:46:35.654539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_clean_scrub_stamp":"2023-12-01T23:46:35.654472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:04:47.022634+0000","scrub_duration":0.001093908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:11.073086+0000","last_change":"2023-12-01T23:47:11.073121+0000","last_active":"2023-12-01T23:47:11.073086+0000","last_peered":"2023-12-01T23:47:11.073086+0000","last_clean":"2023-12-01T23:47:11.073086+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:47:11.073086+0000","last_undegraded":"2023-12-01T23:47:11.073086+0000","last_fullsized":"2023-12-01T23:47:11.073086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'165","last_scrub_stamp":"2023-12-01T23:47:11.072989+0000","last_deep_scrub":"29'165","last_deep_scrub_stamp":"2023-12-01T23:47:11.072989+0000","last_clean_scrub_stamp":"2023-12-01T23:47:11.072989+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:57:06.840159+0000","scrub_duration":0.0026215549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.578493+0000","last_change":"2023-12-01T23:46:52.578528+0000","last_active":"2023-12-01T23:46:52.578493+0000","last_peered":"2023-12-01T23:46:52.578493+0000","last_clean":"2023-12-01T23:46:52.578493+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:46:52.578493+0000","last_undegraded":"2023-12-01T23:46:52.578493+0000","last_fullsized":"2023-12-01T23:46:52.578493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.578401+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:50.768577+0000","scrub_duration":0.0025899289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:53.575402+0000","last_change":"2023-12-01T23:46:53.575421+0000","last_active":"2023-12-01T23:46:53.575402+0000","last_peered":"2023-12-01T23:46:53.575402+0000","last_clean":"2023-12-01T23:46:53.575402+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:53.575402+0000","last_undegraded":"2023-12-01T23:46:53.575402+0000","last_fullsized":"2023-12-01T23:46:53.575402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_clean_scrub_stamp":"2023-12-01T23:46:53.575336+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:30:00.456637+0000","scrub_duration":0.001325278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.355761+0000","last_change":"2023-12-01T23:46:33.355780+0000","last_active":"2023-12-01T23:46:33.355761+0000","last_peered":"2023-12-01T23:46:33.355761+0000","last_clean":"2023-12-01T23:46:33.355761+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:33.355761+0000","last_undegraded":"2023-12-01T23:46:33.355761+0000","last_fullsized":"2023-12-01T23:46:33.355761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.355695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:18.846237+0000","scrub_duration":0.001158233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.677171+0000","last_change":"2023-12-01T23:47:00.677212+0000","last_active":"2023-12-01T23:47:00.677171+0000","last_peered":"2023-12-01T23:47:00.677171+0000","last_clean":"2023-12-01T23:47:00.677171+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:47:00.677171+0000","last_undegraded":"2023-12-01T23:47:00.677171+0000","last_fullsized":"2023-12-01T23:47:00.677171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'139","last_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_deep_scrub":"29'139","last_deep_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.677068+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:15:58.982047+0000","scrub_duration":0.0026136110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.044121+0000","last_change":"2023-12-01T23:46:50.044143+0000","last_active":"2023-12-01T23:46:50.044121+0000","last_peered":"2023-12-01T23:46:50.044121+0000","last_clean":"2023-12-01T23:46:50.044121+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:50.044121+0000","last_undegraded":"2023-12-01T23:46:50.044121+0000","last_fullsized":"2023-12-01T23:46:50.044121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.044041+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:15.451249+0000","scrub_duration":0.0013565980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.023231+0000","last_change":"2023-12-01T23:46:40.023249+0000","last_active":"2023-12-01T23:46:40.023231+0000","last_peered":"2023-12-01T23:46:40.023231+0000","last_clean":"2023-12-01T23:46:40.023231+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:46:40.023231+0000","last_undegraded":"2023-12-01T23:46:40.023231+0000","last_fullsized":"2023-12-01T23:46:40.023231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.023168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:04:05.565732+0000","scrub_duration":0.0015748159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.712232+0000","last_change":"2023-12-01T23:46:26.712257+0000","last_active":"2023-12-01T23:46:26.712232+0000","last_peered":"2023-12-01T23:46:26.712232+0000","last_clean":"2023-12-01T23:46:26.712232+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:46:26.712232+0000","last_undegraded":"2023-12-01T23:46:26.712232+0000","last_fullsized":"2023-12-01T23:46:26.712232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'688","last_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_deep_scrub":"29'688","last_deep_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.712170+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:40.675762+0000","scrub_duration":0.015526883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.913858+0000","last_change":"2023-12-01T23:46:17.913876+0000","last_active":"2023-12-01T23:46:17.913858+0000","last_peered":"2023-12-01T23:46:17.913858+0000","last_clean":"2023-12-01T23:46:17.913858+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:17.913858+0000","last_undegraded":"2023-12-01T23:46:17.913858+0000","last_fullsized":"2023-12-01T23:46:17.913858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_clean_scrub_stamp":"2023-12-01T23:46:17.913795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:35.764452+0000","scrub_duration":0.0020485220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.618263+0000","last_change":"2023-12-01T23:46:27.618286+0000","last_active":"2023-12-01T23:46:27.618263+0000","last_peered":"2023-12-01T23:46:27.618263+0000","last_clean":"2023-12-01T23:46:27.618263+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:46:27.618263+0000","last_undegraded":"2023-12-01T23:46:27.618263+0000","last_fullsized":"2023-12-01T23:46:27.618263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'79","last_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_deep_scrub":"29'79","last_deep_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.618173+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:55:34.334662+0000","scrub_duration":0.002712112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'677","reported_seq":716,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.082022+0000","last_change":"2023-12-01T23:46:39.082058+0000","last_active":"2023-12-01T23:46:39.082022+0000","last_peered":"2023-12-01T23:46:39.082022+0000","last_clean":"2023-12-01T23:46:39.082022+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:46:39.082022+0000","last_undegraded":"2023-12-01T23:46:39.082022+0000","last_fullsized":"2023-12-01T23:46:39.082022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'677","last_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_deep_scrub":"29'677","last_deep_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.081954+0000","objects_scrubbed":1,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:38.963801+0000","scrub_duration":0.018891622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.563173+0000","last_change":"2023-12-01T23:46:22.563206+0000","last_active":"2023-12-01T23:46:22.563173+0000","last_peered":"2023-12-01T23:46:22.563173+0000","last_clean":"2023-12-01T23:46:22.563173+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:22.563173+0000","last_undegraded":"2023-12-01T23:46:22.563173+0000","last_fullsized":"2023-12-01T23:46:22.563173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.563080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:56.997610+0000","scrub_duration":0.001814476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:15.089056+0000","last_change":"2023-12-01T23:47:15.089077+0000","last_active":"2023-12-01T23:47:15.089056+0000","last_peered":"2023-12-01T23:47:15.089056+0000","last_clean":"2023-12-01T23:47:15.089056+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:47:15.089056+0000","last_undegraded":"2023-12-01T23:47:15.089056+0000","last_fullsized":"2023-12-01T23:47:15.089056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'156","last_scrub_stamp":"2023-12-01T23:47:15.088982+0000","last_deep_scrub":"29'156","last_deep_scrub_stamp":"2023-12-01T23:47:15.088982+0000","last_clean_scrub_stamp":"2023-12-01T23:47:15.088982+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:36.481668+0000","scrub_duration":0.0030626120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.826074+0000","last_change":"2023-12-01T23:46:46.826094+0000","last_active":"2023-12-01T23:46:46.826074+0000","last_peered":"2023-12-01T23:46:46.826074+0000","last_clean":"2023-12-01T23:46:46.826074+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:46.826074+0000","last_undegraded":"2023-12-01T23:46:46.826074+0000","last_fullsized":"2023-12-01T23:46:46.826074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.826007+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:54:22.515338+0000","scrub_duration":0.001437015,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.641266+0000","last_change":"2023-12-01T23:46:34.641284+0000","last_active":"2023-12-01T23:46:34.641266+0000","last_peered":"2023-12-01T23:46:34.641266+0000","last_clean":"2023-12-01T23:46:34.641266+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:34.641266+0000","last_undegraded":"2023-12-01T23:46:34.641266+0000","last_fullsized":"2023-12-01T23:46:34.641266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.641201+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:52.382796+0000","scrub_duration":0.0012133529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.259763+0000","last_change":"2023-12-01T23:47:00.259785+0000","last_active":"2023-12-01T23:47:00.259763+0000","last_peered":"2023-12-01T23:47:00.259763+0000","last_clean":"2023-12-01T23:47:00.259763+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:47:00.259763+0000","last_undegraded":"2023-12-01T23:47:00.259763+0000","last_fullsized":"2023-12-01T23:47:00.259763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.259685+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:58.449861+0000","scrub_duration":0.0017484359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.673858+0000","last_change":"2023-12-01T23:46:37.673877+0000","last_active":"2023-12-01T23:46:37.673858+0000","last_peered":"2023-12-01T23:46:37.673858+0000","last_clean":"2023-12-01T23:46:37.673858+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:37.673858+0000","last_undegraded":"2023-12-01T23:46:37.673858+0000","last_fullsized":"2023-12-01T23:46:37.673858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.673790+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:09.493981+0000","scrub_duration":0.0014334879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.107049+0000","last_change":"2023-12-01T23:46:34.107049+0000","last_active":"2023-12-01T23:46:34.107049+0000","last_peered":"2023-12-01T23:46:34.107049+0000","last_clean":"2023-12-01T23:46:34.107049+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:34.107049+0000","last_undegraded":"2023-12-01T23:46:34.107049+0000","last_fullsized":"2023-12-01T23:46:34.107049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.106923+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:29.317297+0000","scrub_duration":0.001525958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.536617+0000","last_change":"2023-12-01T23:46:56.536637+0000","last_active":"2023-12-01T23:46:56.536617+0000","last_peered":"2023-12-01T23:46:56.536617+0000","last_clean":"2023-12-01T23:46:56.536617+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:56.536617+0000","last_undegraded":"2023-12-01T23:46:56.536617+0000","last_fullsized":"2023-12-01T23:46:56.536617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.536539+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:15:59.378966+0000","scrub_duration":0.001488685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.689584+0000","last_change":"2023-12-01T23:46:42.689584+0000","last_active":"2023-12-01T23:46:42.689584+0000","last_peered":"2023-12-01T23:46:42.689584+0000","last_clean":"2023-12-01T23:46:42.689584+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:42.689584+0000","last_undegraded":"2023-12-01T23:46:42.689584+0000","last_fullsized":"2023-12-01T23:46:42.689584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.689499+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:18:16.705098+0000","scrub_duration":0.0011022670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.047350+0000","last_change":"2023-12-01T23:46:26.047350+0000","last_active":"2023-12-01T23:46:26.047350+0000","last_peered":"2023-12-01T23:46:26.047350+0000","last_clean":"2023-12-01T23:46:26.047350+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:26.047350+0000","last_undegraded":"2023-12-01T23:46:26.047350+0000","last_fullsized":"2023-12-01T23:46:26.047350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.047200+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:26.854020+0000","scrub_duration":0.0017362949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.198415+0000","last_change":"2023-12-01T23:46:51.198438+0000","last_active":"2023-12-01T23:46:51.198415+0000","last_peered":"2023-12-01T23:46:51.198415+0000","last_clean":"2023-12-01T23:46:51.198415+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:51.198415+0000","last_undegraded":"2023-12-01T23:46:51.198415+0000","last_fullsized":"2023-12-01T23:46:51.198415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.198334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:15.700114+0000","scrub_duration":0.001943721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.044001+0000","last_change":"2023-12-01T23:46:51.044035+0000","last_active":"2023-12-01T23:46:51.044001+0000","last_peered":"2023-12-01T23:46:51.044001+0000","last_clean":"2023-12-01T23:46:51.044001+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:51.044001+0000","last_undegraded":"2023-12-01T23:46:51.044001+0000","last_fullsized":"2023-12-01T23:46:51.044001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.043920+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:36.778792+0000","scrub_duration":0.001802297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.289908+0000","last_change":"2023-12-01T23:47:01.289932+0000","last_active":"2023-12-01T23:47:01.289908+0000","last_peered":"2023-12-01T23:47:01.289908+0000","last_clean":"2023-12-01T23:47:01.289908+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:47:01.289908+0000","last_undegraded":"2023-12-01T23:47:01.289908+0000","last_fullsized":"2023-12-01T23:47:01.289908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.289823+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:15:15.160034+0000","scrub_duration":0.001556446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.701165+0000","last_change":"2023-12-01T23:46:42.701183+0000","last_active":"2023-12-01T23:46:42.701165+0000","last_peered":"2023-12-01T23:46:42.701165+0000","last_clean":"2023-12-01T23:46:42.701165+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:42.701165+0000","last_undegraded":"2023-12-01T23:46:42.701165+0000","last_fullsized":"2023-12-01T23:46:42.701165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.701106+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:17:19.446451+0000","scrub_duration":0.001533106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.628034+0000","last_change":"2023-12-01T23:46:36.628054+0000","last_active":"2023-12-01T23:46:36.628034+0000","last_peered":"2023-12-01T23:46:36.628034+0000","last_clean":"2023-12-01T23:46:36.628034+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:36.628034+0000","last_undegraded":"2023-12-01T23:46:36.628034+0000","last_fullsized":"2023-12-01T23:46:36.628034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.627948+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:57:18.693485+0000","scrub_duration":0.001270539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:10.856204+0000","last_change":"2023-12-01T23:47:10.856223+0000","last_active":"2023-12-01T23:47:10.856204+0000","last_peered":"2023-12-01T23:47:10.856204+0000","last_clean":"2023-12-01T23:47:10.856204+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:47:10.856204+0000","last_undegraded":"2023-12-01T23:47:10.856204+0000","last_fullsized":"2023-12-01T23:47:10.856204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:47:10.856142+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:47:10.856142+0000","last_clean_scrub_stamp":"2023-12-01T23:47:10.856142+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:03:25.187506+0000","scrub_duration":0.0016634569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.608302+0000","last_change":"2023-12-01T23:46:26.608302+0000","last_active":"2023-12-01T23:46:26.608302+0000","last_peered":"2023-12-01T23:46:26.608302+0000","last_clean":"2023-12-01T23:46:26.608302+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:26.608302+0000","last_undegraded":"2023-12-01T23:46:26.608302+0000","last_fullsized":"2023-12-01T23:46:26.608302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.608209+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:59:04.832666+0000","scrub_duration":0.001815189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:30.299426+0000","last_change":"2023-12-01T23:46:30.299447+0000","last_active":"2023-12-01T23:46:30.299426+0000","last_peered":"2023-12-01T23:46:30.299426+0000","last_clean":"2023-12-01T23:46:30.299426+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:30.299426+0000","last_undegraded":"2023-12-01T23:46:30.299426+0000","last_fullsized":"2023-12-01T23:46:30.299426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_clean_scrub_stamp":"2023-12-01T23:46:30.299352+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:55.857362+0000","scrub_duration":0.0016640419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.248304+0000","last_change":"2023-12-01T23:46:58.248328+0000","last_active":"2023-12-01T23:46:58.248304+0000","last_peered":"2023-12-01T23:46:58.248304+0000","last_clean":"2023-12-01T23:46:58.248304+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:58.248304+0000","last_undegraded":"2023-12-01T23:46:58.248304+0000","last_fullsized":"2023-12-01T23:46:58.248304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.248217+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:55.631573+0000","scrub_duration":0.001664198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.573753+0000","last_change":"2023-12-01T23:46:55.573772+0000","last_active":"2023-12-01T23:46:55.573753+0000","last_peered":"2023-12-01T23:46:55.573753+0000","last_clean":"2023-12-01T23:46:55.573753+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:55.573753+0000","last_undegraded":"2023-12-01T23:46:55.573753+0000","last_fullsized":"2023-12-01T23:46:55.573753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.573678+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:00.619061+0000","scrub_duration":0.0017204410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.804111+0000","last_change":"2023-12-01T23:46:25.804111+0000","last_active":"2023-12-01T23:46:25.804111+0000","last_peered":"2023-12-01T23:46:25.804111+0000","last_clean":"2023-12-01T23:46:25.804111+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:25.804111+0000","last_undegraded":"2023-12-01T23:46:25.804111+0000","last_fullsized":"2023-12-01T23:46:25.804111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.804022+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:51.362032+0000","scrub_duration":0.0012177780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.914785+0000","last_change":"2023-12-01T23:46:20.914819+0000","last_active":"2023-12-01T23:46:20.914785+0000","last_peered":"2023-12-01T23:46:20.914785+0000","last_clean":"2023-12-01T23:46:20.914785+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:20.914785+0000","last_undegraded":"2023-12-01T23:46:20.914785+0000","last_fullsized":"2023-12-01T23:46:20.914785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_clean_scrub_stamp":"2023-12-01T23:46:20.914690+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:47.420005+0000","scrub_duration":0.00189442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.574944+0000","last_change":"2023-12-01T23:46:27.574967+0000","last_active":"2023-12-01T23:46:27.574944+0000","last_peered":"2023-12-01T23:46:27.574944+0000","last_clean":"2023-12-01T23:46:27.574944+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:27.574944+0000","last_undegraded":"2023-12-01T23:46:27.574944+0000","last_fullsized":"2023-12-01T23:46:27.574944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.574851+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:54.288208+0000","scrub_duration":0.0016018880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.714945+0000","last_change":"2023-12-01T23:46:43.714964+0000","last_active":"2023-12-01T23:46:43.714945+0000","last_peered":"2023-12-01T23:46:43.714945+0000","last_clean":"2023-12-01T23:46:43.714945+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:43.714945+0000","last_undegraded":"2023-12-01T23:46:43.714945+0000","last_fullsized":"2023-12-01T23:46:43.714945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.714833+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:20:47.722456+0000","scrub_duration":0.0012353959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:47.793393+0000","last_change":"2023-12-01T23:46:47.793414+0000","last_active":"2023-12-01T23:46:47.793393+0000","last_peered":"2023-12-01T23:46:47.793393+0000","last_clean":"2023-12-01T23:46:47.793393+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:47.793393+0000","last_undegraded":"2023-12-01T23:46:47.793393+0000","last_fullsized":"2023-12-01T23:46:47.793393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_clean_scrub_stamp":"2023-12-01T23:46:47.793300+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:09:52.838684+0000","scrub_duration":0.0014654469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.856089+0000","last_change":"2023-12-01T23:47:05.856110+0000","last_active":"2023-12-01T23:47:05.856089+0000","last_peered":"2023-12-01T23:47:05.856089+0000","last_clean":"2023-12-01T23:47:05.856089+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:47:05.856089+0000","last_undegraded":"2023-12-01T23:47:05.856089+0000","last_fullsized":"2023-12-01T23:47:05.856089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:47:05.856011+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:47:05.856011+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.856011+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:15:19.726222+0000","scrub_duration":0.0016672989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.992196+0000","last_change":"2023-12-01T23:46:41.992215+0000","last_active":"2023-12-01T23:46:41.992196+0000","last_peered":"2023-12-01T23:46:41.992196+0000","last_clean":"2023-12-01T23:46:41.992196+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:41.992196+0000","last_undegraded":"2023-12-01T23:46:41.992196+0000","last_fullsized":"2023-12-01T23:46:41.992196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.992130+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:06.493909+0000","scrub_duration":0.001678983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.919845+0000","last_change":"2023-12-01T23:46:51.919900+0000","last_active":"2023-12-01T23:46:51.919845+0000","last_peered":"2023-12-01T23:46:51.919845+0000","last_clean":"2023-12-01T23:46:51.919845+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:51.919845+0000","last_undegraded":"2023-12-01T23:46:51.919845+0000","last_fullsized":"2023-12-01T23:46:51.919845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.919767+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:23.739958+0000","scrub_duration":0.001832024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.280960+0000","last_change":"2023-12-01T23:47:02.280989+0000","last_active":"2023-12-01T23:47:02.280960+0000","last_peered":"2023-12-01T23:47:02.280960+0000","last_clean":"2023-12-01T23:47:02.280960+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:47:02.280960+0000","last_undegraded":"2023-12-01T23:47:02.280960+0000","last_fullsized":"2023-12-01T23:47:02.280960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.280885+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:52:59.819161+0000","scrub_duration":0.001839079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.021716+0000","last_change":"2023-12-01T23:46:28.021737+0000","last_active":"2023-12-01T23:46:28.021716+0000","last_peered":"2023-12-01T23:46:28.021716+0000","last_clean":"2023-12-01T23:46:28.021716+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:28.021716+0000","last_undegraded":"2023-12-01T23:46:28.021716+0000","last_fullsized":"2023-12-01T23:46:28.021716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.021656+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:08:59.781744+0000","scrub_duration":0.0016958609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.188263+0000","last_change":"2023-12-01T23:46:55.188286+0000","last_active":"2023-12-01T23:46:55.188263+0000","last_peered":"2023-12-01T23:46:55.188263+0000","last_clean":"2023-12-01T23:46:55.188263+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:55.188263+0000","last_undegraded":"2023-12-01T23:46:55.188263+0000","last_fullsized":"2023-12-01T23:46:55.188263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.188182+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:56.798147+0000","scrub_duration":0.0018947809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.768099+0000","last_change":"2023-12-01T23:46:29.768119+0000","last_active":"2023-12-01T23:46:29.768099+0000","last_peered":"2023-12-01T23:46:29.768099+0000","last_clean":"2023-12-01T23:46:29.768099+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:29.768099+0000","last_undegraded":"2023-12-01T23:46:29.768099+0000","last_fullsized":"2023-12-01T23:46:29.768099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.768031+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.675393+0000","scrub_duration":0.001232375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.750831+0000","last_change":"2023-12-01T23:46:18.750868+0000","last_active":"2023-12-01T23:46:18.750831+0000","last_peered":"2023-12-01T23:46:18.750831+0000","last_clean":"2023-12-01T23:46:18.750831+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:18.750831+0000","last_undegraded":"2023-12-01T23:46:18.750831+0000","last_fullsized":"2023-12-01T23:46:18.750831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_clean_scrub_stamp":"2023-12-01T23:46:18.750724+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:36.492319+0000","scrub_duration":0.001499631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.812087+0000","last_change":"2023-12-01T23:46:59.812108+0000","last_active":"2023-12-01T23:46:59.812087+0000","last_peered":"2023-12-01T23:46:59.812087+0000","last_clean":"2023-12-01T23:46:59.812087+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:59.812087+0000","last_undegraded":"2023-12-01T23:46:59.812087+0000","last_fullsized":"2023-12-01T23:46:59.812087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.812008+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:25.219215+0000","scrub_duration":0.0022375279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8445,"ondisk_log_size":8445,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509794,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63700000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.33400000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.66800000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.33400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45500000000000002},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.28299999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.54100000000000004}]},{"osd":4,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.37},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36399999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.23000000000000001},"max":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.64400000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.34699999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.435,"15min":0.434},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28100000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.434},{"interface":"front","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.42599999999999999},"min":{"1min":0.32800000000000001,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.71399999999999997},"last":0.40000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509795,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.20999999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.68700000000000006},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.43099999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.38200000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.44800000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.253,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.40100000000000002},"min":{"1min":0.27200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40699999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.32500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.73199999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.43099999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.314,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.50800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509794,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40300000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.312,"15min":0.30099999999999999},"min":{"1min":0.23499999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.216},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.503}]},{"osd":2,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.57199999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.373},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.46400000000000002,"15min":0.437},"min":{"1min":0.36399999999999999,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.49299999999999999,"15min":0.46999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.622}]},{"osd":6,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.498,"15min":0.47599999999999998},"min":{"1min":0.432,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.46500000000000002},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.30599999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63700000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509795,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.71299999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.16600000000000001},"max":{"1min":0.501,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.33400000000000002},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.48999999999999999,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32600000000000001},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.32600000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20599999999999999},"max":{"1min":0.52000000000000002,"5min":0.54300000000000004,"15min":0.621},"last":0.38},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.61499999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.32900000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.46000000000000002,"15min":0.45000000000000001},"min":{"1min":0.38200000000000001,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.442,"15min":0.434},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.41499999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.41299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.46899999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542498,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.42599999999999999},"min":{"1min":0.35799999999999998,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.41299999999999998,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.499}]},{"osd":1,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.434,"15min":0.40400000000000003},"min":{"1min":0.34899999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.71199999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.435,"15min":0.42399999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60899999999999999,"5min":0.62,"15min":0.70299999999999996},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.59299999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"min":{"1min":0.36499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.438},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.27300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23300000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.67500000000000004},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.317}]},{"osd":5,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.38600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.74199999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.35299999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.254,"15min":0.249},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28799999999999998,"15min":0.249},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.77100000000000002},"last":0.29999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542498,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65176,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306664,"statfs":{"total":96636764160,"available":96570023936,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.40999999999999998},"min":{"1min":0.26400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.42699999999999999,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.42699999999999999},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.39600000000000002,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46000000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.44800000000000001},"min":{"1min":0.377,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.216},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.376,"15min":0.371},"min":{"1min":0.29899999999999999,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.39600000000000002},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.245},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.496}]},{"osd":7,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.434,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.625,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.625}]}]},{"osd":2,"up_from":14,"seq":60129542499,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.311,"15min":0.29999999999999999},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.378,"5min":0.32900000000000001,"15min":0.316},"min":{"1min":0.27400000000000002,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66400000000000003},"last":0.42699999999999999}]},{"osd":1,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.309,"15min":0.30499999999999999},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46300000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.23300000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57299999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.30399999999999999,"5min":0.252,"15min":0.214},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.624},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.26600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.44},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.70899999999999996},"last":0.61199999999999999}]},{"osd":5,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.442,"15min":0.439},"min":{"1min":0.371,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.317,"15min":0.307},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46400000000000002},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.629}]}]},{"osd":1,"up_from":13,"seq":55834575202,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28299999999999997},"min":{"1min":0.217,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.41399999999999998,"5min":0.47299999999999998,"15min":0.623},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.311},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.64800000000000002},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.316,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.19600000000000001},"max":{"1min":0.48199999999999998,"5min":0.496,"15min":0.63400000000000001},"last":0.318},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.254,"5min":0.23699999999999999,"15min":0.22500000000000001},"max":{"1min":0.41499999999999998,"5min":0.56100000000000005,"15min":0.61099999999999999},"last":0.379}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.46100000000000002,"5min":0.56499999999999995,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.36299999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.316,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.44900000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.46500000000000002,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70999999999999996}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.745},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:47:25.502 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:25.502 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:25.503 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-01T23:18:33.577644+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=18, tm_sec=33, tm_wday=4, tm_yday=335, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=1, tm_hour=23, tm_min=46, tm_sec=16, tm_wday=4, tm_yday=335, tm_isdst=0) 2023-12-01T23:47:25.504 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-01T23:47:42.506 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:47:42.509 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:47:43.431 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:30:02.337 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.436 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:30:02.342 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.443 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:30:02.295 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.444 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:30:02.297 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.445 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:30:02.297 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.448 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:30:02.300 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.515 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:30:02.421 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.547 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:30:02.399 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:43.551 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:30:02.403 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:47:45.504 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T23:47:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.608+0000 7f5a673ce640 1 Processor -- start 2023-12-01T23:47:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.608+0000 7f5a673ce640 1 -- start start 2023-12-01T23:47:45.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a673ce640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a601501c0 0x7f5a60159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a673ce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 0x7f5a60071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a673ce640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a60072b60 con 0x7f5a600bff00 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a673ce640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a601572d0 con 0x7f5a601501c0 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a673ce640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600c1a90 con 0x7f5a60156e60 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a64969640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f5a600bff00 0x7f5a60072450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:49122/0 (socket says 172.21.15.96:49122) 2023-12-01T23:47:45.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.609+0000 7f5a64969640 1 -- 172.21.15.96:0/86518835 learned_addr learned my addr 172.21.15.96:0/86518835 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:47:45.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.612+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590009838 0 0) 0x7f5a60072b60 con 0x7f5a600bff00 2023-12-01T23:47:45.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.612+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a4c005730 con 0x7f5a600bff00 2023-12-01T23:47:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v1:172.21.15.96:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702883689 0 0) 0x7f5a4c005730 con 0x7f5a600bff00 2023-12-01T23:47:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 msgr2=0x7f5a60071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:45.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 0x7f5a60071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 >> v2:172.21.15.102:3300/0 conn(0x7f5a601501c0 msgr2=0x7f5a60159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 --2- 172.21.15.96:0/86518835 >> v2:172.21.15.102:3300/0 conn(0x7f5a601501c0 0x7f5a60159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 --> v1:172.21.15.96:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a600c1d30 con 0x7f5a600bff00 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v1:172.21.15.96:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2346215439 0 0) 0x7f5a50001670 con 0x7f5a600bff00 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 >> v1:172.21.15.96:6789/0 conn(0x7f5a600bff00 legacy=0x7f5a60072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a4c005b80 0x7f5a4c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 0x7f5a4c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a4c006f60 0x7f5a4c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a601572d0 con 0x7f5a4c006f60 2023-12-01T23:47:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600c1a90 con 0x7f5a4c005b80 2023-12-01T23:47:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.615+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c00deb0 con 0x7f5a60156e60 2023-12-01T23:47:45.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.617+0000 7f5a6596b640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a4c006f60 0x7f5a4c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.621+0000 7f5a6596b640 1 -- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 msgr2=0x7f5a4c0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.621+0000 7f5a6596b640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a60156e60 0x7f5a4c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.621+0000 7f5a6596b640 1 -- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a4c005b80 msgr2=0x7f5a4c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.621+0000 7f5a6596b640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a4c005b80 0x7f5a4c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.621+0000 7f5a6596b640 1 -- 172.21.15.96:0/86518835 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c005730 con 0x7f5a4c006f60 2023-12-01T23:47:45.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.622+0000 7f5a6596b640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a4c006f60 0x7f5a4c0073e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009e40 tx=0x7f5a4c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ce428265a8679a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.626+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5802cd90 con 0x7f5a4c006f60 2023-12-01T23:47:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.626+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a58034440 con 0x7f5a4c006f60 2023-12-01T23:47:45.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.626+0000 7f5a57fff640 1 -- 172.21.15.96:0/86518835 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a580347f0 con 0x7f5a4c006f60 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 -- 172.21.15.96:0/86518835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a4c006f60 msgr2=0x7f5a4c0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 --2- 172.21.15.96:0/86518835 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a4c006f60 0x7f5a4c0073e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009e40 tx=0x7f5a4c007a00 comp rx=0 tx=0).stop 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a6596b640 1 -- 172.21.15.96:0/86518835 reap_dead start 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 -- 172.21.15.96:0/86518835 shutdown_connections 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 -- 172.21.15.96:0/86518835 >> 172.21.15.96:0/86518835 conn(0x7f5a6006cd60 msgr2=0x7f5a6006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 -- 172.21.15.96:0/86518835 shutdown_connections 2023-12-01T23:47:45.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.627+0000 7f5a673ce640 1 -- 172.21.15.96:0/86518835 wait complete. 2023-12-01T23:47:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.628+0000 7f5a673ce640 1 Processor -- start 2023-12-01T23:47:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.628+0000 7f5a673ce640 1 -- start start 2023-12-01T23:47:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a601ebbb0 0x7f5a60157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600c30a0 con 0x7f5a601ebbb0 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a601eaec0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a673ce640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a601594e0 con 0x7f5a600ca0d0 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a6516a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.629+0000 7f5a6596b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.630+0000 7f5a6516a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:57384/0 (socket says 172.21.15.96:57384) 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.630+0000 7f5a6596b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:47834/0 (socket says 172.21.15.96:47834) 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.630+0000 7f5a6516a640 1 -- 172.21.15.96:0/3618302233 learned_addr learned my addr 172.21.15.96:0/3618302233 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:45.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.631+0000 7f5a64969640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a601ebbb0 0x7f5a60157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6596b640 1 -- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 msgr2=0x7f5a60158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6596b640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6596b640 1 -- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a601ebbb0 msgr2=0x7f5a60157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6596b640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a601ebbb0 0x7f5a60157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6596b640 1 -- 172.21.15.96:0/3618302233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a600c2ae0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.633+0000 7f5a6516a640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:47:45.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.636+0000 7f5a6596b640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a58033000 tx=0x7f5a58004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:45.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.639+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58042070 con 0x7f5a600ca4b0 2023-12-01T23:47:45.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.639+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5803dd30 con 0x7f5a600ca4b0 2023-12-01T23:47:45.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.639+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5803dea0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.639+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600c2dc0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.640+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a601eb3b0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.641+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a600c77e0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.879+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a58003bb0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.880+0000 7f5a55ffb640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 0x7f5a4406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.880+0000 7f5a6516a640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 0x7f5a4406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:45.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.880+0000 7f5a6516a640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 0x7f5a4406d350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c006fd0 tx=0x7f5a5c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:45.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.882+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a5807e3f0 con 0x7f5a600ca4b0 2023-12-01T23:47:45.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:45.897+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a5807a730 con 0x7f5a600ca4b0 2023-12-01T23:47:46.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.062+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 --> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a60156660 con 0x7f5a4406ae90 2023-12-01T23:47:46.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.070+0000 7f5a55ffb640 1 -- 172.21.15.96:0/3618302233 <== mgr.4113 v2:172.21.15.96:6800/3997971778 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373771 (secure 0 0 0) 0x7f5a5c009a30 con 0x7f5a4406ae90 2023-12-01T23:47:46.075 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:46.077 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 msgr2=0x7f5a4406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 0x7f5a4406d350 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c006fd0 tx=0x7f5a5c009190 comp rx=0 tx=0).stop 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 msgr2=0x7f5a600c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5a58033000 tx=0x7f5a58004b50 comp rx=0 tx=0).stop 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 shutdown_connections 2023-12-01T23:47:46.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f5a4406ae90 0x7f5a4406d350 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a600ca4b0 0x7f5a600c2250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5a601ebbb0 0x7f5a60157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 --2- 172.21.15.96:0/3618302233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a600ca0d0 0x7f5a60158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 >> 172.21.15.96:0/3618302233 conn(0x7f5a6006cd60 msgr2=0x7f5a600c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 shutdown_connections 2023-12-01T23:47:46.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.074+0000 7f5a673ce640 1 -- 172.21.15.96:0/3618302233 wait complete. 2023-12-01T23:47:46.086 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":909,"stamp":"2023-12-01T23:47:44.201558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":41170046,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":1146,"num_read_kb":1192,"num_write":13167,"num_write_kb":371743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15689,"ondisk_log_size":15689,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":409192,"kb_used_data":57064,"kb_used_omap":12,"kb_used_meta":352051,"kb_avail":754565528,"statfs":{"total":773094113280,"available":772675100672,"internally_reserved":0,"allocated":58433536,"data_stored":83352620,"data_compressed":7744364,"data_compressed_allocated":12189696,"data_compressed_original":38625280,"omap_allocated":12737,"internal_metadata":360500799},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003390"},"pg_stats":[{"pgid":"2.1f","version":"29'587","reported_seq":629,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:23.821644+0000","last_change":"2023-12-01T23:46:23.821644+0000","last_active":"2023-12-01T23:46:23.821644+0000","last_peered":"2023-12-01T23:46:23.821644+0000","last_clean":"2023-12-01T23:46:23.821644+0000","last_became_active":"2023-12-01T23:18:27.886545+0000","last_became_peered":"2023-12-01T23:18:27.886545+0000","last_unstale":"2023-12-01T23:46:23.821644+0000","last_undegraded":"2023-12-01T23:46:23.821644+0000","last_fullsized":"2023-12-01T23:46:23.821644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'587","last_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_deep_scrub":"29'587","last_deep_scrub_stamp":"2023-12-01T23:46:23.821567+0000","last_clean_scrub_stamp":"2023-12-01T23:46:23.821567+0000","objects_scrubbed":3,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:27:45.679880+0000","scrub_duration":0.014376867999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":578,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'30","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.099073+0000","last_change":"2023-12-01T23:46:29.099073+0000","last_active":"2023-12-01T23:46:29.099073+0000","last_peered":"2023-12-01T23:46:29.099073+0000","last_clean":"2023-12-01T23:46:29.099073+0000","last_became_active":"2023-12-01T23:18:28.871583+0000","last_became_peered":"2023-12-01T23:18:28.871583+0000","last_unstale":"2023-12-01T23:46:29.099073+0000","last_undegraded":"2023-12-01T23:46:29.099073+0000","last_fullsized":"2023-12-01T23:46:29.099073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-12-01T23:46:29.098979+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.098979+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.006340+0000","scrub_duration":0.001500726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'166","reported_seq":202,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.041956+0000","last_change":"2023-12-01T23:47:09.041956+0000","last_active":"2023-12-01T23:47:09.041956+0000","last_peered":"2023-12-01T23:47:09.041956+0000","last_clean":"2023-12-01T23:47:09.041956+0000","last_became_active":"2023-12-01T23:18:34.837571+0000","last_became_peered":"2023-12-01T23:18:34.837571+0000","last_unstale":"2023-12-01T23:47:09.041956+0000","last_undegraded":"2023-12-01T23:47:09.041956+0000","last_fullsized":"2023-12-01T23:47:09.041956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'166","last_scrub_stamp":"2023-12-01T23:47:09.041819+0000","last_deep_scrub":"29'166","last_deep_scrub_stamp":"2023-12-01T23:47:09.041819+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.041819+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:15:40.390182+0000","scrub_duration":0.00316044,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":10440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"29'722","reported_seq":764,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.050166+0000","last_change":"2023-12-01T23:46:37.050187+0000","last_active":"2023-12-01T23:46:37.050166+0000","last_peered":"2023-12-01T23:46:37.050166+0000","last_clean":"2023-12-01T23:46:37.050166+0000","last_became_active":"2023-12-01T23:18:27.834749+0000","last_became_peered":"2023-12-01T23:18:27.834749+0000","last_unstale":"2023-12-01T23:46:37.050166+0000","last_undegraded":"2023-12-01T23:46:37.050166+0000","last_fullsized":"2023-12-01T23:46:37.050166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'722","last_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_deep_scrub":"29'722","last_deep_scrub_stamp":"2023-12-01T23:46:37.050112+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.050112+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:47.620513+0000","scrub_duration":0.013774812000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":4519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'36","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.791032+0000","last_change":"2023-12-01T23:46:27.791032+0000","last_active":"2023-12-01T23:46:27.791032+0000","last_peered":"2023-12-01T23:46:27.791032+0000","last_clean":"2023-12-01T23:46:27.791032+0000","last_became_active":"2023-12-01T23:18:28.877010+0000","last_became_peered":"2023-12-01T23:18:28.877010+0000","last_unstale":"2023-12-01T23:46:27.791032+0000","last_undegraded":"2023-12-01T23:46:27.791032+0000","last_fullsized":"2023-12-01T23:46:27.791032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:27.790881+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.790881+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:09.321687+0000","scrub_duration":0.0024783050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'146","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.730148+0000","last_change":"2023-12-01T23:47:01.730148+0000","last_active":"2023-12-01T23:47:01.730148+0000","last_peered":"2023-12-01T23:47:01.730148+0000","last_clean":"2023-12-01T23:47:01.730148+0000","last_became_active":"2023-12-01T23:19:06.103250+0000","last_became_peered":"2023-12-01T23:19:06.103250+0000","last_unstale":"2023-12-01T23:47:01.730148+0000","last_undegraded":"2023-12-01T23:47:01.730148+0000","last_fullsized":"2023-12-01T23:47:01.730148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'146","last_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_deep_scrub":"29'146","last_deep_scrub_stamp":"2023-12-01T23:47:01.730038+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.730038+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:03:31.371959+0000","scrub_duration":0.0029167759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2,3],"acting":[4,6,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1377","reported_seq":1416,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:38.059304+0000","last_change":"2023-12-01T23:46:38.059352+0000","last_active":"2023-12-01T23:46:38.059304+0000","last_peered":"2023-12-01T23:46:38.059304+0000","last_clean":"2023-12-01T23:46:38.059304+0000","last_became_active":"2023-12-01T23:18:27.893681+0000","last_became_peered":"2023-12-01T23:18:27.893681+0000","last_unstale":"2023-12-01T23:46:38.059304+0000","last_undegraded":"2023-12-01T23:46:38.059304+0000","last_fullsized":"2023-12-01T23:46:38.059304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1377","last_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_deep_scrub":"29'1377","last_deep_scrub_stamp":"2023-12-01T23:46:38.059230+0000","last_clean_scrub_stamp":"2023-12-01T23:46:38.059230+0000","objects_scrubbed":3,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:38.866050+0000","scrub_duration":0.025760086000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1366,"num_write_kb":8993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.166021+0000","last_change":"2023-12-01T23:46:50.166042+0000","last_active":"2023-12-01T23:46:50.166021+0000","last_peered":"2023-12-01T23:46:50.166021+0000","last_clean":"2023-12-01T23:46:50.166021+0000","last_became_active":"2023-12-01T23:18:28.873400+0000","last_became_peered":"2023-12-01T23:18:28.873400+0000","last_unstale":"2023-12-01T23:46:50.166021+0000","last_undegraded":"2023-12-01T23:46:50.166021+0000","last_fullsized":"2023-12-01T23:46:50.166021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:50.165931+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.165931+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:21.986122+0000","scrub_duration":0.0013328350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'152","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:44.638442+0000","last_change":"2023-12-01T23:46:44.638462+0000","last_active":"2023-12-01T23:46:44.638442+0000","last_peered":"2023-12-01T23:46:44.638442+0000","last_clean":"2023-12-01T23:46:44.638442+0000","last_became_active":"2023-12-01T23:18:34.787283+0000","last_became_peered":"2023-12-01T23:18:34.787283+0000","last_unstale":"2023-12-01T23:46:44.638442+0000","last_undegraded":"2023-12-01T23:46:44.638442+0000","last_fullsized":"2023-12-01T23:46:44.638442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'152","last_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_deep_scrub":"29'152","last_deep_scrub_stamp":"2023-12-01T23:46:44.638369+0000","last_clean_scrub_stamp":"2023-12-01T23:46:44.638369+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:06.578744+0000","scrub_duration":0.002261529,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":9823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'7","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.084780+0000","last_change":"2023-12-01T23:46:34.084820+0000","last_active":"2023-12-01T23:46:34.084780+0000","last_peered":"2023-12-01T23:46:34.084780+0000","last_clean":"2023-12-01T23:46:34.084780+0000","last_became_active":"2023-12-01T23:18:27.893016+0000","last_became_peered":"2023-12-01T23:18:27.893016+0000","last_unstale":"2023-12-01T23:46:34.084780+0000","last_undegraded":"2023-12-01T23:46:34.084780+0000","last_fullsized":"2023-12-01T23:46:34.084780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-12-01T23:46:34.084694+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.084694+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:50:09.154389+0000","scrub_duration":0.0024307840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:57.212463+0000","last_change":"2023-12-01T23:46:57.212484+0000","last_active":"2023-12-01T23:46:57.212463+0000","last_peered":"2023-12-01T23:46:57.212463+0000","last_clean":"2023-12-01T23:46:57.212463+0000","last_became_active":"2023-12-01T23:18:28.879337+0000","last_became_peered":"2023-12-01T23:18:28.879337+0000","last_unstale":"2023-12-01T23:46:57.212463+0000","last_undegraded":"2023-12-01T23:46:57.212463+0000","last_fullsized":"2023-12-01T23:46:57.212463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:57.212392+0000","last_clean_scrub_stamp":"2023-12-01T23:46:57.212392+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:42.947264+0000","scrub_duration":0.0012129280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'148","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.646302+0000","last_change":"2023-12-01T23:47:05.646323+0000","last_active":"2023-12-01T23:47:05.646302+0000","last_peered":"2023-12-01T23:47:05.646302+0000","last_clean":"2023-12-01T23:47:05.646302+0000","last_became_active":"2023-12-01T23:18:34.840598+0000","last_became_peered":"2023-12-01T23:18:34.840598+0000","last_unstale":"2023-12-01T23:47:05.646302+0000","last_undegraded":"2023-12-01T23:47:05.646302+0000","last_fullsized":"2023-12-01T23:47:05.646302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2023-12-01T23:47:05.646225+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2023-12-01T23:47:05.646225+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.646225+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:24.112296+0000","scrub_duration":0.0027797070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":5829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.658029+0000","last_change":"2023-12-01T23:46:37.658029+0000","last_active":"2023-12-01T23:46:37.658029+0000","last_peered":"2023-12-01T23:46:37.658029+0000","last_clean":"2023-12-01T23:46:37.658029+0000","last_became_active":"2023-12-01T23:18:28.870095+0000","last_became_peered":"2023-12-01T23:18:28.870095+0000","last_unstale":"2023-12-01T23:46:37.658029+0000","last_undegraded":"2023-12-01T23:46:37.658029+0000","last_fullsized":"2023-12-01T23:46:37.658029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:37.657927+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.657927+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:23:10.474950+0000","scrub_duration":0.001280696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'636","reported_seq":677,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.993713+0000","last_change":"2023-12-01T23:46:42.993713+0000","last_active":"2023-12-01T23:46:42.993713+0000","last_peered":"2023-12-01T23:46:42.993713+0000","last_clean":"2023-12-01T23:46:42.993713+0000","last_became_active":"2023-12-01T23:18:27.890020+0000","last_became_peered":"2023-12-01T23:18:27.890020+0000","last_unstale":"2023-12-01T23:46:42.993713+0000","last_undegraded":"2023-12-01T23:46:42.993713+0000","last_fullsized":"2023-12-01T23:46:42.993713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'636","last_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_deep_scrub":"29'636","last_deep_scrub_stamp":"2023-12-01T23:46:42.993627+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.993627+0000","objects_scrubbed":2,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:24:26.661673+0000","scrub_duration":0.016535945999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'117","reported_seq":153,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.710564+0000","last_change":"2023-12-01T23:47:02.710602+0000","last_active":"2023-12-01T23:47:02.710564+0000","last_peered":"2023-12-01T23:47:02.710564+0000","last_clean":"2023-12-01T23:47:02.710564+0000","last_became_active":"2023-12-01T23:18:34.837305+0000","last_became_peered":"2023-12-01T23:18:34.837305+0000","last_unstale":"2023-12-01T23:47:02.710564+0000","last_undegraded":"2023-12-01T23:47:02.710564+0000","last_fullsized":"2023-12-01T23:47:02.710564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'117","last_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_deep_scrub":"29'117","last_deep_scrub_stamp":"2023-12-01T23:47:02.710464+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.710464+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:59.065723+0000","scrub_duration":0.003020946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"29'38","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.040412+0000","last_change":"2023-12-01T23:46:25.040412+0000","last_active":"2023-12-01T23:46:25.040412+0000","last_peered":"2023-12-01T23:46:25.040412+0000","last_clean":"2023-12-01T23:46:25.040412+0000","last_became_active":"2023-12-01T23:18:28.856923+0000","last_became_peered":"2023-12-01T23:18:28.856923+0000","last_unstale":"2023-12-01T23:46:25.040412+0000","last_undegraded":"2023-12-01T23:46:25.040412+0000","last_fullsized":"2023-12-01T23:46:25.040412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:25.040325+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.040325+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:10.530867+0000","scrub_duration":0.001183684,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.625555+0000","last_change":"2023-12-01T23:46:29.625555+0000","last_active":"2023-12-01T23:46:29.625555+0000","last_peered":"2023-12-01T23:46:29.625555+0000","last_clean":"2023-12-01T23:46:29.625555+0000","last_became_active":"2023-12-01T23:18:27.831603+0000","last_became_peered":"2023-12-01T23:18:27.831603+0000","last_unstale":"2023-12-01T23:46:29.625555+0000","last_undegraded":"2023-12-01T23:46:29.625555+0000","last_fullsized":"2023-12-01T23:46:29.625555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:29.625443+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.625443+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:09.464351+0000","scrub_duration":0.0012089830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"29'182","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.721205+0000","last_change":"2023-12-01T23:47:09.721229+0000","last_active":"2023-12-01T23:47:09.721205+0000","last_peered":"2023-12-01T23:47:09.721205+0000","last_clean":"2023-12-01T23:47:09.721205+0000","last_became_active":"2023-12-01T23:18:34.788334+0000","last_became_peered":"2023-12-01T23:18:34.788334+0000","last_unstale":"2023-12-01T23:47:09.721205+0000","last_undegraded":"2023-12-01T23:47:09.721205+0000","last_fullsized":"2023-12-01T23:47:09.721205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'182","last_scrub_stamp":"2023-12-01T23:47:09.721108+0000","last_deep_scrub":"29'182","last_deep_scrub_stamp":"2023-12-01T23:47:09.721108+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.721108+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:16:08.026087+0000","scrub_duration":0.0030110990000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":11774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.007741+0000","last_change":"2023-12-01T23:46:52.007768+0000","last_active":"2023-12-01T23:46:52.007741+0000","last_peered":"2023-12-01T23:46:52.007741+0000","last_clean":"2023-12-01T23:46:52.007741+0000","last_became_active":"2023-12-01T23:18:28.821437+0000","last_became_peered":"2023-12-01T23:18:28.821437+0000","last_unstale":"2023-12-01T23:46:52.007741+0000","last_undegraded":"2023-12-01T23:46:52.007741+0000","last_fullsized":"2023-12-01T23:46:52.007741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:52.007658+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.007658+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:49.391014+0000","scrub_duration":0.001597935,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.520645+0000","last_change":"2023-12-01T23:46:45.520663+0000","last_active":"2023-12-01T23:46:45.520645+0000","last_peered":"2023-12-01T23:46:45.520645+0000","last_clean":"2023-12-01T23:46:45.520645+0000","last_became_active":"2023-12-01T23:18:27.885972+0000","last_became_peered":"2023-12-01T23:18:27.885972+0000","last_unstale":"2023-12-01T23:46:45.520645+0000","last_undegraded":"2023-12-01T23:46:45.520645+0000","last_fullsized":"2023-12-01T23:46:45.520645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:45.520583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.520583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:48:03.049323+0000","scrub_duration":0.0015689409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'128","reported_seq":164,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:21.758233+0000","last_change":"2023-12-01T23:47:21.758254+0000","last_active":"2023-12-01T23:47:21.758233+0000","last_peered":"2023-12-01T23:47:21.758233+0000","last_clean":"2023-12-01T23:47:21.758233+0000","last_became_active":"2023-12-01T23:18:34.784496+0000","last_became_peered":"2023-12-01T23:18:34.784496+0000","last_unstale":"2023-12-01T23:47:21.758233+0000","last_undegraded":"2023-12-01T23:47:21.758233+0000","last_fullsized":"2023-12-01T23:47:21.758233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'128","last_scrub_stamp":"2023-12-01T23:47:21.758156+0000","last_deep_scrub":"29'128","last_deep_scrub_stamp":"2023-12-01T23:47:21.758156+0000","last_clean_scrub_stamp":"2023-12-01T23:47:21.758156+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:44:34.794552+0000","scrub_duration":0.0027194039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":6922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.572012+0000","last_change":"2023-12-01T23:46:29.572012+0000","last_active":"2023-12-01T23:46:29.572012+0000","last_peered":"2023-12-01T23:46:29.572012+0000","last_clean":"2023-12-01T23:46:29.572012+0000","last_became_active":"2023-12-01T23:18:28.872428+0000","last_became_peered":"2023-12-01T23:18:28.872428+0000","last_unstale":"2023-12-01T23:46:29.572012+0000","last_undegraded":"2023-12-01T23:46:29.572012+0000","last_fullsized":"2023-12-01T23:46:29.572012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:29.571898+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.571898+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:51.682690+0000","scrub_duration":0.0014693180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.896027+0000","last_change":"2023-12-01T23:46:45.896048+0000","last_active":"2023-12-01T23:46:45.896027+0000","last_peered":"2023-12-01T23:46:45.896027+0000","last_clean":"2023-12-01T23:46:45.896027+0000","last_became_active":"2023-12-01T23:18:27.892352+0000","last_became_peered":"2023-12-01T23:18:27.892352+0000","last_unstale":"2023-12-01T23:46:45.896027+0000","last_undegraded":"2023-12-01T23:46:45.896027+0000","last_fullsized":"2023-12-01T23:46:45.896027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:45.895953+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.895953+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:34:05.047561+0000","scrub_duration":0.001328262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'126","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:49.687551+0000","last_change":"2023-12-01T23:46:49.687574+0000","last_active":"2023-12-01T23:46:49.687551+0000","last_peered":"2023-12-01T23:46:49.687551+0000","last_clean":"2023-12-01T23:46:49.687551+0000","last_became_active":"2023-12-01T23:18:34.787719+0000","last_became_peered":"2023-12-01T23:18:34.787719+0000","last_unstale":"2023-12-01T23:46:49.687551+0000","last_undegraded":"2023-12-01T23:46:49.687551+0000","last_fullsized":"2023-12-01T23:46:49.687551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'126","last_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_deep_scrub":"29'126","last_deep_scrub_stamp":"2023-12-01T23:46:49.687463+0000","last_clean_scrub_stamp":"2023-12-01T23:46:49.687463+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:47:53.378669+0000","scrub_duration":0.0035888880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":5037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"29'42","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.688025+0000","last_change":"2023-12-01T23:46:36.688025+0000","last_active":"2023-12-01T23:46:36.688025+0000","last_peered":"2023-12-01T23:46:36.688025+0000","last_clean":"2023-12-01T23:46:36.688025+0000","last_became_active":"2023-12-01T23:18:28.856763+0000","last_became_peered":"2023-12-01T23:18:28.856763+0000","last_unstale":"2023-12-01T23:46:36.688025+0000","last_undegraded":"2023-12-01T23:46:36.688025+0000","last_fullsized":"2023-12-01T23:46:36.688025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:46:36.687934+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.687934+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:36.569781+0000","scrub_duration":0.001389251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.660776+0000","last_change":"2023-12-01T23:46:34.660776+0000","last_active":"2023-12-01T23:46:34.660776+0000","last_peered":"2023-12-01T23:46:34.660776+0000","last_clean":"2023-12-01T23:46:34.660776+0000","last_became_active":"2023-12-01T23:18:27.891264+0000","last_became_peered":"2023-12-01T23:18:27.891264+0000","last_unstale":"2023-12-01T23:46:34.660776+0000","last_undegraded":"2023-12-01T23:46:34.660776+0000","last_fullsized":"2023-12-01T23:46:34.660776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:34.660656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.660656+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:28:56.771448+0000","scrub_duration":0.0024248519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.598069+0000","last_change":"2023-12-01T23:46:36.598093+0000","last_active":"2023-12-01T23:46:36.598069+0000","last_peered":"2023-12-01T23:46:36.598069+0000","last_clean":"2023-12-01T23:46:36.598069+0000","last_became_active":"2023-12-01T23:18:34.791734+0000","last_became_peered":"2023-12-01T23:18:34.791734+0000","last_unstale":"2023-12-01T23:46:36.598069+0000","last_undegraded":"2023-12-01T23:46:36.598069+0000","last_fullsized":"2023-12-01T23:46:36.598069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:36.597987+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.597987+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:08:56.617524+0000","scrub_duration":0.00256362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'37","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.915992+0000","last_change":"2023-12-01T23:46:58.916030+0000","last_active":"2023-12-01T23:46:58.915992+0000","last_peered":"2023-12-01T23:46:58.915992+0000","last_clean":"2023-12-01T23:46:58.915992+0000","last_became_active":"2023-12-01T23:18:28.779698+0000","last_became_peered":"2023-12-01T23:18:28.779698+0000","last_unstale":"2023-12-01T23:46:58.915992+0000","last_undegraded":"2023-12-01T23:46:58.915992+0000","last_fullsized":"2023-12-01T23:46:58.915992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:58.915919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.915919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:05.013437+0000","scrub_duration":0.0018718389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'310","reported_seq":351,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.611009+0000","last_change":"2023-12-01T23:46:39.611046+0000","last_active":"2023-12-01T23:46:39.611009+0000","last_peered":"2023-12-01T23:46:39.611009+0000","last_clean":"2023-12-01T23:46:39.611009+0000","last_became_active":"2023-12-01T23:18:27.891791+0000","last_became_peered":"2023-12-01T23:18:27.891791+0000","last_unstale":"2023-12-01T23:46:39.611009+0000","last_undegraded":"2023-12-01T23:46:39.611009+0000","last_fullsized":"2023-12-01T23:46:39.611009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'310","last_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_deep_scrub":"29'310","last_deep_scrub_stamp":"2023-12-01T23:46:39.610919+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.610919+0000","objects_scrubbed":1,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:38:41.341946+0000","scrub_duration":0.004221219,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":890,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'159","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:08.042656+0000","last_change":"2023-12-01T23:47:08.042679+0000","last_active":"2023-12-01T23:47:08.042656+0000","last_peered":"2023-12-01T23:47:08.042656+0000","last_clean":"2023-12-01T23:47:08.042656+0000","last_became_active":"2023-12-01T23:18:34.831161+0000","last_became_peered":"2023-12-01T23:18:34.831161+0000","last_unstale":"2023-12-01T23:47:08.042656+0000","last_undegraded":"2023-12-01T23:47:08.042656+0000","last_fullsized":"2023-12-01T23:47:08.042656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'159","last_scrub_stamp":"2023-12-01T23:47:08.042579+0000","last_deep_scrub":"29'159","last_deep_scrub_stamp":"2023-12-01T23:47:08.042579+0000","last_clean_scrub_stamp":"2023-12-01T23:47:08.042579+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:24.732443+0000","scrub_duration":0.003188363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":14937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"29'35","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.574038+0000","last_change":"2023-12-01T23:46:54.574038+0000","last_active":"2023-12-01T23:46:54.574038+0000","last_peered":"2023-12-01T23:46:54.574038+0000","last_clean":"2023-12-01T23:46:54.574038+0000","last_became_active":"2023-12-01T23:18:28.865009+0000","last_became_peered":"2023-12-01T23:18:28.865009+0000","last_unstale":"2023-12-01T23:46:54.574038+0000","last_undegraded":"2023-12-01T23:46:54.574038+0000","last_fullsized":"2023-12-01T23:46:54.574038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.573897+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.573897+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:57.397531+0000","scrub_duration":0.0014970319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.066910+0000","last_change":"2023-12-01T23:46:39.066910+0000","last_active":"2023-12-01T23:46:39.066910+0000","last_peered":"2023-12-01T23:46:39.066910+0000","last_clean":"2023-12-01T23:46:39.066910+0000","last_became_active":"2023-12-01T23:18:27.893584+0000","last_became_peered":"2023-12-01T23:18:27.893584+0000","last_unstale":"2023-12-01T23:46:39.066910+0000","last_undegraded":"2023-12-01T23:46:39.066910+0000","last_fullsized":"2023-12-01T23:46:39.066910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:39.066832+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.066832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:46.974193+0000","scrub_duration":0.001216946,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"29'132","reported_seq":170,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.582841+0000","last_change":"2023-12-01T23:46:48.582841+0000","last_active":"2023-12-01T23:46:48.582841+0000","last_peered":"2023-12-01T23:46:48.582841+0000","last_clean":"2023-12-01T23:46:48.582841+0000","last_became_active":"2023-12-01T23:18:34.833781+0000","last_became_peered":"2023-12-01T23:18:34.833781+0000","last_unstale":"2023-12-01T23:46:48.582841+0000","last_undegraded":"2023-12-01T23:46:48.582841+0000","last_fullsized":"2023-12-01T23:46:48.582841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'132","last_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_deep_scrub":"29'132","last_deep_scrub_stamp":"2023-12-01T23:46:48.582715+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.582715+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:52:39.547933+0000","scrub_duration":0.0027570889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":8582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'38","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.178935+0000","last_change":"2023-12-01T23:46:56.178935+0000","last_active":"2023-12-01T23:46:56.178935+0000","last_peered":"2023-12-01T23:46:56.178935+0000","last_clean":"2023-12-01T23:46:56.178935+0000","last_became_active":"2023-12-01T23:18:28.874328+0000","last_became_peered":"2023-12-01T23:18:28.874328+0000","last_unstale":"2023-12-01T23:46:56.178935+0000","last_undegraded":"2023-12-01T23:46:56.178935+0000","last_fullsized":"2023-12-01T23:46:56.178935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:46:56.178803+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.178803+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:21.586011+0000","scrub_duration":0.0019174109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.541631+0000","last_change":"2023-12-01T23:46:48.541631+0000","last_active":"2023-12-01T23:46:48.541631+0000","last_peered":"2023-12-01T23:46:48.541631+0000","last_clean":"2023-12-01T23:46:48.541631+0000","last_became_active":"2023-12-01T23:18:27.834806+0000","last_became_peered":"2023-12-01T23:18:27.834806+0000","last_unstale":"2023-12-01T23:46:48.541631+0000","last_undegraded":"2023-12-01T23:46:48.541631+0000","last_fullsized":"2023-12-01T23:46:48.541631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:48.541502+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.541502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:20:48.706314+0000","scrub_duration":0.001231413,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'191","reported_seq":228,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:18.666943+0000","last_change":"2023-12-01T23:47:18.666964+0000","last_active":"2023-12-01T23:47:18.666943+0000","last_peered":"2023-12-01T23:47:18.666943+0000","last_clean":"2023-12-01T23:47:18.666943+0000","last_became_active":"2023-12-01T23:18:34.831162+0000","last_became_peered":"2023-12-01T23:18:34.831162+0000","last_unstale":"2023-12-01T23:47:18.666943+0000","last_undegraded":"2023-12-01T23:47:18.666943+0000","last_fullsized":"2023-12-01T23:47:18.666943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'191","last_scrub_stamp":"2023-12-01T23:47:18.666866+0000","last_deep_scrub":"29'191","last_deep_scrub_stamp":"2023-12-01T23:47:18.666866+0000","last_clean_scrub_stamp":"2023-12-01T23:47:18.666866+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:52:29.972235+0000","scrub_duration":0.002986313,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":14681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"29'34","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.526319+0000","last_change":"2023-12-01T23:46:31.526319+0000","last_active":"2023-12-01T23:46:31.526319+0000","last_peered":"2023-12-01T23:46:31.526319+0000","last_clean":"2023-12-01T23:46:31.526319+0000","last_became_active":"2023-12-01T23:18:28.876462+0000","last_became_peered":"2023-12-01T23:18:28.876462+0000","last_unstale":"2023-12-01T23:46:31.526319+0000","last_undegraded":"2023-12-01T23:46:31.526319+0000","last_fullsized":"2023-12-01T23:46:31.526319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:31.526232+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.526232+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:41:11.365141+0000","scrub_duration":0.0014675910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"29'8","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:45.191499+0000","last_change":"2023-12-01T23:46:45.191499+0000","last_active":"2023-12-01T23:46:45.191499+0000","last_peered":"2023-12-01T23:46:45.191499+0000","last_clean":"2023-12-01T23:46:45.191499+0000","last_became_active":"2023-12-01T23:18:27.889613+0000","last_became_peered":"2023-12-01T23:18:27.889613+0000","last_unstale":"2023-12-01T23:46:45.191499+0000","last_undegraded":"2023-12-01T23:46:45.191499+0000","last_fullsized":"2023-12-01T23:46:45.191499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:45.191418+0000","last_clean_scrub_stamp":"2023-12-01T23:46:45.191418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:07:55.761819+0000","scrub_duration":0.00187754,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"29'108","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:22.754099+0000","last_change":"2023-12-01T23:47:22.754119+0000","last_active":"2023-12-01T23:47:22.754099+0000","last_peered":"2023-12-01T23:47:22.754099+0000","last_clean":"2023-12-01T23:47:22.754099+0000","last_became_active":"2023-12-01T23:18:34.837612+0000","last_became_peered":"2023-12-01T23:18:34.837612+0000","last_unstale":"2023-12-01T23:47:22.754099+0000","last_undegraded":"2023-12-01T23:47:22.754099+0000","last_fullsized":"2023-12-01T23:47:22.754099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'108","last_scrub_stamp":"2023-12-01T23:47:22.754026+0000","last_deep_scrub":"29'108","last_deep_scrub_stamp":"2023-12-01T23:47:22.754026+0000","last_clean_scrub_stamp":"2023-12-01T23:47:22.754026+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:05:57.730798+0000","scrub_duration":0.0024628559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":5857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"29'34","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.584022+0000","last_change":"2023-12-01T23:47:05.584069+0000","last_active":"2023-12-01T23:47:05.584022+0000","last_peered":"2023-12-01T23:47:05.584022+0000","last_clean":"2023-12-01T23:47:05.584022+0000","last_became_active":"2023-12-01T23:18:28.865068+0000","last_became_peered":"2023-12-01T23:18:28.865068+0000","last_unstale":"2023-12-01T23:47:05.584022+0000","last_undegraded":"2023-12-01T23:47:05.584022+0000","last_fullsized":"2023-12-01T23:47:05.584022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:47:05.583951+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:47:05.583951+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.583951+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:56:44.325716+0000","scrub_duration":0.001198055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'1033","reported_seq":2104,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.643989+0000","last_change":"2023-12-01T23:46:24.643989+0000","last_active":"2023-12-01T23:46:24.643989+0000","last_peered":"2023-12-01T23:46:24.643989+0000","last_clean":"2023-12-01T23:46:24.643989+0000","last_became_active":"2023-12-01T23:18:27.825732+0000","last_became_peered":"2023-12-01T23:18:27.825732+0000","last_unstale":"2023-12-01T23:46:24.643989+0000","last_undegraded":"2023-12-01T23:46:24.643989+0000","last_fullsized":"2023-12-01T23:46:24.643989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1033","last_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_deep_scrub":"29'1033","last_deep_scrub_stamp":"2023-12-01T23:46:24.643892+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.643892+0000","objects_scrubbed":1,"log_size":1033,"log_dups_size":0,"ondisk_log_size":1033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:26:33.573885+0000","scrub_duration":0.0020141569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":223325,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":1030,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'154","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:24.685867+0000","last_change":"2023-12-01T23:47:24.685888+0000","last_active":"2023-12-01T23:47:24.685867+0000","last_peered":"2023-12-01T23:47:24.685867+0000","last_clean":"2023-12-01T23:47:24.685867+0000","last_became_active":"2023-12-01T23:18:34.831378+0000","last_became_peered":"2023-12-01T23:18:34.831378+0000","last_unstale":"2023-12-01T23:47:24.685867+0000","last_undegraded":"2023-12-01T23:47:24.685867+0000","last_fullsized":"2023-12-01T23:47:24.685867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'154","last_scrub_stamp":"2023-12-01T23:47:24.685799+0000","last_deep_scrub":"29'154","last_deep_scrub_stamp":"2023-12-01T23:47:24.685799+0000","last_clean_scrub_stamp":"2023-12-01T23:47:24.685799+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:09:43.514136+0000","scrub_duration":0.0022877610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":10833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"29'27","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.717892+0000","last_change":"2023-12-01T23:46:31.717892+0000","last_active":"2023-12-01T23:46:31.717892+0000","last_peered":"2023-12-01T23:46:31.717892+0000","last_clean":"2023-12-01T23:46:31.717892+0000","last_became_active":"2023-12-01T23:18:28.871271+0000","last_became_peered":"2023-12-01T23:18:28.871271+0000","last_unstale":"2023-12-01T23:46:31.717892+0000","last_undegraded":"2023-12-01T23:46:31.717892+0000","last_fullsized":"2023-12-01T23:46:31.717892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-12-01T23:46:31.717809+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.717809+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:26.928183+0000","scrub_duration":0.001388479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"29'522","reported_seq":564,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.125261+0000","last_change":"2023-12-01T23:46:32.125261+0000","last_active":"2023-12-01T23:46:32.125261+0000","last_peered":"2023-12-01T23:46:32.125261+0000","last_clean":"2023-12-01T23:46:32.125261+0000","last_became_active":"2023-12-01T23:18:27.889010+0000","last_became_peered":"2023-12-01T23:18:27.889010+0000","last_unstale":"2023-12-01T23:46:32.125261+0000","last_undegraded":"2023-12-01T23:46:32.125261+0000","last_fullsized":"2023-12-01T23:46:32.125261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'522","last_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_deep_scrub":"29'522","last_deep_scrub_stamp":"2023-12-01T23:46:32.125130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.125130+0000","objects_scrubbed":1,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:58.630445+0000","scrub_duration":0.014960424999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'140","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.667378+0000","last_change":"2023-12-01T23:46:43.667378+0000","last_active":"2023-12-01T23:46:43.667378+0000","last_peered":"2023-12-01T23:46:43.667378+0000","last_clean":"2023-12-01T23:46:43.667378+0000","last_became_active":"2023-12-01T23:18:34.839877+0000","last_became_peered":"2023-12-01T23:18:34.839877+0000","last_unstale":"2023-12-01T23:46:43.667378+0000","last_undegraded":"2023-12-01T23:46:43.667378+0000","last_fullsized":"2023-12-01T23:46:43.667378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'140","last_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_deep_scrub":"29'140","last_deep_scrub_stamp":"2023-12-01T23:46:43.667288+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.667288+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:26.019724+0000","scrub_duration":0.0024242619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":12116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"29'31","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:48.062444+0000","last_change":"2023-12-01T23:46:48.062444+0000","last_active":"2023-12-01T23:46:48.062444+0000","last_peered":"2023-12-01T23:46:48.062444+0000","last_clean":"2023-12-01T23:46:48.062444+0000","last_became_active":"2023-12-01T23:18:28.877316+0000","last_became_peered":"2023-12-01T23:18:28.877316+0000","last_unstale":"2023-12-01T23:46:48.062444+0000","last_undegraded":"2023-12-01T23:46:48.062444+0000","last_fullsized":"2023-12-01T23:46:48.062444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-12-01T23:46:48.062339+0000","last_clean_scrub_stamp":"2023-12-01T23:46:48.062339+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:13:29.754649+0000","scrub_duration":0.0018067599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.295012+0000","last_change":"2023-12-01T23:46:41.295012+0000","last_active":"2023-12-01T23:46:41.295012+0000","last_peered":"2023-12-01T23:46:41.295012+0000","last_clean":"2023-12-01T23:46:41.295012+0000","last_became_active":"2023-12-01T23:18:27.886903+0000","last_became_peered":"2023-12-01T23:18:27.886903+0000","last_unstale":"2023-12-01T23:46:41.295012+0000","last_undegraded":"2023-12-01T23:46:41.295012+0000","last_fullsized":"2023-12-01T23:46:41.295012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-12-01T23:46:41.294917+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.294917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:36.505291+0000","scrub_duration":0.0016126510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.061262+0000","last_change":"2023-12-01T23:46:29.061287+0000","last_active":"2023-12-01T23:46:29.061262+0000","last_peered":"2023-12-01T23:46:29.061262+0000","last_clean":"2023-12-01T23:46:29.061262+0000","last_became_active":"2023-12-01T23:18:16.122577+0000","last_became_peered":"2023-12-01T23:18:16.122577+0000","last_unstale":"2023-12-01T23:46:29.061262+0000","last_undegraded":"2023-12-01T23:46:29.061262+0000","last_fullsized":"2023-12-01T23:46:29.061262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-12-01T23:46:29.061209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.061209+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:06.598456+0000","scrub_duration":0.0040676059999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'187","reported_seq":224,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.697944+0000","last_change":"2023-12-01T23:46:59.697967+0000","last_active":"2023-12-01T23:46:59.697944+0000","last_peered":"2023-12-01T23:46:59.697944+0000","last_clean":"2023-12-01T23:46:59.697944+0000","last_became_active":"2023-12-01T23:18:34.787198+0000","last_became_peered":"2023-12-01T23:18:34.787198+0000","last_unstale":"2023-12-01T23:46:59.697944+0000","last_undegraded":"2023-12-01T23:46:59.697944+0000","last_fullsized":"2023-12-01T23:46:59.697944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2023-12-01T23:46:59.697850+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.697850+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:18.163921+0000","scrub_duration":0.003308929,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":173,"num_write_kb":12215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"29'33","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.830146+0000","last_change":"2023-12-01T23:47:02.830146+0000","last_active":"2023-12-01T23:47:02.830146+0000","last_peered":"2023-12-01T23:47:02.830146+0000","last_clean":"2023-12-01T23:47:02.830146+0000","last_became_active":"2023-12-01T23:18:28.877887+0000","last_became_peered":"2023-12-01T23:18:28.877887+0000","last_unstale":"2023-12-01T23:47:02.830146+0000","last_undegraded":"2023-12-01T23:47:02.830146+0000","last_fullsized":"2023-12-01T23:47:02.830146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-12-01T23:47:02.830060+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.830060+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:14:34.055454+0000","scrub_duration":0.001200696,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.655758+0000","last_change":"2023-12-01T23:46:25.655758+0000","last_active":"2023-12-01T23:46:25.655758+0000","last_peered":"2023-12-01T23:46:25.655758+0000","last_clean":"2023-12-01T23:46:25.655758+0000","last_became_active":"2023-12-01T23:18:27.887110+0000","last_became_peered":"2023-12-01T23:18:27.887110+0000","last_unstale":"2023-12-01T23:46:25.655758+0000","last_undegraded":"2023-12-01T23:46:25.655758+0000","last_fullsized":"2023-12-01T23:46:25.655758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-12-01T23:46:25.655632+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.655632+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:50:43.867354+0000","scrub_duration":0.001438878,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"29'148","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.735859+0000","last_change":"2023-12-01T23:46:55.735897+0000","last_active":"2023-12-01T23:46:55.735859+0000","last_peered":"2023-12-01T23:46:55.735859+0000","last_clean":"2023-12-01T23:46:55.735859+0000","last_became_active":"2023-12-01T23:18:34.839483+0000","last_became_peered":"2023-12-01T23:18:34.839483+0000","last_unstale":"2023-12-01T23:46:55.735859+0000","last_undegraded":"2023-12-01T23:46:55.735859+0000","last_fullsized":"2023-12-01T23:46:55.735859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'148","last_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_deep_scrub":"29'148","last_deep_scrub_stamp":"2023-12-01T23:46:55.735760+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.735760+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:38:52.091018+0000","scrub_duration":0.0025007599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":6295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"29'43","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.627943+0000","last_change":"2023-12-01T23:46:33.627977+0000","last_active":"2023-12-01T23:46:33.627943+0000","last_peered":"2023-12-01T23:46:33.627943+0000","last_clean":"2023-12-01T23:46:33.627943+0000","last_became_active":"2023-12-01T23:19:06.055968+0000","last_became_peered":"2023-12-01T23:19:06.055968+0000","last_unstale":"2023-12-01T23:46:33.627943+0000","last_undegraded":"2023-12-01T23:46:33.627943+0000","last_fullsized":"2023-12-01T23:46:33.627943+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:33.627841+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.627841+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:47.591432+0000","scrub_duration":0.001328142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.628664+0000","last_change":"2023-12-01T23:46:26.628664+0000","last_active":"2023-12-01T23:46:26.628664+0000","last_peered":"2023-12-01T23:46:26.628664+0000","last_clean":"2023-12-01T23:46:26.628664+0000","last_became_active":"2023-12-01T23:18:27.832195+0000","last_became_peered":"2023-12-01T23:18:27.832195+0000","last_unstale":"2023-12-01T23:46:26.628664+0000","last_undegraded":"2023-12-01T23:46:26.628664+0000","last_fullsized":"2023-12-01T23:46:26.628664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2023-12-01T23:46:26.628583+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.628583+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:55:50.083961+0000","scrub_duration":0.002604281,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'186","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.606653+0000","last_change":"2023-12-01T23:46:55.606690+0000","last_active":"2023-12-01T23:46:55.606653+0000","last_peered":"2023-12-01T23:46:55.606653+0000","last_clean":"2023-12-01T23:46:55.606653+0000","last_became_active":"2023-12-01T23:19:06.162579+0000","last_became_peered":"2023-12-01T23:19:06.162579+0000","last_unstale":"2023-12-01T23:46:55.606653+0000","last_undegraded":"2023-12-01T23:46:55.606653+0000","last_fullsized":"2023-12-01T23:46:55.606653+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'186","last_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_deep_scrub":"29'186","last_deep_scrub_stamp":"2023-12-01T23:46:55.606555+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.606555+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T23:57:01.704072+0000","scrub_duration":0.0027214320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":9179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:07.837222+0000","last_change":"2023-12-01T23:47:07.837274+0000","last_active":"2023-12-01T23:47:07.837222+0000","last_peered":"2023-12-01T23:47:07.837222+0000","last_clean":"2023-12-01T23:47:07.837222+0000","last_became_active":"2023-12-01T23:18:28.871599+0000","last_became_peered":"2023-12-01T23:18:28.871599+0000","last_unstale":"2023-12-01T23:47:07.837222+0000","last_undegraded":"2023-12-01T23:47:07.837222+0000","last_fullsized":"2023-12-01T23:47:07.837222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:47:07.837136+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:47:07.837136+0000","last_clean_scrub_stamp":"2023-12-01T23:47:07.837136+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:47:53.167712+0000","scrub_duration":0.0018515199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:19.564768+0000","last_change":"2023-12-01T23:46:19.564768+0000","last_active":"2023-12-01T23:46:19.564768+0000","last_peered":"2023-12-01T23:46:19.564768+0000","last_clean":"2023-12-01T23:46:19.564768+0000","last_became_active":"2023-12-01T23:18:27.825766+0000","last_became_peered":"2023-12-01T23:18:27.825766+0000","last_unstale":"2023-12-01T23:46:19.564768+0000","last_undegraded":"2023-12-01T23:46:19.564768+0000","last_fullsized":"2023-12-01T23:46:19.564768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:19.564681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:19.564681+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:07:18.833129+0000","scrub_duration":0.0023607229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"29'143","reported_seq":180,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:09.353370+0000","last_change":"2023-12-01T23:47:09.353393+0000","last_active":"2023-12-01T23:47:09.353370+0000","last_peered":"2023-12-01T23:47:09.353370+0000","last_clean":"2023-12-01T23:47:09.353370+0000","last_became_active":"2023-12-01T23:18:34.790110+0000","last_became_peered":"2023-12-01T23:18:34.790110+0000","last_unstale":"2023-12-01T23:47:09.353370+0000","last_undegraded":"2023-12-01T23:47:09.353370+0000","last_fullsized":"2023-12-01T23:47:09.353370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2023-12-01T23:47:09.353291+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2023-12-01T23:47:09.353291+0000","last_clean_scrub_stamp":"2023-12-01T23:47:09.353291+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:15:40.701654+0000","scrub_duration":0.002774903,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":12345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"29'23","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.819389+0000","last_change":"2023-12-01T23:47:00.819389+0000","last_active":"2023-12-01T23:47:00.819389+0000","last_peered":"2023-12-01T23:47:00.819389+0000","last_clean":"2023-12-01T23:47:00.819389+0000","last_became_active":"2023-12-01T23:18:28.874310+0000","last_became_peered":"2023-12-01T23:18:28.874310+0000","last_unstale":"2023-12-01T23:47:00.819389+0000","last_undegraded":"2023-12-01T23:47:00.819389+0000","last_fullsized":"2023-12-01T23:47:00.819389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-12-01T23:47:00.819291+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.819291+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:46.554163+0000","scrub_duration":0.001268436,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:21.537130+0000","last_change":"2023-12-01T23:46:21.537165+0000","last_active":"2023-12-01T23:46:21.537130+0000","last_peered":"2023-12-01T23:46:21.537130+0000","last_clean":"2023-12-01T23:46:21.537130+0000","last_became_active":"2023-12-01T23:18:27.834593+0000","last_became_peered":"2023-12-01T23:18:27.834593+0000","last_unstale":"2023-12-01T23:46:21.537130+0000","last_undegraded":"2023-12-01T23:46:21.537130+0000","last_fullsized":"2023-12-01T23:46:21.537130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:21.537038+0000","last_clean_scrub_stamp":"2023-12-01T23:46:21.537038+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:17.479391+0000","scrub_duration":0.0027855789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"29'171","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.762785+0000","last_change":"2023-12-01T23:46:59.762823+0000","last_active":"2023-12-01T23:46:59.762785+0000","last_peered":"2023-12-01T23:46:59.762785+0000","last_clean":"2023-12-01T23:46:59.762785+0000","last_became_active":"2023-12-01T23:18:34.787789+0000","last_became_peered":"2023-12-01T23:18:34.787789+0000","last_unstale":"2023-12-01T23:46:59.762785+0000","last_undegraded":"2023-12-01T23:46:59.762785+0000","last_fullsized":"2023-12-01T23:46:59.762785+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'171","last_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_deep_scrub":"29'171","last_deep_scrub_stamp":"2023-12-01T23:46:59.762681+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.762681+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:27:37.020845+0000","scrub_duration":0.0029108900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":15293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"29'37","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.935278+0000","last_change":"2023-12-01T23:46:55.935325+0000","last_active":"2023-12-01T23:46:55.935278+0000","last_peered":"2023-12-01T23:46:55.935278+0000","last_clean":"2023-12-01T23:46:55.935278+0000","last_became_active":"2023-12-01T23:18:28.871153+0000","last_became_peered":"2023-12-01T23:18:28.871153+0000","last_unstale":"2023-12-01T23:46:55.935278+0000","last_undegraded":"2023-12-01T23:46:55.935278+0000","last_fullsized":"2023-12-01T23:46:55.935278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:55.935190+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.935190+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:55:38.287626+0000","scrub_duration":0.0013732950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'14","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.631874+0000","last_change":"2023-12-01T23:46:22.631874+0000","last_active":"2023-12-01T23:46:22.631874+0000","last_peered":"2023-12-01T23:46:22.631874+0000","last_clean":"2023-12-01T23:46:22.631874+0000","last_became_active":"2023-12-01T23:18:27.834420+0000","last_became_peered":"2023-12-01T23:18:27.834420+0000","last_unstale":"2023-12-01T23:46:22.631874+0000","last_undegraded":"2023-12-01T23:46:22.631874+0000","last_fullsized":"2023-12-01T23:46:22.631874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2023-12-01T23:46:22.631783+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.631783+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:27:42.297274+0000","scrub_duration":0.0059878589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"29'130","reported_seq":166,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.654375+0000","last_change":"2023-12-01T23:46:46.654375+0000","last_active":"2023-12-01T23:46:46.654375+0000","last_peered":"2023-12-01T23:46:46.654375+0000","last_clean":"2023-12-01T23:46:46.654375+0000","last_became_active":"2023-12-01T23:18:34.840595+0000","last_became_peered":"2023-12-01T23:18:34.840595+0000","last_unstale":"2023-12-01T23:46:46.654375+0000","last_undegraded":"2023-12-01T23:46:46.654375+0000","last_fullsized":"2023-12-01T23:46:46.654375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'130","last_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_deep_scrub":"29'130","last_deep_scrub_stamp":"2023-12-01T23:46:46.654234+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.654234+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:09:47.109603+0000","scrub_duration":0.0026405740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":7253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'32","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.650489+0000","last_change":"2023-12-01T23:46:41.650508+0000","last_active":"2023-12-01T23:46:41.650489+0000","last_peered":"2023-12-01T23:46:41.650489+0000","last_clean":"2023-12-01T23:46:41.650489+0000","last_became_active":"2023-12-01T23:18:28.866303+0000","last_became_peered":"2023-12-01T23:18:28.866303+0000","last_unstale":"2023-12-01T23:46:41.650489+0000","last_undegraded":"2023-12-01T23:46:41.650489+0000","last_fullsized":"2023-12-01T23:46:41.650489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:41.650424+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.650424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:08:03.590799+0000","scrub_duration":0.0014981689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:31.719656+0000","last_change":"2023-12-01T23:46:31.719675+0000","last_active":"2023-12-01T23:46:31.719656+0000","last_peered":"2023-12-01T23:46:31.719656+0000","last_clean":"2023-12-01T23:46:31.719656+0000","last_became_active":"2023-12-01T23:18:27.895272+0000","last_became_peered":"2023-12-01T23:18:27.895272+0000","last_unstale":"2023-12-01T23:46:31.719656+0000","last_undegraded":"2023-12-01T23:46:31.719656+0000","last_fullsized":"2023-12-01T23:46:31.719656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:31.719600+0000","last_clean_scrub_stamp":"2023-12-01T23:46:31.719600+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:05:15.461606+0000","scrub_duration":0.00093897100000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'135","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:24.157417+0000","last_change":"2023-12-01T23:47:24.157417+0000","last_active":"2023-12-01T23:47:24.157417+0000","last_peered":"2023-12-01T23:47:24.157417+0000","last_clean":"2023-12-01T23:47:24.157417+0000","last_became_active":"2023-12-01T23:18:34.789898+0000","last_became_peered":"2023-12-01T23:18:34.789898+0000","last_unstale":"2023-12-01T23:47:24.157417+0000","last_undegraded":"2023-12-01T23:47:24.157417+0000","last_fullsized":"2023-12-01T23:47:24.157417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'135","last_scrub_stamp":"2023-12-01T23:47:24.157315+0000","last_deep_scrub":"29'135","last_deep_scrub_stamp":"2023-12-01T23:47:24.157315+0000","last_clean_scrub_stamp":"2023-12-01T23:47:24.157315+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:37:50.671467+0000","scrub_duration":0.002819631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":7161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'49","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.679160+0000","last_change":"2023-12-01T23:46:29.679160+0000","last_active":"2023-12-01T23:46:29.679160+0000","last_peered":"2023-12-01T23:46:29.679160+0000","last_clean":"2023-12-01T23:46:29.679160+0000","last_became_active":"2023-12-01T23:19:06.056181+0000","last_became_peered":"2023-12-01T23:19:06.056181+0000","last_unstale":"2023-12-01T23:46:29.679160+0000","last_undegraded":"2023-12-01T23:46:29.679160+0000","last_fullsized":"2023-12-01T23:46:29.679160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'49","last_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_deep_scrub":"29'49","last_deep_scrub_stamp":"2023-12-01T23:46:29.679065+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.679065+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:53:25.621418+0000","scrub_duration":0.0015688550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.298846+0000","last_change":"2023-12-01T23:46:40.298865+0000","last_active":"2023-12-01T23:46:40.298846+0000","last_peered":"2023-12-01T23:46:40.298846+0000","last_clean":"2023-12-01T23:46:40.298846+0000","last_became_active":"2023-12-01T23:18:27.886002+0000","last_became_peered":"2023-12-01T23:18:27.886002+0000","last_unstale":"2023-12-01T23:46:40.298846+0000","last_undegraded":"2023-12-01T23:46:40.298846+0000","last_fullsized":"2023-12-01T23:46:40.298846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-12-01T23:46:40.298785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.298785+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:00:12.873162+0000","scrub_duration":0.0013254339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'118","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:22.144422+0000","last_change":"2023-12-01T23:47:22.144445+0000","last_active":"2023-12-01T23:47:22.144422+0000","last_peered":"2023-12-01T23:47:22.144422+0000","last_clean":"2023-12-01T23:47:22.144422+0000","last_became_active":"2023-12-01T23:18:34.838988+0000","last_became_peered":"2023-12-01T23:18:34.838988+0000","last_unstale":"2023-12-01T23:47:22.144422+0000","last_undegraded":"2023-12-01T23:47:22.144422+0000","last_fullsized":"2023-12-01T23:47:22.144422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'118","last_scrub_stamp":"2023-12-01T23:47:22.144340+0000","last_deep_scrub":"29'118","last_deep_scrub_stamp":"2023-12-01T23:47:22.144340+0000","last_clean_scrub_stamp":"2023-12-01T23:47:22.144340+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:33:26.344832+0000","scrub_duration":0.0028948759999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":105,"num_write_kb":6554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'45","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:32.707881+0000","last_change":"2023-12-01T23:46:32.707923+0000","last_active":"2023-12-01T23:46:32.707881+0000","last_peered":"2023-12-01T23:46:32.707881+0000","last_clean":"2023-12-01T23:46:32.707881+0000","last_became_active":"2023-12-01T23:18:28.857897+0000","last_became_peered":"2023-12-01T23:18:28.857897+0000","last_unstale":"2023-12-01T23:46:32.707881+0000","last_undegraded":"2023-12-01T23:46:32.707881+0000","last_fullsized":"2023-12-01T23:46:32.707881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:32.707812+0000","last_clean_scrub_stamp":"2023-12-01T23:46:32.707812+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:33:51.859421+0000","scrub_duration":0.0017506170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'258","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.834421+0000","last_change":"2023-12-01T23:46:22.834421+0000","last_active":"2023-12-01T23:46:22.834421+0000","last_peered":"2023-12-01T23:46:22.834421+0000","last_clean":"2023-12-01T23:46:22.834421+0000","last_became_active":"2023-12-01T23:18:27.834501+0000","last_became_peered":"2023-12-01T23:18:27.834501+0000","last_unstale":"2023-12-01T23:46:22.834421+0000","last_undegraded":"2023-12-01T23:46:22.834421+0000","last_fullsized":"2023-12-01T23:46:22.834421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2023-12-01T23:46:22.834344+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.834344+0000","objects_scrubbed":3,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:40:00.371590+0000","scrub_duration":0.010238596000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2606181,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":2682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'141","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:10.393899+0000","last_change":"2023-12-01T23:47:10.393899+0000","last_active":"2023-12-01T23:47:10.393899+0000","last_peered":"2023-12-01T23:47:10.393899+0000","last_clean":"2023-12-01T23:47:10.393899+0000","last_became_active":"2023-12-01T23:18:34.837611+0000","last_became_peered":"2023-12-01T23:18:34.837611+0000","last_unstale":"2023-12-01T23:47:10.393899+0000","last_undegraded":"2023-12-01T23:47:10.393899+0000","last_fullsized":"2023-12-01T23:47:10.393899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'141","last_scrub_stamp":"2023-12-01T23:47:10.393805+0000","last_deep_scrub":"29'141","last_deep_scrub_stamp":"2023-12-01T23:47:10.393805+0000","last_clean_scrub_stamp":"2023-12-01T23:47:10.393805+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:33:07.284712+0000","scrub_duration":0.0029833390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":11250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:54.897151+0000","last_change":"2023-12-01T23:46:54.897151+0000","last_active":"2023-12-01T23:46:54.897151+0000","last_peered":"2023-12-01T23:46:54.897151+0000","last_clean":"2023-12-01T23:46:54.897151+0000","last_became_active":"2023-12-01T23:18:28.780468+0000","last_became_peered":"2023-12-01T23:18:28.780468+0000","last_unstale":"2023-12-01T23:46:54.897151+0000","last_undegraded":"2023-12-01T23:46:54.897151+0000","last_fullsized":"2023-12-01T23:46:54.897151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:54.897063+0000","last_clean_scrub_stamp":"2023-12-01T23:46:54.897063+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:19.398843+0000","scrub_duration":0.0017864280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'837","reported_seq":877,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.690721+0000","last_change":"2023-12-01T23:46:22.690721+0000","last_active":"2023-12-01T23:46:22.690721+0000","last_peered":"2023-12-01T23:46:22.690721+0000","last_clean":"2023-12-01T23:46:22.690721+0000","last_became_active":"2023-12-01T23:18:27.889147+0000","last_became_peered":"2023-12-01T23:18:27.889147+0000","last_unstale":"2023-12-01T23:46:22.690721+0000","last_undegraded":"2023-12-01T23:46:22.690721+0000","last_fullsized":"2023-12-01T23:46:22.690721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'837","last_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_deep_scrub":"29'837","last_deep_scrub_stamp":"2023-12-01T23:46:22.690602+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.690602+0000","objects_scrubbed":4,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:40:26.291990+0000","scrub_duration":0.015828854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":831,"num_write_kb":4563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"29'156","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:16.671461+0000","last_change":"2023-12-01T23:47:16.671482+0000","last_active":"2023-12-01T23:47:16.671461+0000","last_peered":"2023-12-01T23:47:16.671461+0000","last_clean":"2023-12-01T23:47:16.671461+0000","last_became_active":"2023-12-01T23:18:34.841161+0000","last_became_peered":"2023-12-01T23:18:34.841161+0000","last_unstale":"2023-12-01T23:47:16.671461+0000","last_undegraded":"2023-12-01T23:47:16.671461+0000","last_fullsized":"2023-12-01T23:47:16.671461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'156","last_scrub_stamp":"2023-12-01T23:47:16.671389+0000","last_deep_scrub":"29'156","last_deep_scrub_stamp":"2023-12-01T23:47:16.671389+0000","last_clean_scrub_stamp":"2023-12-01T23:47:16.671389+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:16:14.976368+0000","scrub_duration":0.0024249760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":12526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'34","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:24.557956+0000","last_change":"2023-12-01T23:46:24.557956+0000","last_active":"2023-12-01T23:46:24.557956+0000","last_peered":"2023-12-01T23:46:24.557956+0000","last_clean":"2023-12-01T23:46:24.557956+0000","last_became_active":"2023-12-01T23:18:28.875528+0000","last_became_peered":"2023-12-01T23:18:28.875528+0000","last_unstale":"2023-12-01T23:46:24.557956+0000","last_undegraded":"2023-12-01T23:46:24.557956+0000","last_fullsized":"2023-12-01T23:46:24.557956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-12-01T23:46:24.557856+0000","last_clean_scrub_stamp":"2023-12-01T23:46:24.557856+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:42.299451+0000","scrub_duration":0.0012882550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'697","reported_seq":737,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.664462+0000","last_change":"2023-12-01T23:46:28.664462+0000","last_active":"2023-12-01T23:46:28.664462+0000","last_peered":"2023-12-01T23:46:28.664462+0000","last_clean":"2023-12-01T23:46:28.664462+0000","last_became_active":"2023-12-01T23:18:27.887102+0000","last_became_peered":"2023-12-01T23:18:27.887102+0000","last_unstale":"2023-12-01T23:46:28.664462+0000","last_undegraded":"2023-12-01T23:46:28.664462+0000","last_fullsized":"2023-12-01T23:46:28.664462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'697","last_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_deep_scrub":"29'697","last_deep_scrub_stamp":"2023-12-01T23:46:28.664354+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.664354+0000","objects_scrubbed":2,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:29:54.783596+0000","scrub_duration":0.0041761050000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":694,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'157","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.689438+0000","last_change":"2023-12-01T23:46:55.689459+0000","last_active":"2023-12-01T23:46:55.689438+0000","last_peered":"2023-12-01T23:46:55.689438+0000","last_clean":"2023-12-01T23:46:55.689438+0000","last_became_active":"2023-12-01T23:18:34.789720+0000","last_became_peered":"2023-12-01T23:18:34.789720+0000","last_unstale":"2023-12-01T23:46:55.689438+0000","last_undegraded":"2023-12-01T23:46:55.689438+0000","last_fullsized":"2023-12-01T23:46:55.689438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'157","last_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_deep_scrub":"29'157","last_deep_scrub_stamp":"2023-12-01T23:46:55.689362+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.689362+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:36:58.512996+0000","scrub_duration":0.002487628,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":142,"num_write_kb":26084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"29'41","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.782497+0000","last_change":"2023-12-01T23:46:26.782497+0000","last_active":"2023-12-01T23:46:26.782497+0000","last_peered":"2023-12-01T23:46:26.782497+0000","last_clean":"2023-12-01T23:46:26.782497+0000","last_became_active":"2023-12-01T23:18:28.876985+0000","last_became_peered":"2023-12-01T23:18:28.876985+0000","last_unstale":"2023-12-01T23:46:26.782497+0000","last_undegraded":"2023-12-01T23:46:26.782497+0000","last_fullsized":"2023-12-01T23:46:26.782497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:26.782401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.782401+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:01:23.398097+0000","scrub_duration":0.0019853919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.366716+0000","last_change":"2023-12-01T23:46:36.366716+0000","last_active":"2023-12-01T23:46:36.366716+0000","last_peered":"2023-12-01T23:46:36.366716+0000","last_clean":"2023-12-01T23:46:36.366716+0000","last_became_active":"2023-12-01T23:18:27.892324+0000","last_became_peered":"2023-12-01T23:18:27.892324+0000","last_unstale":"2023-12-01T23:46:36.366716+0000","last_undegraded":"2023-12-01T23:46:36.366716+0000","last_fullsized":"2023-12-01T23:46:36.366716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:36.366584+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.366584+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:06:17.897390+0000","scrub_duration":0.0011632089999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'136","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:20.178438+0000","last_change":"2023-12-01T23:47:20.178461+0000","last_active":"2023-12-01T23:47:20.178438+0000","last_peered":"2023-12-01T23:47:20.178438+0000","last_clean":"2023-12-01T23:47:20.178438+0000","last_became_active":"2023-12-01T23:18:34.789845+0000","last_became_peered":"2023-12-01T23:18:34.789845+0000","last_unstale":"2023-12-01T23:47:20.178438+0000","last_undegraded":"2023-12-01T23:47:20.178438+0000","last_fullsized":"2023-12-01T23:47:20.178438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'136","last_scrub_stamp":"2023-12-01T23:47:20.178346+0000","last_deep_scrub":"29'136","last_deep_scrub_stamp":"2023-12-01T23:47:20.178346+0000","last_clean_scrub_stamp":"2023-12-01T23:47:20.178346+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:08:27.007884+0000","scrub_duration":0.0033497589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":9398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"29'41","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.338925+0000","last_change":"2023-12-01T23:46:28.338925+0000","last_active":"2023-12-01T23:46:28.338925+0000","last_peered":"2023-12-01T23:46:28.338925+0000","last_clean":"2023-12-01T23:46:28.338925+0000","last_became_active":"2023-12-01T23:18:28.876172+0000","last_became_peered":"2023-12-01T23:18:28.876172+0000","last_unstale":"2023-12-01T23:46:28.338925+0000","last_undegraded":"2023-12-01T23:46:28.338925+0000","last_fullsized":"2023-12-01T23:46:28.338925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-12-01T23:46:28.338785+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.338785+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:45:52.136028+0000","scrub_duration":0.0016464509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:35.654557+0000","last_change":"2023-12-01T23:46:35.654557+0000","last_active":"2023-12-01T23:46:35.654557+0000","last_peered":"2023-12-01T23:46:35.654557+0000","last_clean":"2023-12-01T23:46:35.654557+0000","last_became_active":"2023-12-01T23:18:27.897575+0000","last_became_peered":"2023-12-01T23:18:27.897575+0000","last_unstale":"2023-12-01T23:46:35.654557+0000","last_undegraded":"2023-12-01T23:46:35.654557+0000","last_fullsized":"2023-12-01T23:46:35.654557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-12-01T23:46:35.654472+0000","last_clean_scrub_stamp":"2023-12-01T23:46:35.654472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:04:47.022634+0000","scrub_duration":0.001093908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"29'165","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:11.073086+0000","last_change":"2023-12-01T23:47:11.073121+0000","last_active":"2023-12-01T23:47:11.073086+0000","last_peered":"2023-12-01T23:47:11.073086+0000","last_clean":"2023-12-01T23:47:11.073086+0000","last_became_active":"2023-12-01T23:18:34.791031+0000","last_became_peered":"2023-12-01T23:18:34.791031+0000","last_unstale":"2023-12-01T23:47:11.073086+0000","last_undegraded":"2023-12-01T23:47:11.073086+0000","last_fullsized":"2023-12-01T23:47:11.073086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'165","last_scrub_stamp":"2023-12-01T23:47:11.072989+0000","last_deep_scrub":"29'165","last_deep_scrub_stamp":"2023-12-01T23:47:11.072989+0000","last_clean_scrub_stamp":"2023-12-01T23:47:11.072989+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:57:06.840159+0000","scrub_duration":0.0026215549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":7666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"29'143","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:52.578493+0000","last_change":"2023-12-01T23:46:52.578528+0000","last_active":"2023-12-01T23:46:52.578493+0000","last_peered":"2023-12-01T23:46:52.578493+0000","last_clean":"2023-12-01T23:46:52.578493+0000","last_became_active":"2023-12-01T23:18:34.833853+0000","last_became_peered":"2023-12-01T23:18:34.833853+0000","last_unstale":"2023-12-01T23:46:52.578493+0000","last_undegraded":"2023-12-01T23:46:52.578493+0000","last_fullsized":"2023-12-01T23:46:52.578493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'143","last_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_deep_scrub":"29'143","last_deep_scrub_stamp":"2023-12-01T23:46:52.578401+0000","last_clean_scrub_stamp":"2023-12-01T23:46:52.578401+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:50.768577+0000","scrub_duration":0.0025899289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'43","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:53.575421+0000","last_change":"2023-12-01T23:46:53.575421+0000","last_active":"2023-12-01T23:46:53.575421+0000","last_peered":"2023-12-01T23:46:53.575421+0000","last_clean":"2023-12-01T23:46:53.575421+0000","last_became_active":"2023-12-01T23:19:06.056971+0000","last_became_peered":"2023-12-01T23:19:06.056971+0000","last_unstale":"2023-12-01T23:46:53.575421+0000","last_undegraded":"2023-12-01T23:46:53.575421+0000","last_fullsized":"2023-12-01T23:46:53.575421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:53.575336+0000","last_clean_scrub_stamp":"2023-12-01T23:46:53.575336+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:30:00.456637+0000","scrub_duration":0.001325278,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:33.355780+0000","last_change":"2023-12-01T23:46:33.355780+0000","last_active":"2023-12-01T23:46:33.355780+0000","last_peered":"2023-12-01T23:46:33.355780+0000","last_clean":"2023-12-01T23:46:33.355780+0000","last_became_active":"2023-12-01T23:18:27.886018+0000","last_became_peered":"2023-12-01T23:18:27.886018+0000","last_unstale":"2023-12-01T23:46:33.355780+0000","last_undegraded":"2023-12-01T23:46:33.355780+0000","last_fullsized":"2023-12-01T23:46:33.355780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2023-12-01T23:46:33.355695+0000","last_clean_scrub_stamp":"2023-12-01T23:46:33.355695+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:46:18.846237+0000","scrub_duration":0.001158233,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"29'139","reported_seq":176,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.677171+0000","last_change":"2023-12-01T23:47:00.677212+0000","last_active":"2023-12-01T23:47:00.677171+0000","last_peered":"2023-12-01T23:47:00.677171+0000","last_clean":"2023-12-01T23:47:00.677171+0000","last_became_active":"2023-12-01T23:18:34.830710+0000","last_became_peered":"2023-12-01T23:18:34.830710+0000","last_unstale":"2023-12-01T23:47:00.677171+0000","last_undegraded":"2023-12-01T23:47:00.677171+0000","last_fullsized":"2023-12-01T23:47:00.677171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'139","last_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_deep_scrub":"29'139","last_deep_scrub_stamp":"2023-12-01T23:47:00.677068+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.677068+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:15:58.982047+0000","scrub_duration":0.0026136110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":15232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:50.044143+0000","last_change":"2023-12-01T23:46:50.044143+0000","last_active":"2023-12-01T23:46:50.044143+0000","last_peered":"2023-12-01T23:46:50.044143+0000","last_clean":"2023-12-01T23:46:50.044143+0000","last_became_active":"2023-12-01T23:18:28.856944+0000","last_became_peered":"2023-12-01T23:18:28.856944+0000","last_unstale":"2023-12-01T23:46:50.044143+0000","last_undegraded":"2023-12-01T23:46:50.044143+0000","last_fullsized":"2023-12-01T23:46:50.044143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:50.044041+0000","last_clean_scrub_stamp":"2023-12-01T23:46:50.044041+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:15.451249+0000","scrub_duration":0.0013565980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:40.023249+0000","last_change":"2023-12-01T23:46:40.023249+0000","last_active":"2023-12-01T23:46:40.023249+0000","last_peered":"2023-12-01T23:46:40.023249+0000","last_clean":"2023-12-01T23:46:40.023249+0000","last_became_active":"2023-12-01T23:18:27.891729+0000","last_became_peered":"2023-12-01T23:18:27.891729+0000","last_unstale":"2023-12-01T23:46:40.023249+0000","last_undegraded":"2023-12-01T23:46:40.023249+0000","last_fullsized":"2023-12-01T23:46:40.023249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-12-01T23:46:40.023168+0000","last_clean_scrub_stamp":"2023-12-01T23:46:40.023168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:04:05.565732+0000","scrub_duration":0.0015748159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"29'688","reported_seq":727,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.712232+0000","last_change":"2023-12-01T23:46:26.712257+0000","last_active":"2023-12-01T23:46:26.712232+0000","last_peered":"2023-12-01T23:46:26.712232+0000","last_clean":"2023-12-01T23:46:26.712232+0000","last_became_active":"2023-12-01T23:18:27.894666+0000","last_became_peered":"2023-12-01T23:18:27.894666+0000","last_unstale":"2023-12-01T23:46:26.712232+0000","last_undegraded":"2023-12-01T23:46:26.712232+0000","last_fullsized":"2023-12-01T23:46:26.712232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'688","last_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_deep_scrub":"29'688","last_deep_scrub_stamp":"2023-12-01T23:46:26.712170+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.712170+0000","objects_scrubbed":1,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:56:40.675762+0000","scrub_duration":0.015526883,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":682,"num_write_kb":4444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:17.913858+0000","last_change":"2023-12-01T23:46:17.913876+0000","last_active":"2023-12-01T23:46:17.913858+0000","last_peered":"2023-12-01T23:46:17.913858+0000","last_clean":"2023-12-01T23:46:17.913858+0000","last_became_active":"2023-12-01T23:18:28.872073+0000","last_became_peered":"2023-12-01T23:18:28.872073+0000","last_unstale":"2023-12-01T23:46:17.913858+0000","last_undegraded":"2023-12-01T23:46:17.913858+0000","last_fullsized":"2023-12-01T23:46:17.913858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:17.913795+0000","last_clean_scrub_stamp":"2023-12-01T23:46:17.913795+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:26:35.764452+0000","scrub_duration":0.0020485220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'79","reported_seq":123,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.618263+0000","last_change":"2023-12-01T23:46:27.618286+0000","last_active":"2023-12-01T23:46:27.618263+0000","last_peered":"2023-12-01T23:46:27.618263+0000","last_clean":"2023-12-01T23:46:27.618263+0000","last_became_active":"2023-12-01T23:19:06.162596+0000","last_became_peered":"2023-12-01T23:19:06.162596+0000","last_unstale":"2023-12-01T23:46:27.618263+0000","last_undegraded":"2023-12-01T23:46:27.618263+0000","last_fullsized":"2023-12-01T23:46:27.618263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'79","last_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_deep_scrub":"29'79","last_deep_scrub_stamp":"2023-12-01T23:46:27.618173+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.618173+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:55:34.334662+0000","scrub_duration":0.002712112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'677","reported_seq":716,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:39.082022+0000","last_change":"2023-12-01T23:46:39.082058+0000","last_active":"2023-12-01T23:46:39.082022+0000","last_peered":"2023-12-01T23:46:39.082022+0000","last_clean":"2023-12-01T23:46:39.082022+0000","last_became_active":"2023-12-01T23:18:27.894400+0000","last_became_peered":"2023-12-01T23:18:27.894400+0000","last_unstale":"2023-12-01T23:46:39.082022+0000","last_undegraded":"2023-12-01T23:46:39.082022+0000","last_fullsized":"2023-12-01T23:46:39.082022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'677","last_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_deep_scrub":"29'677","last_deep_scrub_stamp":"2023-12-01T23:46:39.081954+0000","last_clean_scrub_stamp":"2023-12-01T23:46:39.081954+0000","objects_scrubbed":1,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:53:38.963801+0000","scrub_duration":0.018891622,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'32","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:22.563173+0000","last_change":"2023-12-01T23:46:22.563206+0000","last_active":"2023-12-01T23:46:22.563173+0000","last_peered":"2023-12-01T23:46:22.563173+0000","last_clean":"2023-12-01T23:46:22.563173+0000","last_became_active":"2023-12-01T23:18:28.875390+0000","last_became_peered":"2023-12-01T23:18:28.875390+0000","last_unstale":"2023-12-01T23:46:22.563173+0000","last_undegraded":"2023-12-01T23:46:22.563173+0000","last_fullsized":"2023-12-01T23:46:22.563173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-12-01T23:46:22.563080+0000","last_clean_scrub_stamp":"2023-12-01T23:46:22.563080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:36:56.997610+0000","scrub_duration":0.001814476,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'156","reported_seq":191,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:15.089056+0000","last_change":"2023-12-01T23:47:15.089077+0000","last_active":"2023-12-01T23:47:15.089056+0000","last_peered":"2023-12-01T23:47:15.089056+0000","last_clean":"2023-12-01T23:47:15.089056+0000","last_became_active":"2023-12-01T23:18:34.837952+0000","last_became_peered":"2023-12-01T23:18:34.837952+0000","last_unstale":"2023-12-01T23:47:15.089056+0000","last_undegraded":"2023-12-01T23:47:15.089056+0000","last_fullsized":"2023-12-01T23:47:15.089056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'156","last_scrub_stamp":"2023-12-01T23:47:15.088982+0000","last_deep_scrub":"29'156","last_deep_scrub_stamp":"2023-12-01T23:47:15.088982+0000","last_clean_scrub_stamp":"2023-12-01T23:47:15.088982+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:01:36.481668+0000","scrub_duration":0.0030626120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":14755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'50","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:46.826094+0000","last_change":"2023-12-01T23:46:46.826094+0000","last_active":"2023-12-01T23:46:46.826094+0000","last_peered":"2023-12-01T23:46:46.826094+0000","last_clean":"2023-12-01T23:46:46.826094+0000","last_became_active":"2023-12-01T23:18:28.870819+0000","last_became_peered":"2023-12-01T23:18:28.870819+0000","last_unstale":"2023-12-01T23:46:46.826094+0000","last_undegraded":"2023-12-01T23:46:46.826094+0000","last_fullsized":"2023-12-01T23:46:46.826094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'50","last_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_deep_scrub":"29'50","last_deep_scrub_stamp":"2023-12-01T23:46:46.826007+0000","last_clean_scrub_stamp":"2023-12-01T23:46:46.826007+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:54:22.515338+0000","scrub_duration":0.001437015,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"29'51","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.641284+0000","last_change":"2023-12-01T23:46:34.641284+0000","last_active":"2023-12-01T23:46:34.641284+0000","last_peered":"2023-12-01T23:46:34.641284+0000","last_clean":"2023-12-01T23:46:34.641284+0000","last_became_active":"2023-12-01T23:19:06.058505+0000","last_became_peered":"2023-12-01T23:19:06.058505+0000","last_unstale":"2023-12-01T23:46:34.641284+0000","last_undegraded":"2023-12-01T23:46:34.641284+0000","last_fullsized":"2023-12-01T23:46:34.641284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:34.641201+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.641201+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:52.382796+0000","scrub_duration":0.0012133529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"29'48","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:00.259785+0000","last_change":"2023-12-01T23:47:00.259785+0000","last_active":"2023-12-01T23:47:00.259785+0000","last_peered":"2023-12-01T23:47:00.259785+0000","last_clean":"2023-12-01T23:47:00.259785+0000","last_became_active":"2023-12-01T23:18:28.875024+0000","last_became_peered":"2023-12-01T23:18:28.875024+0000","last_unstale":"2023-12-01T23:47:00.259785+0000","last_undegraded":"2023-12-01T23:47:00.259785+0000","last_fullsized":"2023-12-01T23:47:00.259785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:47:00.259685+0000","last_clean_scrub_stamp":"2023-12-01T23:47:00.259685+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:11:58.449861+0000","scrub_duration":0.0017484359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"29'37","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:37.673877+0000","last_change":"2023-12-01T23:46:37.673877+0000","last_active":"2023-12-01T23:46:37.673877+0000","last_peered":"2023-12-01T23:46:37.673877+0000","last_clean":"2023-12-01T23:46:37.673877+0000","last_became_active":"2023-12-01T23:18:28.859360+0000","last_became_peered":"2023-12-01T23:18:28.859360+0000","last_unstale":"2023-12-01T23:46:37.673877+0000","last_undegraded":"2023-12-01T23:46:37.673877+0000","last_fullsized":"2023-12-01T23:46:37.673877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-12-01T23:46:37.673790+0000","last_clean_scrub_stamp":"2023-12-01T23:46:37.673790+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:09.493981+0000","scrub_duration":0.0014334879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"29'28","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:34.107049+0000","last_change":"2023-12-01T23:46:34.107049+0000","last_active":"2023-12-01T23:46:34.107049+0000","last_peered":"2023-12-01T23:46:34.107049+0000","last_clean":"2023-12-01T23:46:34.107049+0000","last_became_active":"2023-12-01T23:18:28.872707+0000","last_became_peered":"2023-12-01T23:18:28.872707+0000","last_unstale":"2023-12-01T23:46:34.107049+0000","last_undegraded":"2023-12-01T23:46:34.107049+0000","last_fullsized":"2023-12-01T23:46:34.107049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:34.106923+0000","last_clean_scrub_stamp":"2023-12-01T23:46:34.106923+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:14:29.317297+0000","scrub_duration":0.001525958,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:56.536617+0000","last_change":"2023-12-01T23:46:56.536637+0000","last_active":"2023-12-01T23:46:56.536617+0000","last_peered":"2023-12-01T23:46:56.536617+0000","last_clean":"2023-12-01T23:46:56.536617+0000","last_became_active":"2023-12-01T23:18:28.821622+0000","last_became_peered":"2023-12-01T23:18:28.821622+0000","last_unstale":"2023-12-01T23:46:56.536617+0000","last_undegraded":"2023-12-01T23:46:56.536617+0000","last_fullsized":"2023-12-01T23:46:56.536617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:56.536539+0000","last_clean_scrub_stamp":"2023-12-01T23:46:56.536539+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:15:59.378966+0000","scrub_duration":0.001488685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"29'46","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.689584+0000","last_change":"2023-12-01T23:46:42.689584+0000","last_active":"2023-12-01T23:46:42.689584+0000","last_peered":"2023-12-01T23:46:42.689584+0000","last_clean":"2023-12-01T23:46:42.689584+0000","last_became_active":"2023-12-01T23:18:28.863903+0000","last_became_peered":"2023-12-01T23:18:28.863903+0000","last_unstale":"2023-12-01T23:46:42.689584+0000","last_undegraded":"2023-12-01T23:46:42.689584+0000","last_fullsized":"2023-12-01T23:46:42.689584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2023-12-01T23:46:42.689499+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.689499+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:18:16.705098+0000","scrub_duration":0.0011022670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.047350+0000","last_change":"2023-12-01T23:46:26.047350+0000","last_active":"2023-12-01T23:46:26.047350+0000","last_peered":"2023-12-01T23:46:26.047350+0000","last_clean":"2023-12-01T23:46:26.047350+0000","last_became_active":"2023-12-01T23:18:28.871908+0000","last_became_peered":"2023-12-01T23:18:28.871908+0000","last_unstale":"2023-12-01T23:46:26.047350+0000","last_undegraded":"2023-12-01T23:46:26.047350+0000","last_fullsized":"2023-12-01T23:46:26.047350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:26.047200+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.047200+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T03:03:26.854020+0000","scrub_duration":0.0017362949999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'35","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.198415+0000","last_change":"2023-12-01T23:46:51.198438+0000","last_active":"2023-12-01T23:46:51.198415+0000","last_peered":"2023-12-01T23:46:51.198415+0000","last_clean":"2023-12-01T23:46:51.198415+0000","last_became_active":"2023-12-01T23:18:28.874305+0000","last_became_peered":"2023-12-01T23:18:28.874305+0000","last_unstale":"2023-12-01T23:46:51.198415+0000","last_undegraded":"2023-12-01T23:46:51.198415+0000","last_fullsized":"2023-12-01T23:46:51.198415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:46:51.198334+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.198334+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:15.700114+0000","scrub_duration":0.001943721,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"29'45","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.044035+0000","last_change":"2023-12-01T23:46:51.044035+0000","last_active":"2023-12-01T23:46:51.044035+0000","last_peered":"2023-12-01T23:46:51.044035+0000","last_clean":"2023-12-01T23:46:51.044035+0000","last_became_active":"2023-12-01T23:18:28.872155+0000","last_became_peered":"2023-12-01T23:18:28.872155+0000","last_unstale":"2023-12-01T23:46:51.044035+0000","last_undegraded":"2023-12-01T23:46:51.044035+0000","last_fullsized":"2023-12-01T23:46:51.044035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2023-12-01T23:46:51.043920+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.043920+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T11:14:36.778792+0000","scrub_duration":0.001802297,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"29'39","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:01.289932+0000","last_change":"2023-12-01T23:47:01.289932+0000","last_active":"2023-12-01T23:47:01.289932+0000","last_peered":"2023-12-01T23:47:01.289932+0000","last_clean":"2023-12-01T23:47:01.289932+0000","last_became_active":"2023-12-01T23:18:28.876714+0000","last_became_peered":"2023-12-01T23:18:28.876714+0000","last_unstale":"2023-12-01T23:47:01.289932+0000","last_undegraded":"2023-12-01T23:47:01.289932+0000","last_fullsized":"2023-12-01T23:47:01.289932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:47:01.289823+0000","last_clean_scrub_stamp":"2023-12-01T23:47:01.289823+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:15:15.160034+0000","scrub_duration":0.001556446,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"29'53","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:42.701183+0000","last_change":"2023-12-01T23:46:42.701183+0000","last_active":"2023-12-01T23:46:42.701183+0000","last_peered":"2023-12-01T23:46:42.701183+0000","last_clean":"2023-12-01T23:46:42.701183+0000","last_became_active":"2023-12-01T23:18:28.860872+0000","last_became_peered":"2023-12-01T23:18:28.860872+0000","last_unstale":"2023-12-01T23:46:42.701183+0000","last_undegraded":"2023-12-01T23:46:42.701183+0000","last_fullsized":"2023-12-01T23:46:42.701183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'53","last_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_deep_scrub":"29'53","last_deep_scrub_stamp":"2023-12-01T23:46:42.701106+0000","last_clean_scrub_stamp":"2023-12-01T23:46:42.701106+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:17:19.446451+0000","scrub_duration":0.001533106,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:36.628034+0000","last_change":"2023-12-01T23:46:36.628054+0000","last_active":"2023-12-01T23:46:36.628034+0000","last_peered":"2023-12-01T23:46:36.628034+0000","last_clean":"2023-12-01T23:46:36.628034+0000","last_became_active":"2023-12-01T23:18:28.872875+0000","last_became_peered":"2023-12-01T23:18:28.872875+0000","last_unstale":"2023-12-01T23:46:36.628034+0000","last_undegraded":"2023-12-01T23:46:36.628034+0000","last_fullsized":"2023-12-01T23:46:36.628034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:36.627948+0000","last_clean_scrub_stamp":"2023-12-01T23:46:36.627948+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T06:57:18.693485+0000","scrub_duration":0.001270539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"29'35","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:10.856204+0000","last_change":"2023-12-01T23:47:10.856223+0000","last_active":"2023-12-01T23:47:10.856204+0000","last_peered":"2023-12-01T23:47:10.856204+0000","last_clean":"2023-12-01T23:47:10.856204+0000","last_became_active":"2023-12-01T23:18:28.865056+0000","last_became_peered":"2023-12-01T23:18:28.865056+0000","last_unstale":"2023-12-01T23:47:10.856204+0000","last_undegraded":"2023-12-01T23:47:10.856204+0000","last_fullsized":"2023-12-01T23:47:10.856204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-12-01T23:47:10.856142+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-12-01T23:47:10.856142+0000","last_clean_scrub_stamp":"2023-12-01T23:47:10.856142+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:03:25.187506+0000","scrub_duration":0.0016634569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"29'48","reported_seq":86,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:26.608302+0000","last_change":"2023-12-01T23:46:26.608302+0000","last_active":"2023-12-01T23:46:26.608302+0000","last_peered":"2023-12-01T23:46:26.608302+0000","last_clean":"2023-12-01T23:46:26.608302+0000","last_became_active":"2023-12-01T23:18:28.872365+0000","last_became_peered":"2023-12-01T23:18:28.872365+0000","last_unstale":"2023-12-01T23:46:26.608302+0000","last_undegraded":"2023-12-01T23:46:26.608302+0000","last_fullsized":"2023-12-01T23:46:26.608302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-12-01T23:46:26.608209+0000","last_clean_scrub_stamp":"2023-12-01T23:46:26.608209+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T09:59:04.832666+0000","scrub_duration":0.001815189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:30.299426+0000","last_change":"2023-12-01T23:46:30.299447+0000","last_active":"2023-12-01T23:46:30.299426+0000","last_peered":"2023-12-01T23:46:30.299426+0000","last_clean":"2023-12-01T23:46:30.299426+0000","last_became_active":"2023-12-01T23:18:28.875613+0000","last_became_peered":"2023-12-01T23:18:28.875613+0000","last_unstale":"2023-12-01T23:46:30.299426+0000","last_undegraded":"2023-12-01T23:46:30.299426+0000","last_fullsized":"2023-12-01T23:46:30.299426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:30.299352+0000","last_clean_scrub_stamp":"2023-12-01T23:46:30.299352+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:55.857362+0000","scrub_duration":0.0016640419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"29'44","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:58.248304+0000","last_change":"2023-12-01T23:46:58.248328+0000","last_active":"2023-12-01T23:46:58.248304+0000","last_peered":"2023-12-01T23:46:58.248304+0000","last_clean":"2023-12-01T23:46:58.248304+0000","last_became_active":"2023-12-01T23:18:28.874729+0000","last_became_peered":"2023-12-01T23:18:28.874729+0000","last_unstale":"2023-12-01T23:46:58.248304+0000","last_undegraded":"2023-12-01T23:46:58.248304+0000","last_fullsized":"2023-12-01T23:46:58.248304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:58.248217+0000","last_clean_scrub_stamp":"2023-12-01T23:46:58.248217+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:54:55.631573+0000","scrub_duration":0.001664198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"29'43","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.573753+0000","last_change":"2023-12-01T23:46:55.573772+0000","last_active":"2023-12-01T23:46:55.573753+0000","last_peered":"2023-12-01T23:46:55.573753+0000","last_clean":"2023-12-01T23:46:55.573753+0000","last_became_active":"2023-12-01T23:18:28.870877+0000","last_became_peered":"2023-12-01T23:18:28.870877+0000","last_unstale":"2023-12-01T23:46:55.573753+0000","last_undegraded":"2023-12-01T23:46:55.573753+0000","last_fullsized":"2023-12-01T23:46:55.573753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-12-01T23:46:55.573678+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.573678+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:10:00.619061+0000","scrub_duration":0.0017204410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"29'39","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:25.804111+0000","last_change":"2023-12-01T23:46:25.804111+0000","last_active":"2023-12-01T23:46:25.804111+0000","last_peered":"2023-12-01T23:46:25.804111+0000","last_clean":"2023-12-01T23:46:25.804111+0000","last_became_active":"2023-12-01T23:18:28.854529+0000","last_became_peered":"2023-12-01T23:18:28.854529+0000","last_unstale":"2023-12-01T23:46:25.804111+0000","last_undegraded":"2023-12-01T23:46:25.804111+0000","last_fullsized":"2023-12-01T23:46:25.804111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:25.804022+0000","last_clean_scrub_stamp":"2023-12-01T23:46:25.804022+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:06:51.362032+0000","scrub_duration":0.0012177780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"29'36","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:20.914819+0000","last_change":"2023-12-01T23:46:20.914819+0000","last_active":"2023-12-01T23:46:20.914819+0000","last_peered":"2023-12-01T23:46:20.914819+0000","last_clean":"2023-12-01T23:46:20.914819+0000","last_became_active":"2023-12-01T23:18:28.871022+0000","last_became_peered":"2023-12-01T23:18:28.871022+0000","last_unstale":"2023-12-01T23:46:20.914819+0000","last_undegraded":"2023-12-01T23:46:20.914819+0000","last_fullsized":"2023-12-01T23:46:20.914819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:20.914690+0000","last_clean_scrub_stamp":"2023-12-01T23:46:20.914690+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T10:53:47.420005+0000","scrub_duration":0.00189442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:27.574967+0000","last_change":"2023-12-01T23:46:27.574967+0000","last_active":"2023-12-01T23:46:27.574967+0000","last_peered":"2023-12-01T23:46:27.574967+0000","last_clean":"2023-12-01T23:46:27.574967+0000","last_became_active":"2023-12-01T23:18:28.880161+0000","last_became_peered":"2023-12-01T23:18:28.880161+0000","last_unstale":"2023-12-01T23:46:27.574967+0000","last_undegraded":"2023-12-01T23:46:27.574967+0000","last_fullsized":"2023-12-01T23:46:27.574967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:27.574851+0000","last_clean_scrub_stamp":"2023-12-01T23:46:27.574851+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:21:54.288208+0000","scrub_duration":0.0016018880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"29'40","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:43.714964+0000","last_change":"2023-12-01T23:46:43.714964+0000","last_active":"2023-12-01T23:46:43.714964+0000","last_peered":"2023-12-01T23:46:43.714964+0000","last_clean":"2023-12-01T23:46:43.714964+0000","last_became_active":"2023-12-01T23:18:28.876877+0000","last_became_peered":"2023-12-01T23:18:28.876877+0000","last_unstale":"2023-12-01T23:46:43.714964+0000","last_undegraded":"2023-12-01T23:46:43.714964+0000","last_fullsized":"2023-12-01T23:46:43.714964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2023-12-01T23:46:43.714833+0000","last_clean_scrub_stamp":"2023-12-01T23:46:43.714833+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:20:47.722456+0000","scrub_duration":0.0012353959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"29'51","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:47.793414+0000","last_change":"2023-12-01T23:46:47.793414+0000","last_active":"2023-12-01T23:46:47.793414+0000","last_peered":"2023-12-01T23:46:47.793414+0000","last_clean":"2023-12-01T23:46:47.793414+0000","last_became_active":"2023-12-01T23:18:28.877838+0000","last_became_peered":"2023-12-01T23:18:28.877838+0000","last_unstale":"2023-12-01T23:46:47.793414+0000","last_undegraded":"2023-12-01T23:46:47.793414+0000","last_fullsized":"2023-12-01T23:46:47.793414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2023-12-01T23:46:47.793300+0000","last_clean_scrub_stamp":"2023-12-01T23:46:47.793300+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:09:52.838684+0000","scrub_duration":0.0014654469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"29'42","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:05.856110+0000","last_change":"2023-12-01T23:47:05.856110+0000","last_active":"2023-12-01T23:47:05.856110+0000","last_peered":"2023-12-01T23:47:05.856110+0000","last_clean":"2023-12-01T23:47:05.856110+0000","last_became_active":"2023-12-01T23:18:28.877855+0000","last_became_peered":"2023-12-01T23:18:28.877855+0000","last_unstale":"2023-12-01T23:47:05.856110+0000","last_undegraded":"2023-12-01T23:47:05.856110+0000","last_fullsized":"2023-12-01T23:47:05.856110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-12-01T23:47:05.856011+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-12-01T23:47:05.856011+0000","last_clean_scrub_stamp":"2023-12-01T23:47:05.856011+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:15:19.726222+0000","scrub_duration":0.0016672989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:41.992196+0000","last_change":"2023-12-01T23:46:41.992215+0000","last_active":"2023-12-01T23:46:41.992196+0000","last_peered":"2023-12-01T23:46:41.992196+0000","last_clean":"2023-12-01T23:46:41.992196+0000","last_became_active":"2023-12-01T23:18:28.876643+0000","last_became_peered":"2023-12-01T23:18:28.876643+0000","last_unstale":"2023-12-01T23:46:41.992196+0000","last_undegraded":"2023-12-01T23:46:41.992196+0000","last_fullsized":"2023-12-01T23:46:41.992196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-12-01T23:46:41.992130+0000","last_clean_scrub_stamp":"2023-12-01T23:46:41.992130+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:15:06.493909+0000","scrub_duration":0.001678983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:51.919845+0000","last_change":"2023-12-01T23:46:51.919900+0000","last_active":"2023-12-01T23:46:51.919845+0000","last_peered":"2023-12-01T23:46:51.919845+0000","last_clean":"2023-12-01T23:46:51.919845+0000","last_became_active":"2023-12-01T23:18:28.856887+0000","last_became_peered":"2023-12-01T23:18:28.856887+0000","last_unstale":"2023-12-01T23:46:51.919845+0000","last_undegraded":"2023-12-01T23:46:51.919845+0000","last_fullsized":"2023-12-01T23:46:51.919845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:51.919767+0000","last_clean_scrub_stamp":"2023-12-01T23:46:51.919767+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T08:10:23.739958+0000","scrub_duration":0.001832024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"29'38","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:47:02.280960+0000","last_change":"2023-12-01T23:47:02.280989+0000","last_active":"2023-12-01T23:47:02.280960+0000","last_peered":"2023-12-01T23:47:02.280960+0000","last_clean":"2023-12-01T23:47:02.280960+0000","last_became_active":"2023-12-01T23:18:28.875969+0000","last_became_peered":"2023-12-01T23:18:28.875969+0000","last_unstale":"2023-12-01T23:47:02.280960+0000","last_undegraded":"2023-12-01T23:47:02.280960+0000","last_fullsized":"2023-12-01T23:47:02.280960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-12-01T23:47:02.280885+0000","last_clean_scrub_stamp":"2023-12-01T23:47:02.280885+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T04:52:59.819161+0000","scrub_duration":0.001839079,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'39","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:28.021716+0000","last_change":"2023-12-01T23:46:28.021737+0000","last_active":"2023-12-01T23:46:28.021716+0000","last_peered":"2023-12-01T23:46:28.021716+0000","last_clean":"2023-12-01T23:46:28.021716+0000","last_became_active":"2023-12-01T23:18:28.864952+0000","last_became_peered":"2023-12-01T23:18:28.864952+0000","last_unstale":"2023-12-01T23:46:28.021716+0000","last_undegraded":"2023-12-01T23:46:28.021716+0000","last_fullsized":"2023-12-01T23:46:28.021716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-12-01T23:46:28.021656+0000","last_clean_scrub_stamp":"2023-12-01T23:46:28.021656+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T01:08:59.781744+0000","scrub_duration":0.0016958609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"29'25","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:55.188263+0000","last_change":"2023-12-01T23:46:55.188286+0000","last_active":"2023-12-01T23:46:55.188263+0000","last_peered":"2023-12-01T23:46:55.188263+0000","last_clean":"2023-12-01T23:46:55.188263+0000","last_became_active":"2023-12-01T23:18:28.874347+0000","last_became_peered":"2023-12-01T23:18:28.874347+0000","last_unstale":"2023-12-01T23:46:55.188263+0000","last_undegraded":"2023-12-01T23:46:55.188263+0000","last_fullsized":"2023-12-01T23:46:55.188263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-12-01T23:46:55.188182+0000","last_clean_scrub_stamp":"2023-12-01T23:46:55.188182+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T07:32:56.798147+0000","scrub_duration":0.0018947809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"29'44","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:29.768119+0000","last_change":"2023-12-01T23:46:29.768119+0000","last_active":"2023-12-01T23:46:29.768119+0000","last_peered":"2023-12-01T23:46:29.768119+0000","last_clean":"2023-12-01T23:46:29.768119+0000","last_became_active":"2023-12-01T23:18:28.865015+0000","last_became_peered":"2023-12-01T23:18:28.865015+0000","last_unstale":"2023-12-01T23:46:29.768119+0000","last_undegraded":"2023-12-01T23:46:29.768119+0000","last_fullsized":"2023-12-01T23:46:29.768119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-12-01T23:46:29.768031+0000","last_clean_scrub_stamp":"2023-12-01T23:46:29.768031+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T00:31:37.675393+0000","scrub_duration":0.001232375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"29'36","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:18.750868+0000","last_change":"2023-12-01T23:46:18.750868+0000","last_active":"2023-12-01T23:46:18.750868+0000","last_peered":"2023-12-01T23:46:18.750868+0000","last_clean":"2023-12-01T23:46:18.750868+0000","last_became_active":"2023-12-01T23:18:28.854562+0000","last_became_peered":"2023-12-01T23:18:28.854562+0000","last_unstale":"2023-12-01T23:46:18.750868+0000","last_undegraded":"2023-12-01T23:46:18.750868+0000","last_fullsized":"2023-12-01T23:46:18.750868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-12-01T23:46:18.750724+0000","last_clean_scrub_stamp":"2023-12-01T23:46:18.750724+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T02:56:36.492319+0000","scrub_duration":0.001499631,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"29'28","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-12-01T23:46:59.812108+0000","last_change":"2023-12-01T23:46:59.812108+0000","last_active":"2023-12-01T23:46:59.812108+0000","last_peered":"2023-12-01T23:46:59.812108+0000","last_clean":"2023-12-01T23:46:59.812108+0000","last_became_active":"2023-12-01T23:18:28.874958+0000","last_became_peered":"2023-12-01T23:18:28.874958+0000","last_unstale":"2023-12-01T23:46:59.812108+0000","last_undegraded":"2023-12-01T23:46:59.812108+0000","last_fullsized":"2023-12-01T23:46:59.812108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-12-01T23:46:59.812008+0000","last_clean_scrub_stamp":"2023-12-01T23:46:59.812008+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-03T05:32:25.219215+0000","scrub_duration":0.0022375279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4128,"num_write_kb":324367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2446,"ondisk_log_size":2446,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":40579678,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":1030,"num_read_kb":1092,"num_write":8880,"num_write_kb":44960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":55844864,"data_stored":81159356,"data_compressed":7679572,"data_compressed_allocated":12099584,"data_compressed_original":37478400,"omap_allocated":0,"internal_metadata":0},"log_size":8445,"ondisk_log_size":8445,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64792,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509798,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62108,"kb_used_data":17044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94309732,"statfs":{"total":96636764160,"available":96573165568,"internally_reserved":0,"allocated":17453056,"data_stored":25883340,"data_compressed":2464391,"data_compressed_allocated":3854336,"data_compressed_original":12472320,"omap_allocated":1588,"internal_metadata":46135756},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.434,"15min":0.41399999999999998},"min":{"1min":0.34499999999999997,"5min":0.23899999999999999,"15min":0.23699999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63700000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42999999999999999,"15min":0.42099999999999999},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.55000000000000004}]},{"osd":1,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.33400000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.66800000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.433,"15min":0.41999999999999998},"min":{"1min":0.26400000000000001,"5min":0.26200000000000001,"15min":0.217},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.33400000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.45000000000000001,"15min":0.434},"min":{"1min":0.317,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.439,"15min":0.42199999999999999},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.25900000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.45500000000000002},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.28299999999999997},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.59299999999999997},"last":0.373},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.376,"15min":0.37},"min":{"1min":0.26700000000000002,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.39800000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.255,"5min":0.255,"15min":0.23000000000000001},"max":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.64400000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.41699999999999998,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.45100000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:47:08 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.435,"15min":0.434},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28100000000000003},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.42599999999999999},"min":{"1min":0.32800000000000001,"5min":0.27400000000000002,"15min":0.27300000000000002},"max":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.71399999999999997},"last":0.49299999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509799,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":126656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45000000000000001,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.20999999999999999},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.68700000000000006},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.43099999999999999},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46600000000000003,"15min":0.441},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.439,"15min":0.42899999999999999},"min":{"1min":0.38200000000000001,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.29399999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.44800000000000001},"min":{"1min":0.31900000000000001,"5min":0.28799999999999998,"15min":0.26500000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.45000000000000001,"15min":0.42999999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.32300000000000001}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45900000000000002,"15min":0.45400000000000001},"min":{"1min":0.36199999999999999,"5min":0.29899999999999999,"15min":0.29599999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.253,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.434},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.41399999999999998,"15min":0.40100000000000002},"min":{"1min":0.27200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.32500000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.73199999999999998},"last":0.374},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42399999999999999},"min":{"1min":0.30399999999999999,"5min":0.26600000000000001,"15min":0.23999999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33700000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.314,"5min":0.245,"15min":0.23300000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.45700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509798,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58920,"kb_used_data":9696,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94312920,"statfs":{"total":96636764160,"available":96576430080,"internally_reserved":0,"allocated":9928704,"data_stored":12933475,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":1591,"internal_metadata":50395593},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.316,"15min":0.29999999999999999},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.16500000000000001},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.29999999999999999},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.189},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.312,"15min":0.30099999999999999},"min":{"1min":0.23499999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.48399999999999999,"5min":0.52200000000000002,"15min":0.56599999999999995},"last":0.37},{"interface":"front","average":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.216},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34100000000000003,"15min":0.33400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23999999999999999,"15min":0.23000000000000001},"max":{"1min":0.57199999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.36699999999999999},"min":{"1min":0.28899999999999998,"5min":0.245,"15min":0.20899999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.437,"15min":0.42299999999999999},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.23599999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.46400000000000002,"15min":0.437},"min":{"1min":0.36399999999999999,"5min":0.32000000000000001,"15min":0.28999999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.443}]},{"osd":5,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.436},"min":{"1min":0.35599999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.49299999999999999,"15min":0.46999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35399999999999998,"15min":0.30599999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.498,"15min":0.47599999999999998},"min":{"1min":0.432,"5min":0.33600000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.46999999999999997,"15min":0.45800000000000002},"min":{"1min":0.38200000000000001,"5min":0.33200000000000002,"15min":0.32300000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.46500000000000002},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.30599999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.49199999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509799,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60564,"kb_used_data":7180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311276,"statfs":{"total":96636764160,"available":96574746624,"internally_reserved":0,"allocated":7352320,"data_stored":11712327,"data_compressed":1195206,"data_compressed_allocated":1781760,"data_compressed_original":6340608,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.29099999999999998,"15min":0.29499999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.71299999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.16600000000000001},"max":{"1min":0.501,"5min":0.51000000000000001,"15min":0.55800000000000005},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32900000000000001,"15min":0.33400000000000002},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.186},"max":{"1min":0.48999999999999999,"5min":0.53400000000000003,"15min":0.76900000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.32000000000000001,"15min":0.32600000000000001},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.20899999999999999},"max":{"1min":0.503,"5min":0.50700000000000001,"15min":0.79200000000000004},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.32500000000000001,"15min":0.32600000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20599999999999999},"max":{"1min":0.52000000000000002,"5min":0.54300000000000004,"15min":0.621},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.36299999999999999},"min":{"1min":0.29599999999999999,"5min":0.25700000000000001,"15min":0.22600000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.61499999999999999},"last":0.628}]},{"osd":4,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.33200000000000002,"5min":0.29199999999999998,"15min":0.28100000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.36199999999999999,"5min":0.33600000000000002,"15min":0.32900000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.46000000000000002,"15min":0.45000000000000001},"min":{"1min":0.38200000000000001,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.442,"15min":0.434},"min":{"1min":0.37,"5min":0.317,"15min":0.317},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.29799999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47499999999999998,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Dec 1 23:47:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.47899999999999998,"15min":0.47599999999999998},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.47299999999999998,"15min":0.46000000000000002},"min":{"1min":0.41299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.749}]}]},{"osd":6,"up_from":14,"seq":60129542502,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56904,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314936,"statfs":{"total":96636764160,"available":96578494464,"internally_reserved":0,"allocated":12124160,"data_stored":16904454,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.45200000000000001,"15min":0.42599999999999999},"min":{"1min":0.35799999999999998,"5min":0.217,"15min":0.19600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.48199999999999998,"15min":0.45200000000000001},"min":{"1min":0.41299999999999998,"5min":0.29299999999999998,"15min":0.255},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.434,"15min":0.40400000000000003},"min":{"1min":0.34899999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.71199999999999997},"last":0.372},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.435,"15min":0.42399999999999999},"min":{"1min":0.29499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60899999999999999,"5min":0.62,"15min":0.70299999999999996},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.22},"max":{"1min":0.59299999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.45100000000000001,"15min":0.42499999999999999},"min":{"1min":0.36499999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.438},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.27300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.439},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.40200000000000002,"5min":0.35499999999999998,"15min":0.33800000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23300000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.67500000000000004},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.372},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.23999999999999999},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33600000000000002}]},{"osd":5,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.39700000000000002,"15min":0.38600000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23599999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.74199999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Dec 1 23:47:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.28999999999999998,"5min":0.254,"15min":0.249},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.498},{"interface":"front","average":{"1min":0.442,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.29999999999999999,"5min":0.28799999999999998,"15min":0.249},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.77100000000000002},"last":0.45600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542502,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65176,"kb_used_data":7632,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306664,"statfs":{"total":96636764160,"available":96570023936,"internally_reserved":0,"allocated":7815168,"data_stored":11121447,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.43099999999999999,"15min":0.40999999999999998},"min":{"1min":0.26400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.42699999999999999,"15min":0.41399999999999998},"min":{"1min":0.31,"5min":0.23699999999999999,"15min":0.22900000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.45600000000000002,"15min":0.42699999999999999},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.23300000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.42299999999999999,"15min":0.41199999999999998},"min":{"1min":0.39600000000000002,"5min":0.23999999999999999,"15min":0.219},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.437,"15min":0.42199999999999999},"min":{"1min":0.32000000000000001,"5min":0.27100000000000002,"15min":0.26800000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.40200000000000002},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.252},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.627}]},{"osd":3,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.46000000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.24299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.44800000000000001},"min":{"1min":0.377,"5min":0.30399999999999999,"15min":0.27000000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.216},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.376,"15min":0.371},"min":{"1min":0.29899999999999999,"5min":0.23999999999999999,"15min":0.22900000000000001},"max":{"1min":0.67000000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.39600000000000002},"min":{"1min":0.29399999999999998,"5min":0.248,"15min":0.245},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.504},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Dec 1 23:47:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.434,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.40799999999999997},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.25800000000000001},"max":{"1min":0.625,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.56999999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542503,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31696,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340144,"statfs":{"total":96636764160,"available":96604307456,"internally_reserved":0,"allocated":532480,"data_stored":349891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.311,"15min":0.29999999999999999},"min":{"1min":0.23799999999999999,"5min":0.187,"15min":0.17799999999999999},"max":{"1min":0.54700000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.32900000000000001,"15min":0.316},"min":{"1min":0.27400000000000002,"5min":0.19700000000000001,"15min":0.19400000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.66400000000000003},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35199999999999998,"15min":0.33800000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.57599999999999996,"15min":0.59099999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.309,"15min":0.30499999999999999},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46300000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.23300000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.57299999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.30399999999999999,"5min":0.252,"15min":0.214},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.624},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.35999999999999999,"5min":0.29799999999999999,"15min":0.26600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.46100000000000002,"15min":0.44},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.315},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.70899999999999996},"last":0.755}]},{"osd":5,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.442,"15min":0.439},"min":{"1min":0.371,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29899999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.33000000000000002,"5min":0.317,"15min":0.307},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.46899999999999997,"15min":0.46400000000000002},"min":{"1min":0.39700000000000002,"5min":0.33100000000000002,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Dec 1 23:47:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.46899999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.317},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.47499999999999998,"15min":0.46600000000000003},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.83399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575206,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42344,"kb_used_data":2848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329496,"statfs":{"total":96636764160,"available":96593403904,"internally_reserved":0,"allocated":2916352,"data_stored":4321030,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.28599999999999998,"15min":0.28299999999999997},"min":{"1min":0.217,"5min":0.188,"15min":0.16400000000000001},"max":{"1min":0.41399999999999998,"5min":0.47299999999999998,"15min":0.623},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.316,"15min":0.311},"min":{"1min":0.215,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.64800000000000002},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.316,"15min":0.30399999999999999},"min":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.19600000000000001},"max":{"1min":0.48199999999999998,"5min":0.496,"15min":0.63400000000000001},"last":0.309},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.32800000000000001},"min":{"1min":0.254,"5min":0.23699999999999999,"15min":0.22500000000000001},"max":{"1min":0.41499999999999998,"5min":0.56100000000000005,"15min":0.61099999999999999},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.255,"5min":0.224,"15min":0.224},"max":{"1min":0.46100000000000002,"5min":0.56499999999999995,"15min":0.59499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.33700000000000002,"15min":0.33600000000000002},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.22900000000000001},"max":{"1min":0.46000000000000002,"5min":0.55100000000000005,"15min":0.55500000000000005},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.41699999999999998},"min":{"1min":0.36299999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.433,"15min":0.41799999999999998},"min":{"1min":0.33900000000000002,"5min":0.312,"15min":0.28499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.45300000000000001,"15min":0.443},"min":{"1min":0.316,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70999999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.46200000000000002,"15min":0.44900000000000001},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.75}]},{"osd":6,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.35999999999999999,"5min":0.33300000000000002,"15min":0.315},"max":{"1min":0.69199999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.46500000000000002,"15min":0.46000000000000002},"min":{"1min":0.38900000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Dec 1 23:46:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.47699999999999998,"15min":0.46200000000000002},"min":{"1min":0.41699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.745},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.40300000000000002,"5min":0.36199999999999999,"15min":0.35199999999999998},"max":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55700000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32396,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6979584,"data_stored":10995393,"data_compressed":1162810,"data_compressed_allocated":1736704,"data_compressed_original":5767168,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2609152,"data_stored":4194464,"data_compressed":521441,"data_compressed_allocated":786432,"data_compressed_original":2379776,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":223325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9621504,"data_stored":12806909,"data_compressed":1001457,"data_compressed_allocated":1675264,"data_compressed_original":4870144,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7507968,"data_stored":10994881,"data_compressed":1101703,"data_compressed_allocated":1740800,"data_compressed_original":5242880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11816960,"data_stored":16777888,"data_compressed":1460166,"data_compressed_allocated":2351104,"data_compressed_original":7319552,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17080320,"data_stored":25166406,"data_compressed":2431995,"data_compressed_allocated":3809280,"data_compressed_original":11898880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T23:47:46.094 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-01T23:47:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.224+0000 7f18996e1640 1 Processor -- start 2023-12-01T23:47:46.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.224+0000 7f18996e1640 1 -- start start 2023-12-01T23:47:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18996e1640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f18940710e0 0x7f1894153380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18996e1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940c7700 0x7f18941538c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18996e1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940ca6c0 con 0x7f1894070d00 2023-12-01T23:47:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18996e1640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1894159880 con 0x7f18940710e0 2023-12-01T23:47:46.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18996e1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894159b60 con 0x7f18940c7700 2023-12-01T23:47:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.225+0000 7f18927fc640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f18940710e0 0x7f1894153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.226+0000 7f18937fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940c7700 0x7f18941538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.226+0000 7f1892ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1894070d00 0x7f189415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:59028/0 (socket says 172.21.15.96:59028) 2023-12-01T23:47:46.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.226+0000 7f1892ffd640 1 -- 172.21.15.96:0/2022356961 learned_addr learned my addr 172.21.15.96:0/2022356961 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:47:46.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.227+0000 7f1891ffb640 1 -- 172.21.15.96:0/2022356961 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673652161 0 0) 0x7f18940ca6c0 con 0x7f1894070d00 2023-12-01T23:47:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.228+0000 7f1891ffb640 1 -- 172.21.15.96:0/2022356961 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187c003520 con 0x7f1894070d00 2023-12-01T23:47:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.228+0000 7f18927fc640 1 -- 172.21.15.96:0/2022356961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940c7700 msgr2=0x7f18941538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.228+0000 7f18927fc640 1 --2- 172.21.15.96:0/2022356961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940c7700 0x7f18941538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.228+0000 7f18927fc640 1 -- 172.21.15.96:0/2022356961 >> v1:172.21.15.102:6789/0 conn(0x7f1894070d00 legacy=0x7f189415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.228+0000 7f18927fc640 1 -- 172.21.15.96:0/2022356961 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894159e40 con 0x7f18940710e0 2023-12-01T23:47:46.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.230+0000 7f18927fc640 1 --2- 172.21.15.96:0/2022356961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18940710e0 0x7f1894153380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18840097a0 tx=0x7f188402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f69e6eda5caa7cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:46.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.233+0000 7f1891ffb640 1 -- 172.21.15.96:0/2022356961 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884030610 con 0x7f18940710e0 2023-12-01T23:47:46.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.233+0000 7f1891ffb640 1 -- 172.21.15.96:0/2022356961 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1884030770 con 0x7f18940710e0 2023-12-01T23:47:46.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.233+0000 7f1891ffb640 1 -- 172.21.15.96:0/2022356961 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884030b00 con 0x7f18940710e0 2023-12-01T23:47:46.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 -- 172.21.15.96:0/2022356961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18940710e0 msgr2=0x7f1894153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 --2- 172.21.15.96:0/2022356961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18940710e0 0x7f1894153380 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f18840097a0 tx=0x7f188402b960 comp rx=0 tx=0).stop 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 -- 172.21.15.96:0/2022356961 shutdown_connections 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 --2- 172.21.15.96:0/2022356961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940c7700 0x7f18941538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 --2- 172.21.15.96:0/2022356961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18940710e0 0x7f1894153380 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 -- 172.21.15.96:0/2022356961 >> 172.21.15.96:0/2022356961 conn(0x7f189406ab30 msgr2=0x7f189406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 -- 172.21.15.96:0/2022356961 shutdown_connections 2023-12-01T23:47:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.234+0000 7f18996e1640 1 -- 172.21.15.96:0/2022356961 wait complete. 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.235+0000 7f18996e1640 1 Processor -- start 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.235+0000 7f18996e1640 1 -- start start 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940710e0 0x7f189415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18940c7700 0x7f1894150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894150730 con 0x7f1894070d00 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894150100 con 0x7f18940c7700 2023-12-01T23:47:46.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.236+0000 7f18996e1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18941ef870 con 0x7f18940710e0 2023-12-01T23:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.237+0000 7f1892ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.237+0000 7f18937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18940c7700 0x7f1894150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.237+0000 7f18927fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940710e0 0x7f189415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.237+0000 7f1892ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55764/0 (socket says 172.21.15.96:55764) 2023-12-01T23:47:46.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.237+0000 7f1892ffd640 1 -- 172.21.15.96:0/3384737708 learned_addr learned my addr 172.21.15.96:0/3384737708 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:46.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.240+0000 7f1892ffd640 1 -- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940710e0 msgr2=0x7f189415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.240+0000 7f1892ffd640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940710e0 0x7f189415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.240+0000 7f1892ffd640 1 -- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18940c7700 msgr2=0x7f1894150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.240+0000 7f1892ffd640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18940c7700 0x7f1894150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.240+0000 7f1892ffd640 1 -- 172.21.15.96:0/3384737708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009400 con 0x7f1894070d00 2023-12-01T23:47:46.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.242+0000 7f1892ffd640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f188800c430 tx=0x7f188800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.246+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888005ce0 con 0x7f1894070d00 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.246+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888005e40 con 0x7f1894070d00 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.246+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18941efb00 con 0x7f1894070d00 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.246+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880072f0 con 0x7f1894070d00 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.246+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18941f00c0 con 0x7f1894070d00 2023-12-01T23:47:46.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.247+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18941509a0 con 0x7f1894070d00 2023-12-01T23:47:46.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.485+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1888007450 con 0x7f1894070d00 2023-12-01T23:47:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.486+0000 7f187b7fe640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 0x7f188006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.486+0000 7f18927fc640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 0x7f188006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.486+0000 7f18927fc640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 0x7f188006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1884036000 tx=0x7f1884008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:46.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.498+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1888057eb0 con 0x7f1894070d00 2023-12-01T23:47:46.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.498+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18880541f0 con 0x7f1894070d00 2023-12-01T23:47:46.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.677+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1894067500 con 0x7f1894070d00 2023-12-01T23:47:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.784+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1888017020 con 0x7f1894070d00 2023-12-01T23:47:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.784+0000 7f187b7fe640 1 -- 172.21.15.96:0/3384737708 <== mon.0 v2:172.21.15.96:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f18880541f0 con 0x7f1894070d00 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 msgr2=0x7f188006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 0x7f188006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1884036000 tx=0x7f1884008030 comp rx=0 tx=0).stop 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 msgr2=0x7f18941ef330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f188800c430 tx=0x7f188800c8f0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 shutdown_connections 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f188006ae40 0x7f188006d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18940c7700 0x7f1894150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18940710e0 0x7f189415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 --2- 172.21.15.96:0/3384737708 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1894070d00 0x7f18941ef330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 >> 172.21.15.96:0/3384737708 conn(0x7f189406ab30 msgr2=0x7f18941e2440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 shutdown_connections 2023-12-01T23:47:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.786+0000 7f18996e1640 1 -- 172.21.15.96:0/3384737708 wait complete. 2023-12-01T23:47:46.799 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-01T23:47:46.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:47:46.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.903+0000 7fb27be7c640 1 Processor -- start 2023-12-01T23:47:46.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.903+0000 7fb27be7c640 1 -- start start 2023-12-01T23:47:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb27be7c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 0x7fb274070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb27be7c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 0x7fb274159b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb27be7c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb274071420 con 0x7fb27414fd70 2023-12-01T23:47:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb27be7c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb274155b20 con 0x7fb274071c40 2023-12-01T23:47:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb27be7c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27415a0c0 con 0x7fb274159760 2023-12-01T23:47:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb279417640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 0x7fb274070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.904+0000 7fb279c18640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7fb27414fd70 0x7fb2740c7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:43280/0 (socket says 172.21.15.96:43280) 2023-12-01T23:47:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.905+0000 7fb279c18640 1 -- 172.21.15.96:0/3976215080 learned_addr learned my addr 172.21.15.96:0/3976215080 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:47:46.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.905+0000 7fb27a419640 1 --2- 172.21.15.96:0/3976215080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 0x7fb274159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.907+0000 7fb27a419640 1 -- 172.21.15.96:0/3976215080 >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 msgr2=0x7fb274070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.907+0000 7fb27a419640 1 --2- 172.21.15.96:0/3976215080 >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 0x7fb274070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.907+0000 7fb27a419640 1 -- 172.21.15.96:0/3976215080 >> v1:172.21.15.96:6789/0 conn(0x7fb27414fd70 legacy=0x7fb2740c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.907+0000 7fb27a419640 1 -- 172.21.15.96:0/3976215080 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2741592d0 con 0x7fb274159760 2023-12-01T23:47:46.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.907+0000 7fb279417640 1 --2- 172.21.15.96:0/3976215080 >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 0x7fb274070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T23:47:46.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.909+0000 7fb27a419640 1 --2- 172.21.15.96:0/3976215080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 0x7fb274159b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d90 tx=0x7fb26c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed4318986afeeb17 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.912+0000 7fb278c16640 1 -- 172.21.15.96:0/3976215080 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c02cb30 con 0x7fb274159760 2023-12-01T23:47:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb278c16640 1 -- 172.21.15.96:0/3976215080 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb26c02cc90 con 0x7fb274159760 2023-12-01T23:47:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb278c16640 1 -- 172.21.15.96:0/3976215080 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c034440 con 0x7fb274159760 2023-12-01T23:47:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 -- 172.21.15.96:0/3976215080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 msgr2=0x7fb274159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 --2- 172.21.15.96:0/3976215080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 0x7fb274159b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009d90 tx=0x7fb26c02bd80 comp rx=0 tx=0).stop 2023-12-01T23:47:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 -- 172.21.15.96:0/3976215080 shutdown_connections 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 --2- 172.21.15.96:0/3976215080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb274159760 0x7fb274159b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 --2- 172.21.15.96:0/3976215080 >> v2:172.21.15.102:3300/0 conn(0x7fb274071c40 0x7fb274070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 -- 172.21.15.96:0/3976215080 >> 172.21.15.96:0/3976215080 conn(0x7fb27406cd60 msgr2=0x7fb27406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 -- 172.21.15.96:0/3976215080 shutdown_connections 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.913+0000 7fb27be7c640 1 -- 172.21.15.96:0/3976215080 wait complete. 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.914+0000 7fb27be7c640 1 Processor -- start 2023-12-01T23:47:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.914+0000 7fb27be7c640 1 -- start start 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 0x7fb2740ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb27414fd70 0x7fb2740c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 0x7fb27414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2741521a0 con 0x7fb274159760 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2741502e0 con 0x7fb274071c40 2023-12-01T23:47:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.915+0000 7fb27be7c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb274150530 con 0x7fb27414fd70 2023-12-01T23:47:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.916+0000 7fb27a419640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 0x7fb27414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.916+0000 7fb279c18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 0x7fb2740ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.916+0000 7fb279417640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb27414fd70 0x7fb2740c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.916+0000 7fb27a419640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 0x7fb27414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45992/0 (socket says 172.21.15.96:45992) 2023-12-01T23:47:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.916+0000 7fb27a419640 1 -- 172.21.15.96:0/4096027574 learned_addr learned my addr 172.21.15.96:0/4096027574 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.919+0000 7fb279c18640 1 -- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb27414fd70 msgr2=0x7fb2740c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.919+0000 7fb279c18640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb27414fd70 0x7fb2740c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.919+0000 7fb279c18640 1 -- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 msgr2=0x7fb27414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.919+0000 7fb279c18640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 0x7fb27414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:46.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.919+0000 7fb279c18640 1 -- 172.21.15.96:0/4096027574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27000a5a0 con 0x7fb274071c40 2023-12-01T23:47:46.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.921+0000 7fb279c18640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 0x7fb2740ca980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb274072c60 tx=0x7fb26400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:46.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.925+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264005ce0 con 0x7fb274071c40 2023-12-01T23:47:46.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.925+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb264005e60 con 0x7fb274071c40 2023-12-01T23:47:46.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.925+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c009a70 con 0x7fb274071c40 2023-12-01T23:47:46.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.925+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264007330 con 0x7fb274071c40 2023-12-01T23:47:46.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.925+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb274150af0 con 0x7fb274071c40 2023-12-01T23:47:46.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:46.926+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb274067500 con 0x7fb274071c40 2023-12-01T23:47:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.164+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb264007490 con 0x7fb274071c40 2023-12-01T23:47:47.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.164+0000 7fb26a7fc640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 0x7fb25806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.165+0000 7fb279417640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 0x7fb25806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.165+0000 7fb279417640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 0x7fb25806d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2741e8810 tx=0x7fb27000a2a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:47.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.166+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb26405a3a0 con 0x7fb274071c40 2023-12-01T23:47:47.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.176+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb264056650 con 0x7fb274071c40 2023-12-01T23:47:47.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.377+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2740713e0 con 0x7fb274071c40 2023-12-01T23:47:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.402+0000 7fb26a7fc640 1 -- 172.21.15.96:0/4096027574 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7fb264015020 con 0x7fb274071c40 2023-12-01T23:47:47.403 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:47.403 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:47:47.403 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 msgr2=0x7fb25806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 0x7fb25806d350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2741e8810 tx=0x7fb27000a2a0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 msgr2=0x7fb2740ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 0x7fb2740ca980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb274072c60 tx=0x7fb26400c800 comp rx=0 tx=0).stop 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 shutdown_connections 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fb25806ae90 0x7fb25806d350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb274159760 0x7fb27414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb27414fd70 0x7fb2740c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 --2- 172.21.15.96:0/4096027574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb274071c40 0x7fb2740ca980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 >> 172.21.15.96:0/4096027574 conn(0x7fb27406cd60 msgr2=0x7fb274145b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 shutdown_connections 2023-12-01T23:47:47.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.404+0000 7fb27be7c640 1 -- 172.21.15.96:0/4096027574 wait complete. 2023-12-01T23:47:47.417 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.515+0000 7f30f7773640 1 Processor -- start 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.515+0000 7f30f7773640 1 -- start start 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f7773640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f30f01580c0 0x7f30f006d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f7773640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f006e670 con 0x7f30f01514d0 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f7773640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f015ace0 con 0x7f30f00c87d0 2023-12-01T23:47:47.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f7773640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f015af80 con 0x7f30f01580c0 2023-12-01T23:47:47.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f550f640 1 --1- >> v1:172.21.15.96:6789/0 conn(0x7f30f01514d0 0x7f30f00c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.96:6789/0 says I am v1:172.21.15.96:43284/0 (socket says 172.21.15.96:43284) 2023-12-01T23:47:47.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f550f640 1 -- 172.21.15.96:0/358335897 learned_addr learned my addr 172.21.15.96:0/358335897 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:47:47.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.516+0000 7f30f5d10640 1 --2- 172.21.15.96:0/358335897 >> v2:172.21.15.102:3300/0 conn(0x7f30f01580c0 0x7f30f006d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.519+0000 7f30e7fff640 1 -- 172.21.15.96:0/358335897 <== mon.0 v1:172.21.15.96:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483935505 0 0) 0x7f30f006e670 con 0x7f30f01514d0 2023-12-01T23:47:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.519+0000 7f30e7fff640 1 -- 172.21.15.96:0/358335897 --> v1:172.21.15.96:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30dc003520 con 0x7f30f01514d0 2023-12-01T23:47:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.519+0000 7f30f5d10640 1 -- 172.21.15.96:0/358335897 >> v1:172.21.15.102:6789/0 conn(0x7f30f00c87d0 legacy=0x7f30f01579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.519+0000 7f30f5d10640 1 -- 172.21.15.96:0/358335897 >> v1:172.21.15.96:6789/0 conn(0x7f30f01514d0 legacy=0x7f30f00c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.519+0000 7f30f5d10640 1 -- 172.21.15.96:0/358335897 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f015b240 con 0x7f30f01580c0 2023-12-01T23:47:47.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.523+0000 7f30f5d10640 1 --2- 172.21.15.96:0/358335897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f01580c0 0x7f30f006d3a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009d90 tx=0x7f30e802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e971ac8ca6452c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.526+0000 7f30e7fff640 1 -- 172.21.15.96:0/358335897 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e802cd80 con 0x7f30f01580c0 2023-12-01T23:47:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.526+0000 7f30e7fff640 1 -- 172.21.15.96:0/358335897 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f30e8034440 con 0x7f30f01580c0 2023-12-01T23:47:47.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.526+0000 7f30e7fff640 1 -- 172.21.15.96:0/358335897 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e80347f0 con 0x7f30f01580c0 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 -- 172.21.15.96:0/358335897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f01580c0 msgr2=0x7f30f006d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 --2- 172.21.15.96:0/358335897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f01580c0 0x7f30f006d3a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009d90 tx=0x7f30e802bfd0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 -- 172.21.15.96:0/358335897 shutdown_connections 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 --2- 172.21.15.96:0/358335897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f01580c0 0x7f30f006d3a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 -- 172.21.15.96:0/358335897 >> 172.21.15.96:0/358335897 conn(0x7f30f0071410 msgr2=0x7f30f006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 -- 172.21.15.96:0/358335897 shutdown_connections 2023-12-01T23:47:47.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.527+0000 7f30f7773640 1 -- 172.21.15.96:0/358335897 wait complete. 2023-12-01T23:47:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.528+0000 7f30f7773640 1 Processor -- start 2023-12-01T23:47:47.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.528+0000 7f30f7773640 1 -- start start 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f00c87d0 0x7f30f01ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f01514d0 0x7f30f014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f014ffd0 con 0x7f30f01580c0 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f014ede0 con 0x7f30f00c87d0 2023-12-01T23:47:47.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f7773640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f0155b00 con 0x7f30f01514d0 2023-12-01T23:47:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.529+0000 7f30f5d10640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.530+0000 7f30f4d0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f01514d0 0x7f30f014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.530+0000 7f30f550f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f00c87d0 0x7f30f01ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.530+0000 7f30f5d10640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46008/0 (socket says 172.21.15.96:46008) 2023-12-01T23:47:47.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.530+0000 7f30f5d10640 1 -- 172.21.15.96:0/2472024092 learned_addr learned my addr 172.21.15.96:0/2472024092 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:47.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.533+0000 7f30f5d10640 1 -- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f01514d0 msgr2=0x7f30f014b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.533+0000 7f30f5d10640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f01514d0 0x7f30f014b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.533+0000 7f30f5d10640 1 -- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f00c87d0 msgr2=0x7f30f01ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:47.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.533+0000 7f30f5d10640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f00c87d0 0x7f30f01ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:47.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.533+0000 7f30f5d10640 1 -- 172.21.15.96:0/2472024092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e8009a70 con 0x7f30f01580c0 2023-12-01T23:47:47.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.535+0000 7f30f5d10640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30e802c5e0 tx=0x7f30e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:47.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.537+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e803e410 con 0x7f30f01580c0 2023-12-01T23:47:47.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.537+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f01f3180 con 0x7f30f01580c0 2023-12-01T23:47:47.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.538+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f014e790 con 0x7f30f01580c0 2023-12-01T23:47:47.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.538+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f01518b0 con 0x7f30f01580c0 2023-12-01T23:47:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.539+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f30e803e570 con 0x7f30f01580c0 2023-12-01T23:47:47.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.539+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e803e8e0 con 0x7f30f01580c0 2023-12-01T23:47:47.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.780+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f30e803b050 con 0x7f30f01580c0 2023-12-01T23:47:47.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.781+0000 7f30e5ffb640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 0x7f30d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:47.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.781+0000 7f30f550f640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 0x7f30d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:47.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.781+0000 7f30f550f640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 0x7f30d406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0011e0 tx=0x7f30ec007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:47.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.795+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f30e807b370 con 0x7f30f01580c0 2023-12-01T23:47:47.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.795+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30e8077620 con 0x7f30f01580c0 2023-12-01T23:47:47.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:47.998+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30f0067500 con 0x7f30f01580c0 2023-12-01T23:47:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.011+0000 7f30e5ffb640 1 -- 172.21.15.96:0/2472024092 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6501 (secure 0 0 0) 0x7f30e8039030 con 0x7f30f01580c0 2023-12-01T23:47:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:48.012 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6835/2147014621","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2147014621},{"type":"v1","addr":"172.21.15.96:6835","nonce":2147014621}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/1336909237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6836","nonce":1336909237},{"type":"v1","addr":"172.21.15.96:6837","nonce":1336909237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3560180033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3560180033},{"type":"v1","addr":"172.21.15.102:6835","nonce":3560180033}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4226,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6839/3826976889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6838","nonce":3826976889},{"type":"v1","addr":"172.21.15.96:6839","nonce":3826976889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/1939409017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":1939409017},{"type":"v1","addr":"172.21.15.102:6837","nonce":1939409017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-01T23:18:28.557088+0000","modified":"2023-12-01T23:18:57.289784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4255":{"gid":4255,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.102:6833/2956212258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2956212258},{"type":"v1","addr":"172.21.15.102:6833","nonce":2956212258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T23:47:48.012 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 10 2023-12-01T23:47:48.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 msgr2=0x7f30d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 0x7f30d406d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0011e0 tx=0x7f30ec007d30 comp rx=0 tx=0).stop 2023-12-01T23:47:48.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 msgr2=0x7f30f014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f30e802c5e0 tx=0x7f30e8004a40 comp rx=0 tx=0).stop 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 shutdown_connections 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f30d406ae40 0x7f30d406d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30f01580c0 0x7f30f014f270 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f01514d0 0x7f30f014b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 --2- 172.21.15.96:0/2472024092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f00c87d0 0x7f30f01ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 >> 172.21.15.96:0/2472024092 conn(0x7f30f0071410 msgr2=0x7f30f006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 shutdown_connections 2023-12-01T23:47:48.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.013+0000 7f30f7773640 1 -- 172.21.15.96:0/2472024092 wait complete. 2023-12-01T23:47:48.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T23:47:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 Processor -- start 2023-12-01T23:47:48.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 -- start start 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1814fd70 0x7f1c18070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1c18071c40 0x7f1c180c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c18071420 con 0x7f1c180c7eb0 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c180c82c0 con 0x7f1c18071c40 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.124+0000 7f1c20087640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c18155b20 con 0x7f1c1814fd70 2023-12-01T23:47:48.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.125+0000 7f1c1d622640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f1c18071c40 0x7f1c180c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.125+0000 7f1c1e624640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1c180c7eb0 0x7f1c18159760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.96:59670/0 (socket says 172.21.15.96:59670) 2023-12-01T23:47:48.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.125+0000 7f1c1e624640 1 -- 172.21.15.96:0/3999908672 learned_addr learned my addr 172.21.15.96:0/3999908672 (peer_addr_for_me v1:172.21.15.96:0/0) 2023-12-01T23:47:48.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.125+0000 7f1c1de23640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1814fd70 0x7f1c18070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1ce21640 1 -- 172.21.15.96:0/3999908672 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251084959 0 0) 0x7f1c10001490 con 0x7f1c180c7eb0 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1ce21640 1 -- 172.21.15.96:0/3999908672 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c04003520 con 0x7f1c180c7eb0 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1d622640 1 -- 172.21.15.96:0/3999908672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1814fd70 msgr2=0x7f1c18070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1d622640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1814fd70 0x7f1c18070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1d622640 1 -- 172.21.15.96:0/3999908672 >> v1:172.21.15.102:6789/0 conn(0x7f1c180c7eb0 legacy=0x7f1c18159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.128+0000 7f1c1d622640 1 -- 172.21.15.96:0/3999908672 --> v2:172.21.15.96:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c181592d0 con 0x7f1c18071c40 2023-12-01T23:47:48.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.130+0000 7f1c1d622640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c180c7970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c140097a0 tx=0x7f1c1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f06a1103c571648 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.131+0000 7f1c1ce21640 1 -- 172.21.15.96:0/3999908672 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402e070 con 0x7f1c18071c40 2023-12-01T23:47:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.133+0000 7f1c1ce21640 1 -- 172.21.15.96:0/3999908672 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c140315a0 con 0x7f1c18071c40 2023-12-01T23:47:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.133+0000 7f1c1ce21640 1 -- 172.21.15.96:0/3999908672 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14031910 con 0x7f1c18071c40 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 -- 172.21.15.96:0/3999908672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 msgr2=0x7f1c180c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c180c7970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c140097a0 tx=0x7f1c1402b840 comp rx=0 tx=0).stop 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 -- 172.21.15.96:0/3999908672 shutdown_connections 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c180c7970 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 --2- 172.21.15.96:0/3999908672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1814fd70 0x7f1c18070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 -- 172.21.15.96:0/3999908672 >> 172.21.15.96:0/3999908672 conn(0x7f1c1806cd60 msgr2=0x7f1c1806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 -- 172.21.15.96:0/3999908672 shutdown_connections 2023-12-01T23:47:48.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.134+0000 7f1c20087640 1 -- 172.21.15.96:0/3999908672 wait complete. 2023-12-01T23:47:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.135+0000 7f1c20087640 1 Processor -- start 2023-12-01T23:47:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.135+0000 7f1c20087640 1 -- start start 2023-12-01T23:47:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c180c7eb0 0x7f1c18145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1814fd70 0x7f1c181436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1814bef0 con 0x7f1c18071c40 2023-12-01T23:47:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1814b7f0 con 0x7f1c1814fd70 2023-12-01T23:47:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c20087640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181e1150 con 0x7f1c180c7eb0 2023-12-01T23:47:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c1de23640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c1de23640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46034/0 (socket says 172.21.15.96:46034) 2023-12-01T23:47:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c1de23640 1 -- 172.21.15.96:0/2342711265 learned_addr learned my addr 172.21.15.96:0/2342711265 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c1e624640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1814fd70 0x7f1c181436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.136+0000 7f1c1d622640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c180c7eb0 0x7f1c18145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.139+0000 7f1c1de23640 1 -- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c180c7eb0 msgr2=0x7f1c18145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.139+0000 7f1c1de23640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c180c7eb0 0x7f1c18145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.140+0000 7f1c1de23640 1 -- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1814fd70 msgr2=0x7f1c181436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.140+0000 7f1c1de23640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1814fd70 0x7f1c181436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.140+0000 7f1c1de23640 1 -- 172.21.15.96:0/2342711265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009400 con 0x7f1c18071c40 2023-12-01T23:47:48.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.142+0000 7f1c1de23640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c080108a0 tx=0x7f1c08010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:48.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.145+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800ca40 con 0x7f1c18071c40 2023-12-01T23:47:48.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.145+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c0800cba0 con 0x7f1c18071c40 2023-12-01T23:47:48.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.145+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08018410 con 0x7f1c18071c40 2023-12-01T23:47:48.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.145+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180c9be0 con 0x7f1c18071c40 2023-12-01T23:47:48.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.145+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180ca1a0 con 0x7f1c18071c40 2023-12-01T23:47:48.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.146+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c18067500 con 0x7f1c18071c40 2023-12-01T23:47:48.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.163+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c08018570 con 0x7f1c18071c40 2023-12-01T23:47:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.164+0000 7f1c0e7fc640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 0x7f1bfc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.164+0000 7f1c1d622640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 0x7f1bfc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.165+0000 7f1c1d622640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 0x7f1bfc06d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c14036000 tx=0x7f1c14008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:48.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.166+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c08059fa0 con 0x7f1c18071c40 2023-12-01T23:47:48.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.399+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c080562e0 con 0x7f1c18071c40 2023-12-01T23:47:48.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.569+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c180c5da0 con 0x7f1c18071c40 2023-12-01T23:47:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.607+0000 7f1c0e7fc640 1 -- 172.21.15.96:0/2342711265 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f1c08059900 con 0x7f1c18071c40 2023-12-01T23:47:48.608 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-12-01T23:47:48.609 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":29,"fsid":"427efaec-98ee-4c98-922b-5db70b583575","created":"2023-12-01T23:17:58.423127+0000","modified":"2023-12-01T23:19:05.336668+0000","last_up_change":"2023-12-01T23:18:13.080623+0000","last_in_change":"2023-12-01T23:18:04.199976+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T23:18:14.051664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T23:18:26.226080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T23:18:27.378852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-01T23:18:32.629361+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"275b2c35-691f-4d44-9283-4e3c0fdd037d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6813","nonce":904588792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6815","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6817","nonce":904588792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6823","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6825","nonce":904588792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6819","nonce":904588792},{"type":"v1","addr":"172.21.15.96:6821","nonce":904588792}]},"public_addr":"172.21.15.96:6813/904588792","cluster_addr":"172.21.15.96:6817/904588792","heartbeat_back_addr":"172.21.15.96:6825/904588792","heartbeat_front_addr":"172.21.15.96:6821/904588792","state":["exists","up"]},{"osd":1,"uuid":"6ac67309-748d-4b73-afb8-3b3ca05690a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6803","nonce":3966350993}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6805","nonce":3966350993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6809","nonce":3966350993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3966350993},{"type":"v1","addr":"172.21.15.96:6807","nonce":3966350993}]},"public_addr":"172.21.15.96:6803/3966350993","cluster_addr":"172.21.15.96:6805/3966350993","heartbeat_back_addr":"172.21.15.96:6809/3966350993","heartbeat_front_addr":"172.21.15.96:6807/3966350993","state":["exists","up"]},{"osd":2,"uuid":"2363cd32-cd62-427a-8bb9-682c6387c607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6811","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6812","nonce":3916123530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6816","nonce":3916123530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6824","nonce":3916123530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3916123530},{"type":"v1","addr":"172.21.15.96:6820","nonce":3916123530}]},"public_addr":"172.21.15.96:6812/3916123530","cluster_addr":"172.21.15.96:6816/3916123530","heartbeat_back_addr":"172.21.15.96:6824/3916123530","heartbeat_front_addr":"172.21.15.96:6820/3916123530","state":["exists","up"]},{"osd":3,"uuid":"63fdf9ef-afed-4359-bea1-95ef96c3a1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6827","nonce":4247342649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6829","nonce":4247342649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6833","nonce":4247342649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":4247342649},{"type":"v1","addr":"172.21.15.96:6831","nonce":4247342649}]},"public_addr":"172.21.15.96:6827/4247342649","cluster_addr":"172.21.15.96:6829/4247342649","heartbeat_back_addr":"172.21.15.96:6833/4247342649","heartbeat_front_addr":"172.21.15.96:6831/4247342649","state":["exists","up"]},{"osd":4,"uuid":"7f2dc942-202c-4386-99ab-e6a5bb9d1df1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6801","nonce":1035724866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6803","nonce":1035724866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6807","nonce":1035724866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1035724866},{"type":"v1","addr":"172.21.15.102:6805","nonce":1035724866}]},"public_addr":"172.21.15.102:6801/1035724866","cluster_addr":"172.21.15.102:6803/1035724866","heartbeat_back_addr":"172.21.15.102:6807/1035724866","heartbeat_front_addr":"172.21.15.102:6805/1035724866","state":["exists","up"]},{"osd":5,"uuid":"bfde523c-f5b8-45e6-b1c4-df8d336d6597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6811","nonce":3442167732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6815","nonce":3442167732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6823","nonce":3442167732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":3442167732},{"type":"v1","addr":"172.21.15.102:6819","nonce":3442167732}]},"public_addr":"172.21.15.102:6811/3442167732","cluster_addr":"172.21.15.102:6815/3442167732","heartbeat_back_addr":"172.21.15.102:6823/3442167732","heartbeat_front_addr":"172.21.15.102:6819/3442167732","state":["exists","up"]},{"osd":6,"uuid":"8c318859-a0f4-4986-a66f-bf6e248c1021","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6810","nonce":3935229295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6814","nonce":3935229295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6822","nonce":3935229295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3935229295},{"type":"v1","addr":"172.21.15.102:6818","nonce":3935229295}]},"public_addr":"172.21.15.102:6810/3935229295","cluster_addr":"172.21.15.102:6814/3935229295","heartbeat_back_addr":"172.21.15.102:6822/3935229295","heartbeat_front_addr":"172.21.15.102:6818/3935229295","state":["exists","up"]},{"osd":7,"uuid":"2e101d87-81cd-436a-a8a6-fb5d2ce70b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6825","nonce":725358453}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6827","nonce":725358453}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6831","nonce":725358453}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":725358453},{"type":"v1","addr":"172.21.15.102:6829","nonce":725358453}]},"public_addr":"172.21.15.102:6825/725358453","cluster_addr":"172.21.15.102:6827/725358453","heartbeat_back_addr":"172.21.15.102:6831/725358453","heartbeat_front_addr":"172.21.15.102:6829/725358453","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.532537+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.398907+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.521779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.541261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.421272+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.487423+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.483358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T23:18:09.533537+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T23:47:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 msgr2=0x7f1bfc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 0x7f1bfc06d380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1c14036000 tx=0x7f1c14008030 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 msgr2=0x7f1c181edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c080108a0 tx=0x7f1c08010d60 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 shutdown_connections 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f1bfc06aec0 0x7f1bfc06d380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1814fd70 0x7f1c181436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c180c7eb0 0x7f1c18145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 --2- 172.21.15.96:0/2342711265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c18071c40 0x7f1c181edec0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 >> 172.21.15.96:0/2342711265 conn(0x7f1c1806cd60 msgr2=0x7f1c180c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 shutdown_connections 2023-12-01T23:47:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.609+0000 7f1c20087640 1 -- 172.21.15.96:0/2342711265 wait complete. 2023-12-01T23:47:48.622 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-01T23:47:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.724+0000 7fea6cf6e640 1 Processor -- start 2023-12-01T23:47:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.724+0000 7fea6cf6e640 1 -- start start 2023-12-01T23:47:48.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea6cf6e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea6cf6e640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fea680728b0 0x7fea680cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea6cf6e640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6815b6e0 con 0x7fea680c5a90 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea6cf6e640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6815a880 con 0x7fea680728b0 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea6cf6e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6806f7e0 con 0x7fea68151510 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.725+0000 7fea65d9b640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fea680728b0 0x7fea680cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.726+0000 7fea6659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.726+0000 7fea6659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:43416/0 (socket says 172.21.15.96:43416) 2023-12-01T23:47:48.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.726+0000 7fea6659c640 1 -- 172.21.15.96:0/2445874920 learned_addr learned my addr 172.21.15.96:0/2445874920 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.728+0000 7fea6659c640 1 -- 172.21.15.96:0/2445874920 >> v2:172.21.15.96:3300/0 conn(0x7fea680728b0 msgr2=0x7fea680cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.728+0000 7fea6659c640 1 --2- 172.21.15.96:0/2445874920 >> v2:172.21.15.96:3300/0 conn(0x7fea680728b0 0x7fea680cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.728+0000 7fea6659c640 1 -- 172.21.15.96:0/2445874920 >> v1:172.21.15.96:6789/0 conn(0x7fea680c5a90 legacy=0x7fea681572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.728+0000 7fea6659c640 1 -- 172.21.15.96:0/2445874920 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6815aad0 con 0x7fea68151510 2023-12-01T23:47:48.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.730+0000 7fea6659c640 1 --2- 172.21.15.96:0/2445874920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea60009e50 tx=0x7fea6002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3801ddf1255187c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.734+0000 7fea6559a640 1 -- 172.21.15.96:0/2445874920 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6002cb00 con 0x7fea68151510 2023-12-01T23:47:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.734+0000 7fea6559a640 1 -- 172.21.15.96:0/2445874920 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea6002cc60 con 0x7fea68151510 2023-12-01T23:47:48.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.734+0000 7fea6559a640 1 -- 172.21.15.96:0/2445874920 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea600343f0 con 0x7fea68151510 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 -- 172.21.15.96:0/2445874920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 msgr2=0x7fea680cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/2445874920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fea60009e50 tx=0x7fea6002bf60 comp rx=0 tx=0).stop 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 -- 172.21.15.96:0/2445874920 shutdown_connections 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/2445874920 >> v2:172.21.15.96:3300/0 conn(0x7fea680728b0 0x7fea680cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/2445874920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea68151510 0x7fea680cae30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 -- 172.21.15.96:0/2445874920 >> 172.21.15.96:0/2445874920 conn(0x7fea6806cd60 msgr2=0x7fea6806d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:48.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 -- 172.21.15.96:0/2445874920 shutdown_connections 2023-12-01T23:47:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.735+0000 7fea6cf6e640 1 -- 172.21.15.96:0/2445874920 wait complete. 2023-12-01T23:47:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.736+0000 7fea6cf6e640 1 Processor -- start 2023-12-01T23:47:48.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 -- start start 2023-12-01T23:47:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea680728b0 0x7fea680c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea68151510 0x7fea681565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681ef340 con 0x7fea680c5a90 2023-12-01T23:47:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea680c1e00 con 0x7fea68151510 2023-12-01T23:47:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.737+0000 7fea6cf6e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea681ee750 con 0x7fea680728b0 2023-12-01T23:47:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.738+0000 7fea65d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.738+0000 7fea65d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46046/0 (socket says 172.21.15.96:46046) 2023-12-01T23:47:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.738+0000 7fea65d9b640 1 -- 172.21.15.96:0/3517082711 learned_addr learned my addr 172.21.15.96:0/3517082711 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.738+0000 7fea66d9d640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea68151510 0x7fea681565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.738+0000 7fea6659c640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea680728b0 0x7fea680c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.741+0000 7fea65d9b640 1 -- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea680728b0 msgr2=0x7fea680c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.741+0000 7fea65d9b640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea680728b0 0x7fea680c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.741+0000 7fea65d9b640 1 -- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea68151510 msgr2=0x7fea681565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.741+0000 7fea65d9b640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea68151510 0x7fea681565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:48.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.741+0000 7fea65d9b640 1 -- 172.21.15.96:0/3517082711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009b30 con 0x7fea680c5a90 2023-12-01T23:47:48.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.744+0000 7fea65d9b640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00e870 tx=0x7fea5c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.746+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0094f0 con 0x7fea680c5a90 2023-12-01T23:47:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.746+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea680c8eb0 con 0x7fea680c5a90 2023-12-01T23:47:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.746+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea681eea10 con 0x7fea680c5a90 2023-12-01T23:47:48.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.747+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea681ef4f0 con 0x7fea680c5a90 2023-12-01T23:47:48.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.747+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fea5c005990 con 0x7fea680c5a90 2023-12-01T23:47:48.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.747+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c005d20 con 0x7fea680c5a90 2023-12-01T23:47:48.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.987+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea5c00c940 con 0x7fea680c5a90 2023-12-01T23:47:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.988+0000 7fea56ffd640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 0x7fea4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.988+0000 7fea6659c640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 0x7fea4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:48.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:48.988+0000 7fea6659c640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 0x7fea4806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea60035000 tx=0x7fea60030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:49.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.006+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea5c058a80 con 0x7fea680c5a90 2023-12-01T23:47:49.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.007+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea5c054dc0 con 0x7fea680c5a90 2023-12-01T23:47:49.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.218+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fea681ef4f0 con 0x7fea680c5a90 2023-12-01T23:47:49.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.318+0000 7fea56ffd640 1 -- 172.21.15.96:0/3517082711 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7fea681ef4f0 con 0x7fea680c5a90 2023-12-01T23:47:49.320 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 msgr2=0x7fea4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 0x7fea4806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fea60035000 tx=0x7fea60030000 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 msgr2=0x7fea68156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00e870 tx=0x7fea5c00ed30 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 shutdown_connections 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fea4806ae70 0x7fea4806d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea68151510 0x7fea681565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea680c5a90 0x7fea68156070 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 --2- 172.21.15.96:0/3517082711 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea680728b0 0x7fea680c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 >> 172.21.15.96:0/3517082711 conn(0x7fea6806cd60 msgr2=0x7fea68073850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:49.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 shutdown_connections 2023-12-01T23:47:49.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.321+0000 7fea6cf6e640 1 -- 172.21.15.96:0/3517082711 wait complete. 2023-12-01T23:47:49.334 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-01T23:47:49.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 Processor -- start 2023-12-01T23:47:49.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 -- start start 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5584153890 0x7f558415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558415a700 con 0x7f5584153c70 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840ca870 con 0x7f5584153890 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.438+0000 7f558aead640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5584159af0 con 0x7f55840ceef0 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.439+0000 7f5588c49640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5584153890 0x7f558415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.439+0000 7f558944a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.439+0000 7f558944a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:43426/0 (socket says 172.21.15.96:43426) 2023-12-01T23:47:49.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.439+0000 7f558944a640 1 -- 172.21.15.96:0/920827121 learned_addr learned my addr 172.21.15.96:0/920827121 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:49.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.442+0000 7f558944a640 1 -- 172.21.15.96:0/920827121 >> v2:172.21.15.102:3300/0 conn(0x7f5584153890 msgr2=0x7f558415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:49.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.442+0000 7f558944a640 1 --2- 172.21.15.96:0/920827121 >> v2:172.21.15.102:3300/0 conn(0x7f5584153890 0x7f558415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.442+0000 7f558944a640 1 -- 172.21.15.96:0/920827121 >> v1:172.21.15.102:6789/0 conn(0x7f5584153c70 legacy=0x7f55840c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.442+0000 7f558944a640 1 -- 172.21.15.96:0/920827121 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584159dd0 con 0x7f55840ceef0 2023-12-01T23:47:49.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.444+0000 7f558944a640 1 --2- 172.21.15.96:0/920827121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f557c009e50 tx=0x7f557c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff04ac7f1bcc7e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.448+0000 7f55837fe640 1 -- 172.21.15.96:0/920827121 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c02cb90 con 0x7f55840ceef0 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.448+0000 7f55837fe640 1 -- 172.21.15.96:0/920827121 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f557c02ccf0 con 0x7f55840ceef0 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.448+0000 7f55837fe640 1 -- 172.21.15.96:0/920827121 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c034630 con 0x7f55840ceef0 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 -- 172.21.15.96:0/920827121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 msgr2=0x7f55840cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 --2- 172.21.15.96:0/920827121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f557c009e50 tx=0x7f557c02bff0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 -- 172.21.15.96:0/920827121 shutdown_connections 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 --2- 172.21.15.96:0/920827121 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f55840cf320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 --2- 172.21.15.96:0/920827121 >> v2:172.21.15.102:3300/0 conn(0x7f5584153890 0x7f558415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 -- 172.21.15.96:0/920827121 >> 172.21.15.96:0/920827121 conn(0x7f558406ba00 msgr2=0x7f558406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:49.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 -- 172.21.15.96:0/920827121 shutdown_connections 2023-12-01T23:47:49.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.449+0000 7f558aead640 1 -- 172.21.15.96:0/920827121 wait complete. 2023-12-01T23:47:49.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.450+0000 7f558aead640 1 Processor -- start 2023-12-01T23:47:49.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.450+0000 7f558aead640 1 -- start start 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f5584149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5584153890 0x7f558414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 0x7f55841f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841509c0 con 0x7f5584153890 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841e31a0 con 0x7f5584153c70 2023-12-01T23:47:49.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558aead640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b3dc0 con 0x7f55840ceef0 2023-12-01T23:47:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f558944a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 0x7f55841f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.451+0000 7f5588c49640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f5584149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.452+0000 7f5583fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5584153890 0x7f558414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.452+0000 7f558944a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 0x7f55841f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:58608/0 (socket says 172.21.15.96:58608) 2023-12-01T23:47:49.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.452+0000 7f558944a640 1 -- 172.21.15.96:0/4065351099 learned_addr learned my addr 172.21.15.96:0/4065351099 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.455+0000 7f5588c49640 1 -- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 msgr2=0x7f55841f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.455+0000 7f5588c49640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 0x7f55841f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.455+0000 7f5588c49640 1 -- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5584153890 msgr2=0x7f558414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.455+0000 7f5588c49640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5584153890 0x7f558414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:49.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.455+0000 7f5588c49640 1 -- 172.21.15.96:0/4065351099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009b30 con 0x7f55840ceef0 2023-12-01T23:47:49.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.458+0000 7f5588c49640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f5584149bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f557400e850 tx=0x7f557400ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.462+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740095b0 con 0x7f55840ceef0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.462+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f557400c940 con 0x7f55840ceef0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.462+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840b3ae0 con 0x7f55840ceef0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.462+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400ccf0 con 0x7f55840ceef0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.462+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55840b4490 con 0x7f55840ceef0 2023-12-01T23:47:49.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.463+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584159780 con 0x7f55840ceef0 2023-12-01T23:47:49.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.482+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5574013470 con 0x7f55840ceef0 2023-12-01T23:47:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.482+0000 7f55817fa640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 0x7f557006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.483+0000 7f5583fff640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 0x7f557006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.483+0000 7f5583fff640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 0x7f557006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f55840c5cf0 tx=0x7f5578009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:49.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.484+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f5574058c40 con 0x7f55840ceef0 2023-12-01T23:47:49.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.722+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5574054ef0 con 0x7f55840ceef0 2023-12-01T23:47:49.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:49.925+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5584159780 con 0x7f55840ceef0 2023-12-01T23:47:50.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.428+0000 7f55817fa640 1 -- 172.21.15.96:0/4065351099 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5584159780 con 0x7f55840ceef0 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.430+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 msgr2=0x7f557006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.430+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 0x7f557006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f55840c5cf0 tx=0x7f5578009040 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.430+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 msgr2=0x7f5584149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.430+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f5584149bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f557400e850 tx=0x7f557400ed10 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 shutdown_connections 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f557006ae40 0x7f557006d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5584153c70 0x7f55841f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5584153890 0x7f558414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 --2- 172.21.15.96:0/4065351099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f55840ceef0 0x7f5584149bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 >> 172.21.15.96:0/4065351099 conn(0x7f558406ba00 msgr2=0x7f55840cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:50.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 shutdown_connections 2023-12-01T23:47:50.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.431+0000 7f558aead640 1 -- 172.21.15.96:0/4065351099 wait complete. 2023-12-01T23:47:50.443 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-01T23:47:50.487 INFO:tasks.ceph.mds.f.smithi102.stderr:==00:00:29:36.448 92489== 2023-12-01T23:47:50.488 INFO:tasks.ceph.mds.f.smithi102.stderr:==00:00:29:36.448 92489== Exit program on first error (--exit-on-first-error=yes) 2023-12-01T23:47:50.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.548+0000 7f874034c640 1 Processor -- start 2023-12-01T23:47:50.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.548+0000 7f874034c640 1 -- start start 2023-12-01T23:47:50.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.549+0000 7f874034c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.549+0000 7f874034c640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7f87380c8580 0x7f87380c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.549+0000 7f874034c640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8738153c60 con 0x7f87380c6ca0 2023-12-01T23:47:50.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.549+0000 7f874034c640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380c80f0 con 0x7f87380c8580 2023-12-01T23:47:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.549+0000 7f874034c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380c8f50 con 0x7f8738153880 2023-12-01T23:47:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.550+0000 7f873e0e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.550+0000 7f873e0e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:43430/0 (socket says 172.21.15.96:43430) 2023-12-01T23:47:50.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.550+0000 7f873e0e8640 1 -- 172.21.15.96:0/172900857 learned_addr learned my addr 172.21.15.96:0/172900857 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.553+0000 7f873e0e8640 1 -- 172.21.15.96:0/172900857 >> v2:172.21.15.96:3300/0 conn(0x7f87380c8580 msgr2=0x7f87380c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.553+0000 7f873e0e8640 1 --2- 172.21.15.96:0/172900857 >> v2:172.21.15.96:3300/0 conn(0x7f87380c8580 0x7f87380c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.553+0000 7f873e0e8640 1 -- 172.21.15.96:0/172900857 >> v1:172.21.15.96:6789/0 conn(0x7f87380c6ca0 legacy=0x7f87380cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:50.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.553+0000 7f873e0e8640 1 -- 172.21.15.96:0/172900857 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380c1fc0 con 0x7f8738153880 2023-12-01T23:47:50.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.555+0000 7f873e0e8640 1 --2- 172.21.15.96:0/172900857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8730009870 tx=0x7f873002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8de1ae337f94d25 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f873d0e6640 1 -- 172.21.15.96:0/172900857 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730030840 con 0x7f8738153880 2023-12-01T23:47:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f873d0e6640 1 -- 172.21.15.96:0/172900857 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87300309a0 con 0x7f8738153880 2023-12-01T23:47:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f873d0e6640 1 -- 172.21.15.96:0/172900857 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730030d50 con 0x7f8738153880 2023-12-01T23:47:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 -- 172.21.15.96:0/172900857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 msgr2=0x7f8738159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:50.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 --2- 172.21.15.96:0/172900857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8730009870 tx=0x7f873002b980 comp rx=0 tx=0).stop 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 -- 172.21.15.96:0/172900857 shutdown_connections 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 --2- 172.21.15.96:0/172900857 >> v2:172.21.15.96:3300/0 conn(0x7f87380c8580 0x7f87380c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 --2- 172.21.15.96:0/172900857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8738153880 0x7f8738159f70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.562+0000 7f874034c640 1 -- 172.21.15.96:0/172900857 >> 172.21.15.96:0/172900857 conn(0x7f873806fa00 msgr2=0x7f873806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.563+0000 7f874034c640 1 -- 172.21.15.96:0/172900857 shutdown_connections 2023-12-01T23:47:50.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.563+0000 7f874034c640 1 -- 172.21.15.96:0/172900857 wait complete. 2023-12-01T23:47:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 Processor -- start 2023-12-01T23:47:50.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 -- start start 2023-12-01T23:47:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87380c6ca0 0x7f87381eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8738153880 0x7f873814a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381efe80 con 0x7f8738153880 2023-12-01T23:47:50.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381ef5e0 con 0x7f87380c6ca0 2023-12-01T23:47:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.564+0000 7f874034c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87381ef8c0 con 0x7f87380c8580 2023-12-01T23:47:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.565+0000 7f873d8e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.565+0000 7f873d8e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:43434/0 (socket says 172.21.15.96:43434) 2023-12-01T23:47:50.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.565+0000 7f873d8e7640 1 -- 172.21.15.96:0/4259009317 learned_addr learned my addr 172.21.15.96:0/4259009317 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.570+0000 7f873d8e7640 1 -- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87380c6ca0 msgr2=0x7f87381eef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.570+0000 7f873d8e7640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87380c6ca0 0x7f87381eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.570+0000 7f873d8e7640 1 -- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8738153880 msgr2=0x7f873814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.570+0000 7f873d8e7640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8738153880 0x7f873814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:50.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.570+0000 7f873d8e7640 1 -- 172.21.15.96:0/4259009317 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300094d0 con 0x7f87380c8580 2023-12-01T23:47:50.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.574+0000 7f873d8e7640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f872800b3e0 tx=0x7f872800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.578+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011830 con 0x7f87380c8580 2023-12-01T23:47:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.578+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f87280119b0 con 0x7f87380c8580 2023-12-01T23:47:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.578+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011d80 con 0x7f87380c8580 2023-12-01T23:47:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.578+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87381efba0 con 0x7f87380c8580 2023-12-01T23:47:50.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.578+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873814a430 con 0x7f87380c8580 2023-12-01T23:47:50.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.579+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873814a650 con 0x7f87380c8580 2023-12-01T23:47:50.661 INFO:tasks.ceph.mds.f.smithi102.stderr:daemon-helper: command failed with exit status 42 2023-12-01T23:47:50.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.824+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f872801a400 con 0x7f87380c8580 2023-12-01T23:47:50.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.825+0000 7f872effd640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 0x7f871c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:50.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.825+0000 7f873e0e8640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 0x7f871c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:50.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.825+0000 7f873e0e8640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 0x7f871c06d350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f873003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:50.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.827+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f87280592d0 con 0x7f87380c8580 2023-12-01T23:47:50.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:50.841+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8728054f10 con 0x7f87380c8580 2023-12-01T23:47:51.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.012+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87380740e0 con 0x7f87380c8580 2023-12-01T23:47:51.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2023-12-01T23:47:51.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.647+0000 7f872effd640 1 -- 172.21.15.96:0/4259009317 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8728015070 con 0x7f87380c8580 2023-12-01T23:47:51.649 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2023-12-01T23:47:51.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 msgr2=0x7f871c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 0x7f871c06d350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8730036000 tx=0x7f873003b040 comp rx=0 tx=0).stop 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 msgr2=0x7f873814c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f872800b3e0 tx=0x7f872800b8a0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 shutdown_connections 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7f871c06ae90 0x7f871c06d350 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8738153880 0x7f873814a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87380c8580 0x7f873814c740 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 --2- 172.21.15.96:0/4259009317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87380c6ca0 0x7f87381eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 >> 172.21.15.96:0/4259009317 conn(0x7f873806fa00 msgr2=0x7f873806fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 shutdown_connections 2023-12-01T23:47:51.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.650+0000 7f874034c640 1 -- 172.21.15.96:0/4259009317 wait complete. 2023-12-01T23:47:51.668 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-01T23:47:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.771+0000 7fafc76e7640 1 Processor -- start 2023-12-01T23:47:51.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.771+0000 7fafc76e7640 1 -- start start 2023-12-01T23:47:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc76e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc00c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc76e7640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 0x7fafc0159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc76e7640 1 -- --> v1:172.21.15.96:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc00c6ec0 con 0x7fafc0150610 2023-12-01T23:47:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc76e7640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc0072a30 con 0x7fafc00bff00 2023-12-01T23:47:51.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc76e7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01509f0 con 0x7fafc0072530 2023-12-01T23:47:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.772+0000 7fafc5c84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 0x7fafc0159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.773+0000 7fafc4c82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc00c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.773+0000 7fafc5c84640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 0x7fafc0159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46062/0 (socket says 172.21.15.96:46062) 2023-12-01T23:47:51.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.773+0000 7fafc5c84640 1 -- 172.21.15.96:0/1528254151 learned_addr learned my addr 172.21.15.96:0/1528254151 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.775+0000 7fafc4c82640 1 -- 172.21.15.96:0/1528254151 >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 msgr2=0x7fafc0159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.775+0000 7fafc4c82640 1 --2- 172.21.15.96:0/1528254151 >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 0x7fafc0159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.775+0000 7fafc4c82640 1 -- 172.21.15.96:0/1528254151 >> v1:172.21.15.96:6789/0 conn(0x7fafc0150610 legacy=0x7fafc00cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.775+0000 7fafc4c82640 1 -- 172.21.15.96:0/1528254151 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0071df0 con 0x7fafc0072530 2023-12-01T23:47:51.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.777+0000 7fafc4c82640 1 --2- 172.21.15.96:0/1528254151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc00c7350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fafb00097a0 tx=0x7fafb002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b98ba3b8174a26f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:51.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafb7fff640 1 -- 172.21.15.96:0/1528254151 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0030610 con 0x7fafc0072530 2023-12-01T23:47:51.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafb7fff640 1 -- 172.21.15.96:0/1528254151 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fafb0030770 con 0x7fafc0072530 2023-12-01T23:47:51.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafb7fff640 1 -- 172.21.15.96:0/1528254151 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0030b20 con 0x7fafc0072530 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 -- 172.21.15.96:0/1528254151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 msgr2=0x7fafc00c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 --2- 172.21.15.96:0/1528254151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc00c7350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fafb00097a0 tx=0x7fafb002b960 comp rx=0 tx=0).stop 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 -- 172.21.15.96:0/1528254151 shutdown_connections 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 --2- 172.21.15.96:0/1528254151 >> v2:172.21.15.96:3300/0 conn(0x7fafc00bff00 0x7fafc0159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 --2- 172.21.15.96:0/1528254151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc00c7350 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 -- 172.21.15.96:0/1528254151 >> 172.21.15.96:0/1528254151 conn(0x7fafc006cd60 msgr2=0x7fafc006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 -- 172.21.15.96:0/1528254151 shutdown_connections 2023-12-01T23:47:51.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.781+0000 7fafc76e7640 1 -- 172.21.15.96:0/1528254151 wait complete. 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.782+0000 7fafc76e7640 1 Processor -- start 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 -- start start 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc0156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc00bff00 0x7fafc01f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc014e220 con 0x7fafc0150610 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc014d8c0 con 0x7fafc00bff00 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.783+0000 7fafc76e7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc014e430 con 0x7fafc0072530 2023-12-01T23:47:51.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.784+0000 7fafc5c84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.784+0000 7fafc5c84640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46064/0 (socket says 172.21.15.96:46064) 2023-12-01T23:47:51.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.784+0000 7fafc5c84640 1 -- 172.21.15.96:0/3497434891 learned_addr learned my addr 172.21.15.96:0/3497434891 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:51.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.784+0000 7fafc5483640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc0156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.784+0000 7fafc4c82640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc00bff00 0x7fafc01f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.787+0000 7fafc5c84640 1 -- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 msgr2=0x7fafc0156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.787+0000 7fafc5c84640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc0156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.787+0000 7fafc5c84640 1 -- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc00bff00 msgr2=0x7fafc01f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.787+0000 7fafc5c84640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc00bff00 0x7fafc01f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:51.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.787+0000 7fafc5c84640 1 -- 172.21.15.96:0/3497434891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0009400 con 0x7fafc0150610 2023-12-01T23:47:51.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.789+0000 7fafc5c84640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fafb800efc0 tx=0x7fafb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:51.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.793+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800cd20 con 0x7fafc0150610 2023-12-01T23:47:51.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.793+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fafb800f040 con 0x7fafc0150610 2023-12-01T23:47:51.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.793+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0150cd0 con 0x7fafc0150610 2023-12-01T23:47:51.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.793+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003bf0 con 0x7fafc0150610 2023-12-01T23:47:51.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.793+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc0151290 con 0x7fafc0150610 2023-12-01T23:47:51.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.794+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0067570 con 0x7fafc0150610 2023-12-01T23:47:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.812+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafb8003d50 con 0x7fafc0150610 2023-12-01T23:47:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.812+0000 7fafb5ffb640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 0x7fafa406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:51.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.812+0000 7fafc5483640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 0x7fafa406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:51.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.813+0000 7fafc5483640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 0x7fafa406d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000f60 tx=0x7fafbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:51.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:51.814+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fafb80597d0 con 0x7fafc0150610 2023-12-01T23:47:52.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.050+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafb8055a80 con 0x7fafc0150610 2023-12-01T23:47:52.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.219+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafc00c63a0 con 0x7fafc0150610 2023-12-01T23:47:52.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.643+0000 7fafb5ffb640 1 -- 172.21.15.96:0/3497434891 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fafb80579b0 con 0x7fafc0150610 2023-12-01T23:47:52.645 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2023-12-01T23:47:52.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 msgr2=0x7fafa406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 0x7fafa406d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000f60 tx=0x7fafbc009040 comp rx=0 tx=0).stop 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 msgr2=0x7fafc01f1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fafb800efc0 tx=0x7fafb800c490 comp rx=0 tx=0).stop 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 shutdown_connections 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7fafa406ae90 0x7fafa406d350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fafc0150610 0x7fafc01f1310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc00bff00 0x7fafc01f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 --2- 172.21.15.96:0/3497434891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafc0072530 0x7fafc0156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 >> 172.21.15.96:0/3497434891 conn(0x7fafc006cd60 msgr2=0x7fafc0140880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:52.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 shutdown_connections 2023-12-01T23:47:52.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.645+0000 7fafc76e7640 1 -- 172.21.15.96:0/3497434891 wait complete. 2023-12-01T23:47:52.661 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-01T23:47:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.768+0000 7ff72efb6640 1 Processor -- start 2023-12-01T23:47:52.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.768+0000 7ff72efb6640 1 -- start start 2023-12-01T23:47:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.769+0000 7ff72efb6640 1 --2- >> v2:172.21.15.96:3300/0 conn(0x7ff728150570 0x7ff7280c8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.769+0000 7ff72efb6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff72806f7e0 0x7ff7281598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.769+0000 7ff72efb6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72806df40 con 0x7ff72806d690 2023-12-01T23:47:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.769+0000 7ff72efb6640 1 -- --> v2:172.21.15.96:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72806e220 con 0x7ff728150570 2023-12-01T23:47:52.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.769+0000 7ff72efb6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72806e500 con 0x7ff72806f7e0 2023-12-01T23:47:52.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.773+0000 7ff727fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff72806f7e0 0x7ff7281598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.773+0000 7ff727fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff72806f7e0 0x7ff7281598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:58640/0 (socket says 172.21.15.96:58640) 2023-12-01T23:47:52.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.773+0000 7ff727fff640 1 -- 172.21.15.96:0/770896648 learned_addr learned my addr 172.21.15.96:0/770896648 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.777+0000 7ff727fff640 1 -- 172.21.15.96:0/770896648 >> v2:172.21.15.96:3300/0 conn(0x7ff728150570 msgr2=0x7ff7280c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T23:47:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.777+0000 7ff727fff640 1 --2- 172.21.15.96:0/770896648 >> v2:172.21.15.96:3300/0 conn(0x7ff728150570 0x7ff7280c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.777+0000 7ff727fff640 1 -- 172.21.15.96:0/770896648 >> v1:172.21.15.102:6789/0 conn(0x7ff72806d690 legacy=0x7ff7280c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.777+0000 7ff727fff640 1 -- 172.21.15.96:0/770896648 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280c7960 con 0x7ff72806f7e0 2023-12-01T23:47:52.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.779+0000 7ff727fff640 1 --2- 172.21.15.96:0/770896648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806f7e0 0x7ff7281598a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff714009870 tx=0x7ff71402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ba5fdd7cee30194 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:52.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.784+0000 7ff7277fe640 1 -- 172.21.15.96:0/770896648 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71402f840 con 0x7ff72806f7e0 2023-12-01T23:47:52.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.786+0000 7ff7277fe640 1 -- 172.21.15.96:0/770896648 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff71402f9a0 con 0x7ff72806f7e0 2023-12-01T23:47:52.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.786+0000 7ff7277fe640 1 -- 172.21.15.96:0/770896648 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71402fd50 con 0x7ff72806f7e0 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 -- 172.21.15.96:0/770896648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806f7e0 msgr2=0x7ff7281598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 --2- 172.21.15.96:0/770896648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806f7e0 0x7ff7281598a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff714009870 tx=0x7ff71402ba20 comp rx=0 tx=0).stop 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 -- 172.21.15.96:0/770896648 shutdown_connections 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 --2- 172.21.15.96:0/770896648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806f7e0 0x7ff7281598a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 --2- 172.21.15.96:0/770896648 >> v2:172.21.15.96:3300/0 conn(0x7ff728150570 0x7ff7280c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 -- 172.21.15.96:0/770896648 >> 172.21.15.96:0/770896648 conn(0x7ff7280cbef0 msgr2=0x7ff7280cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:52.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 -- 172.21.15.96:0/770896648 shutdown_connections 2023-12-01T23:47:52.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.787+0000 7ff72efb6640 1 -- 172.21.15.96:0/770896648 wait complete. 2023-12-01T23:47:52.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.788+0000 7ff72efb6640 1 Processor -- start 2023-12-01T23:47:52.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.789+0000 7ff72efb6640 1 -- start start 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 0x7ff72814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff72806f7e0 0x7ff7280c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814b9a0 con 0x7ff72806f7e0 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814c7a0 con 0x7ff72806d690 2023-12-01T23:47:52.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72efb6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72814c1e0 con 0x7ff728150570 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff727fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff72806f7e0 0x7ff7280c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72d553640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.790+0000 7ff72cd52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 0x7ff72814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.791+0000 7ff72cd52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 0x7ff72814b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.96:58652/0 (socket says 172.21.15.96:58652) 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.791+0000 7ff72cd52640 1 -- 172.21.15.96:0/2723528805 learned_addr learned my addr 172.21.15.96:0/2723528805 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-12-01T23:47:52.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.791+0000 7ff72d553640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.96:43460/0 (socket says 172.21.15.96:43460) 2023-12-01T23:47:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.794+0000 7ff72d553640 1 -- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 msgr2=0x7ff72814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.794+0000 7ff72d553640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 0x7ff72814b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.794+0000 7ff72d553640 1 -- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff72806f7e0 msgr2=0x7ff7280c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.794+0000 7ff72d553640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff72806f7e0 0x7ff7280c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:52.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.794+0000 7ff72d553640 1 -- 172.21.15.96:0/2723528805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140094d0 con 0x7ff728150570 2023-12-01T23:47:52.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.796+0000 7ff72d553640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c6c0 tx=0x7ff72000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.800+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720003b70 con 0x7ff728150570 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.800+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff720003cd0 con 0x7ff728150570 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.800+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720005310 con 0x7ff728150570 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.800+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72814c4c0 con 0x7ff728150570 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.800+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7281578b0 con 0x7ff728150570 2023-12-01T23:47:52.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:52.801+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7280740e0 con 0x7ff728150570 2023-12-01T23:47:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.046+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff720005470 con 0x7ff728150570 2023-12-01T23:47:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.046+0000 7ff7257fa640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 0x7ff70c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T23:47:53.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.046+0000 7ff72cd52640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 0x7ff70c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T23:47:53.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.047+0000 7ff72cd52640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 0x7ff70c06d350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0099a0 tx=0x7ff71c006f90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T23:47:53.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.054+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5781+0+0 (secure 0 0 0) 0x7ff720058ba0 con 0x7ff728150570 2023-12-01T23:47:53.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.069+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff720054ee0 con 0x7ff728150570 2023-12-01T23:47:53.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.241+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff72814ceb0 con 0x7ff728150570 2023-12-01T23:47:53.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.807+0000 7ff7257fa640 1 -- 172.21.15.96:0/2723528805 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff720058500 con 0x7ff728150570 2023-12-01T23:47:53.810 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' removed 2023-12-01T23:47:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.811+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 msgr2=0x7ff70c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.811+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 0x7ff70c06d350 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0099a0 tx=0x7ff71c006f90 comp rx=0 tx=0).stop 2023-12-01T23:47:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.811+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 msgr2=0x7ff7281f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T23:47:53.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.811+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff72000c6c0 tx=0x7ff72000cb80 comp rx=0 tx=0).stop 2023-12-01T23:47:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 shutdown_connections 2023-12-01T23:47:53.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:6800/3997971778,v1:172.21.15.96:6801/3997971778] conn(0x7ff70c06ae90 0x7ff70c06d350 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff728150570 0x7ff7281f0530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff72806f7e0 0x7ff7280c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 --2- 172.21.15.96:0/2723528805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff72806d690 0x7ff72814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T23:47:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.813+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 >> 172.21.15.96:0/2723528805 conn(0x7ff7280cbef0 msgr2=0x7ff72814d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T23:47:53.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.814+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 shutdown_connections 2023-12-01T23:47:53.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-12-01T23:47:53.814+0000 7ff72efb6640 1 -- 172.21.15.96:0/2723528805 wait complete. 2023-12-01T23:47:53.832 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-01T23:47:53.832 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-01T23:47:53.832 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:47:53.846 INFO:tasks.ceph.mds.a.smithi096.stderr:2023-12-01T23:47:53.835+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 92781) UID: 0 2023-12-01T23:47:53.846 INFO:tasks.ceph.mds.a.smithi096.stderr:2023-12-01T23:47:53.837+0000 b5aa640 -1 mds.a *** got signal Terminated *** 2023-12-01T23:47:57.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-01T23:47:57.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2023-12-01T23:47:59.934 INFO:tasks.ceph.mds.a:Stopped 2023-12-01T23:47:59.934 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-01T23:47:59.934 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:47:59.950 INFO:tasks.ceph.mds.c.smithi096.stderr:2023-12-01T23:47:59.938+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 92784) UID: 0 2023-12-01T23:47:59.951 INFO:tasks.ceph.mds.c.smithi096.stderr:2023-12-01T23:47:59.940+0000 b5aa640 -1 mds.c *** got signal Terminated *** 2023-12-01T23:48:04.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~14s 2023-12-01T23:48:04.614 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-01T23:48:06.036 INFO:tasks.ceph.mds.c:Stopped 2023-12-01T23:48:06.037 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-12-01T23:48:06.037 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:06.052 INFO:tasks.ceph.mds.e.smithi096.stderr:2023-12-01T23:48:06.040+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 92785) UID: 0 2023-12-01T23:48:06.052 INFO:tasks.ceph.mds.e.smithi096.stderr:2023-12-01T23:48:06.041+0000 b5aa640 -1 mds.e *** got signal Terminated *** 2023-12-01T23:48:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2023-12-01T23:48:11.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~20s 2023-12-01T23:48:12.139 INFO:tasks.ceph.mds.e:Stopped 2023-12-01T23:48:12.139 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-01T23:48:12.139 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:12.155 INFO:tasks.ceph.mds.b.smithi102.stderr:2023-12-01T23:48:12.143+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 92481) UID: 0 2023-12-01T23:48:12.155 INFO:tasks.ceph.mds.b.smithi102.stderr:2023-12-01T23:48:12.145+0000 b5aa640 -1 mds.b *** got signal Terminated *** 2023-12-01T23:48:12.617 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:48:12.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:48:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-01T23:48:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~27s 2023-12-01T23:48:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2023-12-01T23:48:18.240 INFO:tasks.ceph.mds.b:Stopped 2023-12-01T23:48:18.241 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-01T23:48:18.241 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:18.256 INFO:tasks.ceph.mds.d.smithi102.stderr:2023-12-01T23:48:18.244+0000 b5aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 92483) UID: 0 2023-12-01T23:48:18.256 INFO:tasks.ceph.mds.d.smithi102.stderr:2023-12-01T23:48:18.246+0000 b5aa640 -1 mds.d *** got signal Terminated *** 2023-12-01T23:48:23.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-01T23:48:23.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~33s 2023-12-01T23:48:23.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-01T23:48:24.343 INFO:tasks.ceph.mds.d:Stopped 2023-12-01T23:48:24.343 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-12-01T23:48:24.343 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:24.343 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-01T23:48:24.343 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f" 2023-12-01T23:48:24.344 INFO:tasks.ceph.mds.f:Stopped 2023-12-01T23:48:24.345 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-01T23:48:24.345 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-01T23:48:24.345 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:24.346 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:48:24.345+0000 7f8b8e3c8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 88897) UID: 0 2023-12-01T23:48:24.346 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-12-01T23:48:24.345+0000 7f8b8e3c8640 -1 osd.0 38 *** Got signal Terminated *** 2023-12-01T23:48:30.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-01T23:48:30.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2023-12-01T23:48:30.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-01T23:48:30.446 INFO:tasks.ceph.osd.0:Stopped 2023-12-01T23:48:30.446 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-01T23:48:30.446 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:30.448 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:48:30.447+0000 7fafa0a72640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 88898) UID: 0 2023-12-01T23:48:30.448 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-12-01T23:48:30.447+0000 7fafa0a72640 -1 osd.1 40 *** Got signal Terminated *** 2023-12-01T23:48:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-01T23:48:36.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-01T23:48:36.548 INFO:tasks.ceph.osd.1:Stopped 2023-12-01T23:48:36.548 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-01T23:48:36.548 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:36.549 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:48:36.549+0000 7fa3fb413640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 88901) UID: 0 2023-12-01T23:48:36.549 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-12-01T23:48:36.549+0000 7fa3fb413640 -1 osd.2 41 *** Got signal Terminated *** 2023-12-01T23:48:42.180 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-01T23:48:42.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-01T23:48:42.649 INFO:tasks.ceph.osd.2:Stopped 2023-12-01T23:48:42.650 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-01T23:48:42.650 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:42.651 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:48:42.650+0000 7efe65309640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 88902) UID: 0 2023-12-01T23:48:42.651 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-12-01T23:48:42.650+0000 7efe65309640 -1 osd.3 42 *** Got signal Terminated *** 2023-12-01T23:48:42.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:48:42.679 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:48:48.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-01T23:48:48.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-01T23:48:48.752 INFO:tasks.ceph.osd.3:Stopped 2023-12-01T23:48:48.752 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-01T23:48:48.753 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:48.753 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:48:48.753+0000 7f8fd7b63640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 88915) UID: 0 2023-12-01T23:48:48.753 INFO:tasks.ceph.osd.4.smithi102.stderr:2023-12-01T23:48:48.753+0000 7f8fd7b63640 -1 osd.4 43 *** Got signal Terminated *** 2023-12-01T23:48:53.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-01T23:48:53.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-01T23:48:54.854 INFO:tasks.ceph.osd.4:Stopped 2023-12-01T23:48:54.857 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-01T23:48:54.857 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:48:54.858 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:48:54.858+0000 7f3bffb33640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 88916) UID: 0 2023-12-01T23:48:54.858 INFO:tasks.ceph.osd.5.smithi102.stderr:2023-12-01T23:48:54.858+0000 7f3bffb33640 -1 osd.5 44 *** Got signal Terminated *** 2023-12-01T23:48:59.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-01T23:48:59.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-01T23:49:00.959 INFO:tasks.ceph.osd.5:Stopped 2023-12-01T23:49:00.959 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-01T23:49:00.960 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:00.961 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:49:00.960+0000 7f1564f39640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 88921) UID: 0 2023-12-01T23:49:00.961 INFO:tasks.ceph.osd.6.smithi102.stderr:2023-12-01T23:49:00.960+0000 7f1564f39640 -1 osd.6 45 *** Got signal Terminated *** 2023-12-01T23:49:05.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-01T23:49:05.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-01T23:49:05.905 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:31:24.811 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.906 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:31:24.812 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.948 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:31:24.854 88566== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.961 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:31:24.813 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.962 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:31:24.814 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.963 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:31:24.815 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:05.965 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:31:24.818 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:06.010 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:31:24.862 88342== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:06.015 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:31:24.867 88341== Warning: unimplemented fcntl command: 1036 2023-12-01T23:49:07.061 INFO:tasks.ceph.osd.6:Stopped 2023-12-01T23:49:07.061 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-01T23:49:07.061 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:07.062 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:49:07.062+0000 7f05f2702640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 88919) UID: 0 2023-12-01T23:49:07.062 INFO:tasks.ceph.osd.7.smithi102.stderr:2023-12-01T23:49:07.062+0000 7f05f2702640 -1 osd.7 45 *** Got signal Terminated *** 2023-12-01T23:49:10.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-01T23:49:10.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-01T23:49:12.743 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:12.746 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:13.163 INFO:tasks.ceph.osd.7:Stopped 2023-12-01T23:49:13.163 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-01T23:49:13.163 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-01T23:49:13.163 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:13.192 INFO:tasks.ceph.mgr.y:Stopped 2023-12-01T23:49:13.192 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-01T23:49:13.193 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:13.219 INFO:tasks.ceph.mgr.x:Stopped 2023-12-01T23:49:13.219 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-01T23:49:13.219 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-01T23:49:13.220 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:13.248 INFO:tasks.ceph.mon.a.smithi096.stderr:2023-12-01T23:49:13.236+0000 9f55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 88543) UID: 0 2023-12-01T23:49:13.248 INFO:tasks.ceph.mon.a.smithi096.stderr:2023-12-01T23:49:13.238+0000 9f55640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-01T23:49:13.966 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:31:32.872 88566== 2023-12-01T23:49:13.966 INFO:tasks.ceph.mon.a.smithi096.stderr:==00:00:31:32.872 88566== Exit program on first error (--exit-on-first-error=yes) 2023-12-01T23:49:13.979 INFO:tasks.ceph.mon.a.smithi096.stderr:daemon-helper: command failed with exit status 42 2023-12-01T23:49:15.916 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-01T23:49:15.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-01T23:49:19.322 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-01T23:49:19.322 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi096 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-12-01T23:49:19.323 INFO:tasks.ceph.mon.a:Stopped 2023-12-01T23:49:19.324 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-01T23:49:19.324 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:19.338 INFO:tasks.ceph.mon.b.smithi102.stderr:2023-12-01T23:49:19.327+0000 9f55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 88334) UID: 0 2023-12-01T23:49:19.339 INFO:tasks.ceph.mon.b.smithi102.stderr:2023-12-01T23:49:19.329+0000 9f55640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-01T23:49:19.840 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:31:38.692 88341== 2023-12-01T23:49:19.840 INFO:tasks.ceph.mon.b.smithi102.stderr:==00:00:31:38.692 88341== Exit program on first error (--exit-on-first-error=yes) 2023-12-01T23:49:19.850 INFO:tasks.ceph.mon.b.smithi102.stderr:daemon-helper: command failed with exit status 42 2023-12-01T23:49:21.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-01T23:49:21.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-01T23:49:25.425 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-01T23:49:25.425 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-12-01T23:49:25.426 INFO:tasks.ceph.mon.b:Stopped 2023-12-01T23:49:25.426 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-01T23:49:25.426 INFO:teuthology.orchestra.run:waiting for 300 2023-12-01T23:49:25.454 INFO:tasks.ceph.mon.c.smithi102.stderr:2023-12-01T23:49:25.430+0000 9f55640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 88337) UID: 0 2023-12-01T23:49:25.455 INFO:tasks.ceph.mon.c.smithi102.stderr:2023-12-01T23:49:25.431+0000 9f55640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2023-12-01T23:49:26.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-01T23:49:26.571 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:31:45.423 88342== 2023-12-01T23:49:26.571 INFO:tasks.ceph.mon.c.smithi102.stderr:==00:00:31:45.423 88342== Exit program on first error (--exit-on-first-error=yes) 2023-12-01T23:49:26.581 INFO:tasks.ceph.mon.c.smithi102.stderr:daemon-helper: command failed with exit status 42 2023-12-01T23:49:31.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-01T23:49:31.528 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-12-01T23:49:31.528 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi102 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-12-01T23:49:31.528 INFO:tasks.ceph.mon.c:Stopped 2023-12-01T23:49:31.529 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-01T23:49:31.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2023-12-01T23:49:31.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:49:31.567 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-01T23:49:31.677 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:49:31.678 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-01T23:49:31.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:49:31.734 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-01T23:49:31.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:49:31.793 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-01T23:49:31.853 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:49:31.853 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-01T23:49:32.065 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:49:32.065 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-01T23:49:32.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:49:32.148 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-01T23:49:32.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:49:32.196 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-01T23:49:32.254 INFO:tasks.ceph:Archiving mon data... 2023-12-01T23:49:32.256 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/data/mon.a.tgz 2023-12-01T23:49:32.256 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-12-01T23:49:32.273 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.b1J6Muznjh 2023-12-01T23:49:32.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.b1J6Muznjh 2023-12-01T23:49:32.467 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.b1J6Muznjh 2023-12-01T23:49:32.553 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.b1J6Muznjh is 308KB 2023-12-01T23:49:32.651 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.b1J6Muznjh 2023-12-01T23:49:32.666 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/data/mon.b.tgz 2023-12-01T23:49:32.666 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-12-01T23:49:32.682 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.FjrXbfxUIl 2023-12-01T23:49:32.683 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FjrXbfxUIl 2023-12-01T23:49:32.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.FjrXbfxUIl 2023-12-01T23:49:32.902 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.FjrXbfxUIl is 309KB 2023-12-01T23:49:32.996 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.FjrXbfxUIl 2023-12-01T23:49:33.010 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/data/mon.c.tgz 2023-12-01T23:49:33.011 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2023-12-01T23:49:33.065 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.x2R3ph7jq0 2023-12-01T23:49:33.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.x2R3ph7jq0 2023-12-01T23:49:33.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.x2R3ph7jq0 2023-12-01T23:49:33.271 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.x2R3ph7jq0 is 309KB 2023-12-01T23:49:33.365 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.x2R3ph7jq0 2023-12-01T23:49:33.379 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-01T23:49:33.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-01T23:49:33.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-01T23:49:33.732 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-01T23:49:34.001 INFO:tasks.ceph:Archiving crash dumps... 2023-12-01T23:49:34.002 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi096/crash 2023-12-01T23:49:34.003 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T23:49:34.032 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi102/crash 2023-12-01T23:49:34.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-01T23:49:34.059 INFO:tasks.ceph:Shutting down logrotate 2023-12-01T23:49:34.060 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:34.076 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:34.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:34.229 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-01T23:49:34.256 INFO:tasks.ceph:Compressing logs... 2023-12-01T23:49:34.257 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T23:49:34.272 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-01T23:49:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99877.log 2023-12-01T23:49:34.296 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101572.log 2023-12-01T23:49:34.345 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-01T23:49:34.345 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88573.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88693.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.88573.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88573.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88693.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/valgrind/mon.c.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.88693.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/valgrind/mds.b.log: /var/log/ceph/valgrind/mon.b.log: 57.4%gzip -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.88824.log 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2023-12-01T23:49:34.346 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr: 57.2% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88824.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.88824.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88653.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88533.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88653.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.88653.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88613.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88533.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88613.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr: 88.1%/var/log/ceph/ceph-osd.7.log: -- replaced with /var/log/ceph/ceph-client.admin.88613.log.gz 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-01T23:49:34.347 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88733.log 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88733.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88733.log.gz 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-01T23:49:34.348 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88784.log 2023-12-01T23:49:34.352 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.d.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-01T23:49:34.352 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-01T23:49:34.352 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.88784.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88784.log.gz 2023-12-01T23:49:34.357 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-01T23:49:34.373 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93673.log 2023-12-01T23:49:34.373 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99877.log: /var/log/ceph/ceph-client.admin.101572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92923.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99877.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93673.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101572.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93673.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.92923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100458.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.a.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92923.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97240.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95404.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100458.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97240.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94554.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100374.log 2023-12-01T23:49:34.374 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94554.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.97240.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95404.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99525.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94554.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95320.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100374.log: /var/log/ceph/ceph-client.admin.99525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95278.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100374.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95320.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99525.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97030.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.95320.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101446.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97030.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95278.log.gz 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101446.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97030.log.gzgzip 2023-12-01T23:49:34.375 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101446.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 57.4% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96946.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 74.7% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/valgrind/mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97368.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101278.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96946.log.gz 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94780.log 2023-12-01T23:49:34.376 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5%/var/log/ceph/ceph-client.admin.101278.log: -- replaced with /var/log/ceph/ceph-client.admin.97368.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96373.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94780.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101278.log.gz -5 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94638.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94780.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96568.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96373.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94680.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94638.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101530.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94680.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.96568.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94906.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101530.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94680.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93109.log 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101530.log.gz 2023-12-01T23:49:34.377 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100332.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94906.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101076.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100332.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93109.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93715.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100332.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97072.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93715.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101076.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93823.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97072.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93715.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88582.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97072.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101488.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93823.log.gz 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.88582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100500.log 2023-12-01T23:49:34.378 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101320.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101488.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100416.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.88582.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.95068.log/var/log/ceph/ceph-client.admin.101320.log: -- replaced with /var/log/ceph/ceph-client.admin.100500.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96736.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101320.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95068.log: gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.100416.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95488.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96736.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95068.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95895.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96736.log.gz 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93361.log 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95895.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.95488.log.gz -5 2023-12-01T23:49:34.379 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99651.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93361.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95895.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99567.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93361.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93403.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99567.log: gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.99651.log.gz /var/log/ceph/ceph-client.admin.100247.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99567.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95665.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93403.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97114.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97156.log 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100247.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97114.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.95665.log.gz 2023-12-01T23:49:34.380 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97114.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95959.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99961.log 88.5% 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97156.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95922.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95959.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100542.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95922.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99961.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95026.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95922.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99609.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100542.log: /var/log/ceph/ceph-client.admin.95026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101136.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100542.log.gz 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96988.log 2023-12-01T23:49:34.381 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95026.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101136.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.99609.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96610.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101136.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93151.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96610.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.96988.log.gz --verbose 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: -- /var/log/ceph/ceph-client.admin.92792.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96610.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96525.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.92792.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93151.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100836.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96525.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.92792.log.gz --verbose 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: -- /var/log/ceph/ceph-client.admin.99693.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96525.log.gz 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95663.log 2023-12-01T23:49:34.382 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100836.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99693.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95663.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.99693.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.95886.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95663.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93757.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95661.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93757.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95886.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88943.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100962.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95661.log: /var/log/ceph/ceph-client.admin.88943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96202.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.95661.log.gz -- replaced with /var/log/ceph/ceph-client.admin.93757.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88943.log.gz 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95110.log 2023-12-01T23:49:34.383 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100752.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100962.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96202.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97198.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100752.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95110.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94246.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100752.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.97198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95664.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97198.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93589.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95664.log: /var/log/ceph/ceph-client.admin.93589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100710.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95664.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93589.log.gz 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95945.log 2023-12-01T23:49:34.384 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94822.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0%/var/log/ceph/ceph-client.admin.95945.log: -- replaced with /var/log/ceph/ceph-client.admin.100710.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94948.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.94246.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94822.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95945.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95666.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94822.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95236.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99793.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95666.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94948.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95194.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95666.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95236.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100584.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93319.log 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95194.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99793.log.gz 2023-12-01T23:49:34.385 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100584.log: gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95194.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: -- /var/log/ceph/ceph-client.admin.95667.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2%/var/log/ceph/ceph-client.admin.93319.log: -- replaced with /var/log/ceph/ceph-client.admin.100584.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82565.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93319.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95669.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95667.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.tmp-client.admin.82565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94470.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82565.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93067.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95669.log: /var/log/ceph/ceph-client.admin.94470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100121.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95669.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94470.log.gz 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94512.log 2023-12-01T23:49:34.386 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96333.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100121.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93067.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95670.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100121.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96333.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.94512.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94596.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96333.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99483.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94596.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95670.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93277.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94596.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99483.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101236.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93277.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93277.log.gz 2023-12-01T23:49:34.387 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95362.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.y.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95446.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101236.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101196.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95446.log: gzip -5 87.7% --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95362.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95446.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99751.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100290.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101196.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99751.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100878.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99751.log.gz 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5/var/log/ceph/ceph-client.admin.100290.log: --verbose -- /var/log/ceph/ceph-client.admin.96904.log 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100878.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100290.log.gzgzip 2023-12-01T23:49:34.388 INFO:teuthology.orchestra.run.smithi096.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100920.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100878.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93631.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96904.log: /var/log/ceph/ceph-client.admin.100920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94864.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93631.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100920.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93631.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94738.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94864.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94864.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.94738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93235.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: 88.7%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.94738.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93547.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101362.log 2023-12-01T23:49:34.389 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93235.log: /var/log/ceph/ceph-client.admin.93547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100205.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93235.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93547.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101362.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99919.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96046.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100205.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89062.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99919.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95966.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1%/var/log/ceph/ceph-client.admin.89062.log: -- replaced with /var/log/ceph/ceph-client.admin.96046.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89062.log.gz 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101404.log 2023-12-01T23:49:34.390 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95966.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96045.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101404.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101404.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92837.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96045.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.92837.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92837.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96252.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.c.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96652.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96252.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96252.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100794.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96652.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96652.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96459.log 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100794.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100794.log.gz 2023-12-01T23:49:34.391 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95152.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96459.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96459.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93004.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.95152.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.95152.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93487.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101034.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93004.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96312.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.101034.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93487.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101034.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96694.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96312.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96312.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100668.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99835.log 2023-12-01T23:49:34.392 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96694.log: /var/log/ceph/ceph-client.admin.100668.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96694.log.gz 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100668.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96222.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93193.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.99835.log: /var/log/ceph/ceph-client.admin.96222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96222.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99835.log.gz 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93445.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.93193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97755.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93193.log.gz/var/log/ceph/ceph-client.admin.93445.log: 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr: 89.2%/var/log/ceph/ceph-client.0.97755.log: -- replaced with /var/log/ceph/ceph-client.admin.93445.log.gz 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92675.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.96778.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100163.log 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.92675.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92675.log.gz 2023-12-01T23:49:34.393 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-01T23:49:34.394 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100163.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100163.log.gz 2023-12-01T23:49:34.394 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100626.log 2023-12-01T23:49:34.394 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.a.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-01T23:49:34.394 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.100626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.100626.log.gz 2023-12-01T23:49:34.614 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-01T23:49:34.845 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-01T23:49:35.000 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-01T23:49:35.276 INFO:teuthology.orchestra.run.smithi096.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-01T23:49:36.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-01T23:49:36.918 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-01T23:49:37.675 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-01T23:49:37.715 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-01T23:49:37.797 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-01T23:49:37.851 INFO:teuthology.orchestra.run.smithi096.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-01T23:49:38.173 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-01T23:49:38.783 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-01T23:49:39.246 INFO:teuthology.orchestra.run.smithi096.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-01T23:49:46.234 INFO:teuthology.orchestra.run.smithi096.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.97755.log.gz 2023-12-01T23:49:46.235 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-12-01T23:49:46.235 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m11.951s 2023-12-01T23:49:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m27.223s 2023-12-01T23:49:46.236 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.943s 2023-12-01T23:49:53.860 INFO:teuthology.orchestra.run.smithi102.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2023-12-01T23:49:53.862 INFO:teuthology.orchestra.run.smithi102.stderr: 2023-12-01T23:49:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m19.545s 2023-12-01T23:49:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m34.160s 2023-12-01T23:49:53.862 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m1.145s 2023-12-01T23:49:53.862 INFO:tasks.ceph:Archiving logs... 2023-12-01T23:49:53.862 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi096/log 2023-12-01T23:49:53.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T23:49:58.261 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi102/log 2023-12-01T23:49:58.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T23:50:03.281 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-01T23:50:03.282 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-01T23:50:03.291 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_bed7681480ccb0192b91a35e691658867e1e96b7/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-01T23:50:03.291 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-01T23:50:03.292 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T23:50:03.294 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T23:50:03.384 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-01T23:50:03.394 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-01T23:50:03.394 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T23:50:03.396 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T23:50:03.410 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2023-12-01T23:50:03.412 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2023-12-01T23:50:03.414 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T23:50:03.414 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-12-01T23:50:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 113 -645us[ -749us] +/- 74ms 2023-12-01T23:50:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv02.front.sepia.ceph.com 3 8 377 49 -193us[ -297us] +/- 51ms 2023-12-01T23:50:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +865us[ +760us] +/- 70ms 2023-12-01T23:50:03.415 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:50:03.416 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T23:50:03.416 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2023-12-01T23:50:03.417 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 -637us[ -637us] +/- 75ms 2023-12-01T23:50:03.417 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -196us[ -176us] +/- 51ms 2023-12-01T23:50:03.417 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +922us[ +922us] +/- 70ms 2023-12-01T23:50:03.417 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T23:50:03.417 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-01T23:50:03.427 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-01T23:50:03.427 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-01T23:50:03.452 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-01T23:50:03.558 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-01T23:50:03.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T23:50:03.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:50:03.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T23:50:03.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:50:03.722 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-01T23:50:03.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-01T23:50:03.761 INFO:teuthology.task.internal:Duration was 2782.130789 seconds 2023-12-01T23:50:03.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-01T23:50:03.795 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-01T23:50:03.795 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T23:50:03.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T23:50:03.839 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T23:50:03.841 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T23:50:04.371 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-01T23:50:04.371 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2023-12-01T23:50:04.371 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T23:50:04.392 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2023-12-01T23:50:04.393 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T23:50:04.445 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-01T23:50:04.446 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T23:50:04.448 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T23:50:04.515 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-01T23:50:04.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T23:50:04.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T23:50:04.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-01T23:50:04.672 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-01T23:50:04.672 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T23:50:04.699 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T23:50:04.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-01T23:50:04.736 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T23:50:04.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T23:50:04.763 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2023-12-01T23:50:04.791 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2023-12-01T23:50:04.814 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T23:50:04.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:50:04.835 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T23:50:04.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T23:50:04.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-01T23:50:04.878 INFO:teuthology.task.internal:Transferring archived files... 2023-12-01T23:50:04.879 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi096 2023-12-01T23:50:04.879 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T23:50:04.917 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453/remote/smithi102 2023-12-01T23:50:04.918 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T23:50:04.953 INFO:teuthology.task.internal:Removing archive directory... 2023-12-01T23:50:04.953 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-01T23:50:04.956 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-01T23:50:05.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-01T23:50:05.014 INFO:teuthology.task.internal:Not uploading archives. 2023-12-01T23:50:05.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-01T23:50:05.046 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-01T23:50:05.046 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T23:50:05.048 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T23:50:05.060 INFO:teuthology.orchestra.run.smithi096.stdout: 265874 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 23:50 /home/ubuntu/cephtest 2023-12-01T23:50:05.062 INFO:teuthology.orchestra.run.smithi102.stdout: 265244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 23:50 /home/ubuntu/cephtest 2023-12-01T23:50:05.063 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-01T23:50:05.079 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-01T23:50:05.115 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2023-12-01T23:50:05.115 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T23:50:05.142 DEBUG:teuthology.nuke:shortname: smithi096 2023-12-01T23:50:05.143 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T23:50:05.167 DEBUG:teuthology.nuke:shortname: smithi102 2023-12-01T23:50:05.167 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T23:50:05.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 22:55:24.293873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD5u9+uNlGB2YWutX3Cmr7b6ud89iTWgYtn5XMcLs4DdTp8j0oxlfDvkBy0pyaEvFYIQjLgWqbo2HtWPfGBa7kA='} 2023-12-01T23:50:05.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_17:57:53-fs-main-distro-default-smithi/7474453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 22:55:24.295314', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJoqpsyrcBEMH2A5n6a8bsSeKBPM4Y72Gd+vAxFAmxwZHLJJnTUq2/QNgjtMlgdLqfmCc/XAZefFGkJSmG4+TWc='} 2023-12-01T23:50:05.224 INFO:teuthology.orchestra.console.smithi096:Power off 2023-12-01T23:50:05.224 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T23:50:05.248 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-12-01T23:50:05.248 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:05.267 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-01T23:50:05.267 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T23:50:05.278 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-12-01T23:50:05.290 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-01T23:50:05.290 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:05.316 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-01T23:50:09.279 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:09.317 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:09.390 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-12-01T23:50:09.428 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-01T23:50:13.393 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:13.429 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T23:50:13.504 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-12-01T23:50:13.539 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-01T23:50:13.605 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-12-01T23:50:13.640 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-01T23:50:13.745 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 2782.130789041519 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-01T23:50:13.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T23:50:13.824 INFO:teuthology.run:FAIL